Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 704180 Details for
Bug 917042
[TEXT] when task fails but cleanup is successful the exit state of the task is 'cleanSuccess' which is confusing
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log
vdsm.log (text/x-log), 7.49 MB, created by
Katarzyna Jachim
on 2013-03-01 14:09:15 UTC
(
hide
)
Description:
vdsm log
Filename:
MIME Type:
Creator:
Katarzyna Jachim
Created:
2013-03-01 14:09:15 UTC
Size:
7.49 MB
patch
obsolete
>MainThread::INFO::2013-02-26 04:08:38,862::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-26 04:08:38,870::task::568::TaskManager.Task::(_updateState) Task=`794af91e-f948-4442-ab54-17479d4907d8`::moving from state init -> state preparing >MainThread::INFO::2013-02-26 04:08:38,870::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-26 04:08:38,871::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-26 04:08:38,876::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,878::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,933::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,934::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,936::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,937::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,938::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,940::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,941::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,942::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,943::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,945::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,946::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,947::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,949::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,950::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,951::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,953::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,954::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,955::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,956::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,958::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,959::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,960::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,962::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,963::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,964::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,966::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,967::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,968::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,970::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,971::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,972::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,973::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:38,975::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:08:39,087::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-26 04:08:39,088::taskManager::86::TaskManager::(prepareForShutdown) c688bae4-3ac3-4952-a99f-0e15260ab9ff >MainThread::INFO::2013-02-26 04:08:39,088::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-26 04:08:39,088::task::1151::TaskManager.Task::(prepare) Task=`794af91e-f948-4442-ab54-17479d4907d8`::finished: None >MainThread::DEBUG::2013-02-26 04:08:39,088::task::568::TaskManager.Task::(_updateState) Task=`794af91e-f948-4442-ab54-17479d4907d8`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-26 04:08:39,088::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-26 04:08:39,088::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-26 04:08:39,089::task::957::TaskManager.Task::(_decref) Task=`794af91e-f948-4442-ab54-17479d4907d8`::ref 0 aborting False >MainThread::INFO::2013-02-26 04:08:39,089::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-02-26 04:08:39,089::vdsm::99::vds::(run) <_MainThread(MainThread, started 140642633250560)> >MainThread::INFO::2013-02-26 04:08:39,089::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140642540689152)> >MainThread::INFO::2013-02-26 04:08:39,089::vdsm::99::vds::(run) <WorkerThread(6eab4ef0-5bce-438f-81d8-72d2a6840d44, started daemon 140642327983872)> >MainThread::INFO::2013-02-26 04:08:39,089::vdsm::99::vds::(run) <WorkerThread(0cf5b53f-091a-4f13-b424-b4ccd92dee2b, started daemon 140641925330688)> >MainThread::INFO::2013-02-26 04:08:39,090::vdsm::99::vds::(run) <WorkerThread(dfe0fc68-ccf8-46f3-baf0-82ddf89a967e, started daemon 140642407909120)> >MainThread::INFO::2013-02-26 04:08:39,090::vdsm::99::vds::(run) <WorkerThread(d1d06a67-60a3-4a9c-93c2-8aba60ebc82d, started daemon 140642296514304)> >MainThread::INFO::2013-02-26 04:08:39,090::vdsm::99::vds::(run) <WorkerThread(f39ee77e-54da-44f6-90ed-99a8d173be60, started daemon 140642307004160)> >MainThread::INFO::2013-02-26 04:08:39,090::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-26 04:08:39,090::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 140641445078784)> >MainThread::INFO::2013-02-26 04:08:39,090::vdsm::99::vds::(run) <WorkerThread(c688bae4-3ac3-4952-a99f-0e15260ab9ff, started daemon 140641904350976)> >MainThread::INFO::2013-02-26 04:08:39,090::vdsm::99::vds::(run) <WorkerThread(653095ca-8287-4d52-8a89-8fc21113a64e, started daemon 140642286024448)> >MainThread::INFO::2013-02-26 04:08:39,091::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140641455568640)> >MainThread::INFO::2013-02-26 04:08:39,091::vdsm::99::vds::(run) <WorkerThread(d42e396e-d321-4edf-92e4-431fec53dc74, started daemon 140642275534592)> >MainThread::INFO::2013-02-26 04:08:39,091::vdsm::99::vds::(run) <WorkerThread(5efe8fcc-0ae5-4a18-8ac1-af976e0a827e, started daemon 140641914840832)> >MainThread::INFO::2013-02-26 04:08:39,091::vdsm::99::vds::(run) <WorkerThread(ce90d310-c662-4f8e-b344-ebb6494eae33, started daemon 140642317494016)> >MainThread::INFO::2013-02-26 04:12:41,467::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-26 04:12:42,998::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-26 04:12:42,998::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-26 04:12:43,007::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-26 04:12:43,677::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,679::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,681::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,683::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,684::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,685::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,687::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,688::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,691::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,693::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,695::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,696::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,699::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,700::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,702::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,703::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,704::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,705::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,707::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,708::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,710::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,711::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,712::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,713::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,716::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,718::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,721::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,723::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,726::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,727::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,728::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,729::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,731::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,732::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,734::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:12:43,845::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-26 04:12:43,846::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 78b2a90f-48c5-44b4-9cb0-00bc23f9c41e 7922 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-26 04:12:44,523::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-26 04:12:44,524::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-26 04:12:44,524::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-26 04:12:44,524::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-26 04:12:44,524::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-26 04:12:44,524::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-26 04:12:44,527::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-26 04:12:45,853::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-26 04:12:45,859::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-26 04:12:45,859::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-26 04:12:46,044::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-26 04:12:46,045::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-26 04:12:46,046::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-26 04:12:46,046::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-26 04:12:46,047::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-26 04:12:46,118::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-26 04:12:46,120::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-26 04:12:46,120::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:46,124::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-26 04:12:46,142::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-26 04:12:46,143::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-26 04:12:46,170::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-26 04:12:46,170::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-26 04:12:46,171::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-26 04:12:46,172::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-26 04:12:46,178::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-26 04:12:46,181::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-26 04:12:46,181::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-26 04:12:46,204::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-26 04:12:46,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-26 04:12:46,231::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:12:46,317::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:12:46,318::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:46,318::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:46,319::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:12:46,499::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:12:46,500::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:46,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:12:46,679::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:12:46,680::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-26 04:12:46,680::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 04:12:46,681::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-26 04:12:46,681::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 04:12:46,681::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:12:46,703::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:12:46,704::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:46,706::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,712::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,715::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,717::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:12:47,725::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-26 04:12:49,729::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:12:52,329::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:12:52,329::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:52,336::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:52,336::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:52,337::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:52,337::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:52,337::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:12:52,338::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-26 04:12:52,338::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-26 04:13:47,740::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-26 04:13:48,345::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-26 04:13:48,457::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-26 04:13:48,621::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-02-26 04:13:48,717::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getCapabilities with () {} >Thread-15::DEBUG::2013-02-26 04:13:48,747::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.70.40'}} >Thread-16::DEBUG::2013-02-26 04:13:48,798::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-02-26 04:13:48,799::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-18::DEBUG::2013-02-26 04:13:51,983::task::568::TaskManager.Task::(_updateState) Task=`27b498a4-0465-4623-af5e-fcb4734cf014`::moving from state init -> state preparing >Thread-18::INFO::2013-02-26 04:13:51,984::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::INFO::2013-02-26 04:13:51,984::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-18::DEBUG::2013-02-26 04:13:51,984::task::1151::TaskManager.Task::(prepare) Task=`27b498a4-0465-4623-af5e-fcb4734cf014`::finished: {} >Thread-18::DEBUG::2013-02-26 04:13:51,984::task::568::TaskManager.Task::(_updateState) Task=`27b498a4-0465-4623-af5e-fcb4734cf014`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-02-26 04:13:51,984::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-02-26 04:13:51,985::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-02-26 04:13:51,985::task::957::TaskManager.Task::(_decref) Task=`27b498a4-0465-4623-af5e-fcb4734cf014`::ref 0 aborting False >Thread-24::DEBUG::2013-02-26 04:14:07,362::task::568::TaskManager.Task::(_updateState) Task=`a36c9d54-3651-4785-a986-a2d1973495ff`::moving from state init -> state preparing >Thread-24::INFO::2013-02-26 04:14:07,363::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2013-02-26 04:14:07,363::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2013-02-26 04:14:07,363::task::1151::TaskManager.Task::(prepare) Task=`a36c9d54-3651-4785-a986-a2d1973495ff`::finished: {} >Thread-24::DEBUG::2013-02-26 04:14:07,363::task::568::TaskManager.Task::(_updateState) Task=`a36c9d54-3651-4785-a986-a2d1973495ff`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-02-26 04:14:07,363::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-02-26 04:14:07,364::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-02-26 04:14:07,364::task::957::TaskManager.Task::(_decref) Task=`a36c9d54-3651-4785-a986-a2d1973495ff`::ref 0 aborting False >MainThread::INFO::2013-02-26 04:14:29,406::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-26 04:14:29,414::task::568::TaskManager.Task::(_updateState) Task=`a114f966-73a2-4cf1-9416-4393b4650152`::moving from state init -> state preparing >MainThread::INFO::2013-02-26 04:14:29,414::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-26 04:14:29,415::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-26 04:14:29,426::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,427::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,428::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,429::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,431::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,432::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,433::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,435::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,436::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,437::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,438::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,440::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,441::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,442::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,444::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,445::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,446::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,447::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,449::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,450::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,451::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,452::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,454::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,455::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,456::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,458::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,459::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,460::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,461::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,463::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,464::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,465::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,467::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,468::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,469::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:14:29,569::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-26 04:14:29,570::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-26 04:14:29,570::task::1151::TaskManager.Task::(prepare) Task=`a114f966-73a2-4cf1-9416-4393b4650152`::finished: None >MainThread::DEBUG::2013-02-26 04:14:29,570::task::568::TaskManager.Task::(_updateState) Task=`a114f966-73a2-4cf1-9416-4393b4650152`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-26 04:14:29,570::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-26 04:14:29,571::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-26 04:14:29,571::task::957::TaskManager.Task::(_decref) Task=`a114f966-73a2-4cf1-9416-4393b4650152`::ref 0 aborting False >MainThread::INFO::2013-02-26 04:14:29,571::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-02-26 04:14:29,571::vdsm::99::vds::(run) <_MainThread(MainThread, started 139683924875008)> >MainThread::INFO::2013-02-26 04:14:29,571::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 139683832313600)> >MainThread::INFO::2013-02-26 04:14:29,571::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 139683568793344)> >MainThread::INFO::2013-02-26 04:14:29,571::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 139683140990720)> >MainThread::INFO::2013-02-26 04:14:29,572::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139683088541440)> >MainThread::INFO::2013-02-26 04:14:29,572::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 139683688990464)> >MainThread::INFO::2013-02-26 04:14:29,572::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 139683579283200)> >MainThread::INFO::2013-02-26 04:14:29,572::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 139683699480320)> >MainThread::INFO::2013-02-26 04:14:29,572::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 139683558303488)> >MainThread::INFO::2013-02-26 04:14:29,572::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 139683130500864)> >MainThread::INFO::2013-02-26 04:14:29,572::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-26 04:14:29,573::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 139682660738816)> >MainThread::INFO::2013-02-26 04:14:29,573::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 139683610752768)> >MainThread::INFO::2013-02-26 04:14:29,573::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 139683589773056)> >MainThread::INFO::2013-02-26 04:14:29,573::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 139683600262912)> >MainThread::INFO::2013-02-26 04:18:39,999::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-26 04:18:40,373::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-26 04:18:40,374::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-26 04:18:40,387::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-26 04:18:40,966::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,968::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,970::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,971::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,972::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,974::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,975::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,976::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,978::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,979::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,981::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,982::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,984::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,986::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,988::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,990::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,992::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,994::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,996::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:40,998::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,000::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,002::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,004::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,006::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,008::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,010::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,012::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,014::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,016::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,017::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,018::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,020::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,021::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,023::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,025::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:18:41,139::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-26 04:18:41,139::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 62a44333-a4e3-486e-99a9-25d1fa098308 7971 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-26 04:18:41,393::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-26 04:18:41,393::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-26 04:18:41,393::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-26 04:18:41,394::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-26 04:18:41,394::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-26 04:18:41,394::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-26 04:18:41,397::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-26 04:18:43,145::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-26 04:18:43,151::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-26 04:18:43,151::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-26 04:18:43,372::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-26 04:18:43,373::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-26 04:18:43,375::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-26 04:18:43,376::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-26 04:18:43,376::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-26 04:18:43,398::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-26 04:18:43,400::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-26 04:18:43,400::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:43,405::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-26 04:18:43,425::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-26 04:18:43,426::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-26 04:18:43,461::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-26 04:18:43,461::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-26 04:18:43,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-26 04:18:43,463::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-26 04:18:43,468::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-26 04:18:43,472::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-26 04:18:43,472::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-26 04:18:43,496::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-26 04:18:43,496::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-26 04:18:43,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:18:43,615::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:18:43,616::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:43,616::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:43,617::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:18:43,828::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:18:43,829::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:43,830::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:18:44,003::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:18:44,003::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-26 04:18:44,009::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 04:18:44,009::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-26 04:18:44,009::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 04:18:44,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:18:44,028::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:18:44,028::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:44,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:45,034::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:45,037::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:45,040::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:46,044::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:46,047::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:46,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:18:46,051::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-26 04:18:48,054::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:18:49,778::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:18:49,778::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:49,779::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:49,779::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:49,779::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:49,779::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:49,780::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:18:49,780::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-26 04:18:49,780::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-26 04:19:40,949::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-26 04:19:41,308::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-26 04:19:41,359::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-26 04:19:41,715::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-19::DEBUG::2013-02-26 04:19:53,966::task::568::TaskManager.Task::(_updateState) Task=`2b3e9c32-4e6b-4db2-a4e9-9e41041fcf82`::moving from state init -> state preparing >Thread-19::INFO::2013-02-26 04:19:53,967::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::INFO::2013-02-26 04:19:53,967::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-19::DEBUG::2013-02-26 04:19:53,967::task::1151::TaskManager.Task::(prepare) Task=`2b3e9c32-4e6b-4db2-a4e9-9e41041fcf82`::finished: {} >Thread-19::DEBUG::2013-02-26 04:19:53,967::task::568::TaskManager.Task::(_updateState) Task=`2b3e9c32-4e6b-4db2-a4e9-9e41041fcf82`::moving from state preparing -> state finished >Thread-19::DEBUG::2013-02-26 04:19:53,967::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2013-02-26 04:19:53,967::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2013-02-26 04:19:53,968::task::957::TaskManager.Task::(_decref) Task=`2b3e9c32-4e6b-4db2-a4e9-9e41041fcf82`::ref 0 aborting False >Thread-22::DEBUG::2013-02-26 04:20:00,113::task::568::TaskManager.Task::(_updateState) Task=`446d84ec-b143-4863-ac77-e05b85628d0f`::moving from state init -> state preparing >Thread-22::INFO::2013-02-26 04:20:00,113::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-22::INFO::2013-02-26 04:20:00,113::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-22::DEBUG::2013-02-26 04:20:00,113::task::1151::TaskManager.Task::(prepare) Task=`446d84ec-b143-4863-ac77-e05b85628d0f`::finished: {} >Thread-22::DEBUG::2013-02-26 04:20:00,113::task::568::TaskManager.Task::(_updateState) Task=`446d84ec-b143-4863-ac77-e05b85628d0f`::moving from state preparing -> state finished >Thread-22::DEBUG::2013-02-26 04:20:00,114::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2013-02-26 04:20:00,114::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2013-02-26 04:20:00,114::task::957::TaskManager.Task::(_decref) Task=`446d84ec-b143-4863-ac77-e05b85628d0f`::ref 0 aborting False >Thread-24::DEBUG::2013-02-26 04:20:17,831::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getCapabilities with () {} >Thread-24::DEBUG::2013-02-26 04:20:17,868::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.70.40'}} >Thread-25::DEBUG::2013-02-26 04:20:17,933::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getHardwareInfo with () {} >Thread-25::DEBUG::2013-02-26 04:20:17,934::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-26::DEBUG::2013-02-26 04:20:18,253::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getCapabilities with () {} >Thread-26::DEBUG::2013-02-26 04:20:18,275::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.70.40'}} >Thread-27::DEBUG::2013-02-26 04:20:18,318::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.40]::call getHardwareInfo with () {} >Thread-27::DEBUG::2013-02-26 04:20:18,319::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-30::DEBUG::2013-02-26 04:20:24,532::task::568::TaskManager.Task::(_updateState) Task=`7f92e48c-f10d-4ee2-88c7-85f290f55693`::moving from state init -> state preparing >Thread-30::INFO::2013-02-26 04:20:24,532::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2013-02-26 04:20:24,532::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-30::DEBUG::2013-02-26 04:20:24,532::task::1151::TaskManager.Task::(prepare) Task=`7f92e48c-f10d-4ee2-88c7-85f290f55693`::finished: {} >Thread-30::DEBUG::2013-02-26 04:20:24,532::task::568::TaskManager.Task::(_updateState) Task=`7f92e48c-f10d-4ee2-88c7-85f290f55693`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-02-26 04:20:24,533::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-02-26 04:20:24,533::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-02-26 04:20:24,533::task::957::TaskManager.Task::(_decref) Task=`7f92e48c-f10d-4ee2-88c7-85f290f55693`::ref 0 aborting False >Thread-34::DEBUG::2013-02-26 04:20:32,485::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-34::DEBUG::2013-02-26 04:20:32,491::task::568::TaskManager.Task::(_updateState) Task=`13f4806e-af57-4a67-aba4-23e2665721ae`::moving from state init -> state preparing >Thread-34::INFO::2013-02-26 04:20:32,491::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-34::INFO::2013-02-26 04:20:32,491::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-34::DEBUG::2013-02-26 04:20:32,492::task::1151::TaskManager.Task::(prepare) Task=`13f4806e-af57-4a67-aba4-23e2665721ae`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-34::DEBUG::2013-02-26 04:20:32,492::task::568::TaskManager.Task::(_updateState) Task=`13f4806e-af57-4a67-aba4-23e2665721ae`::moving from state preparing -> state finished >Thread-34::DEBUG::2013-02-26 04:20:32,492::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2013-02-26 04:20:32,492::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2013-02-26 04:20:32,492::task::957::TaskManager.Task::(_decref) Task=`13f4806e-af57-4a67-aba4-23e2665721ae`::ref 0 aborting False >Thread-35::DEBUG::2013-02-26 04:20:32,559::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-35::DEBUG::2013-02-26 04:20:32,559::task::568::TaskManager.Task::(_updateState) Task=`208529be-0c90-4d81-a70a-2dffee2d2536`::moving from state init -> state preparing >Thread-35::INFO::2013-02-26 04:20:32,560::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-35::DEBUG::2013-02-26 04:20:32,649::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720 /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-35::INFO::2013-02-26 04:20:34,075::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-35::DEBUG::2013-02-26 04:20:34,075::task::1151::TaskManager.Task::(prepare) Task=`208529be-0c90-4d81-a70a-2dffee2d2536`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-35::DEBUG::2013-02-26 04:20:34,075::task::568::TaskManager.Task::(_updateState) Task=`208529be-0c90-4d81-a70a-2dffee2d2536`::moving from state preparing -> state finished >Thread-35::DEBUG::2013-02-26 04:20:34,076::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-35::DEBUG::2013-02-26 04:20:34,076::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-35::DEBUG::2013-02-26 04:20:34,076::task::957::TaskManager.Task::(_decref) Task=`208529be-0c90-4d81-a70a-2dffee2d2536`::ref 0 aborting False >Thread-37::DEBUG::2013-02-26 04:20:34,234::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-37::DEBUG::2013-02-26 04:20:34,235::task::568::TaskManager.Task::(_updateState) Task=`fbc3b7be-fb22-4e2b-a590-2e9a0151e220`::moving from state init -> state preparing >Thread-37::INFO::2013-02-26 04:20:34,235::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='cefa67eb-af91-46ac-8e17-8180a8a7daec', domainName='DataDomain01', typeSpecificArg='tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', domClass=1, domVersion='3', options=None) >Thread-37::DEBUG::2013-02-26 04:20:34,235::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-37::DEBUG::2013-02-26 04:20:34,235::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-37::DEBUG::2013-02-26 04:20:34,236::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-37::DEBUG::2013-02-26 04:20:34,236::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-37::DEBUG::2013-02-26 04:20:34,236::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-37::DEBUG::2013-02-26 04:20:34,260::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-37::DEBUG::2013-02-26 04:20:34,260::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:34,262::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:35,265::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:35,267::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:35,270::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:36,272::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:36,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:37,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-37::DEBUG::2013-02-26 04:20:37,280::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-37::DEBUG::2013-02-26 04:20:39,283::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-39::DEBUG::2013-02-26 04:20:39,791::task::568::TaskManager.Task::(_updateState) Task=`bbb3d9f2-8b89-4a43-9d22-7b260f2fa5a2`::moving from state init -> state preparing >Thread-39::INFO::2013-02-26 04:20:39,792::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-39::INFO::2013-02-26 04:20:39,792::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-39::DEBUG::2013-02-26 04:20:39,792::task::1151::TaskManager.Task::(prepare) Task=`bbb3d9f2-8b89-4a43-9d22-7b260f2fa5a2`::finished: {} >Thread-39::DEBUG::2013-02-26 04:20:39,792::task::568::TaskManager.Task::(_updateState) Task=`bbb3d9f2-8b89-4a43-9d22-7b260f2fa5a2`::moving from state preparing -> state finished >Thread-39::DEBUG::2013-02-26 04:20:39,792::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-39::DEBUG::2013-02-26 04:20:39,793::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2013-02-26 04:20:39,793::task::957::TaskManager.Task::(_decref) Task=`bbb3d9f2-8b89-4a43-9d22-7b260f2fa5a2`::ref 0 aborting False >Thread-37::DEBUG::2013-02-26 04:20:41,219::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-37::DEBUG::2013-02-26 04:20:41,219::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,220::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,220::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,220::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,221::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,221::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,221::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-37::DEBUG::2013-02-26 04:20:41,222::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-37::DEBUG::2013-02-26 04:20:41,225::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free cefa67eb-af91-46ac-8e17-8180a8a7daec' (cwd None) >Thread-37::DEBUG::2013-02-26 04:20:41,523::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "cefa67eb-af91-46ac-8e17-8180a8a7daec" not found\n'; <rc> = 5 >Thread-37::WARNING::2013-02-26 04:20:41,525::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "cefa67eb-af91-46ac-8e17-8180a8a7daec" not found'] >Thread-37::DEBUG::2013-02-26 04:20:41,526::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-37::INFO::2013-02-26 04:20:41,853::nfsSD::68::Storage.StorageDomain::(create) sdUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec domainName=DataDomain01 remotePath=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720 domClass=1 >Thread-37::DEBUG::2013-02-26 04:20:42,101::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-37::DEBUG::2013-02-26 04:20:42,104::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-37::WARNING::2013-02-26 04:20:42,105::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-37::DEBUG::2013-02-26 04:20:42,105::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-37::DEBUG::2013-02-26 04:20:42,105::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-37::DEBUG::2013-02-26 04:20:42,105::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=86d49c243b1bcc25d3180d9137b3f3250d2be486'] >Thread-37::DEBUG::2013-02-26 04:20:42,151::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-37::DEBUG::2013-02-26 04:20:42,160::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-37::DEBUG::2013-02-26 04:20:42,160::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-37::DEBUG::2013-02-26 04:20:42,180::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=86d49c243b1bcc25d3180d9137b3f3250d2be486'] >Thread-37::DEBUG::2013-02-26 04:20:42,189::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::DEBUG::2013-02-26 04:20:42,189::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'cefa67eb-af91-46ac-8e17-8180a8a7daec_imageNS' >Thread-37::DEBUG::2013-02-26 04:20:42,189::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'cefa67eb-af91-46ac-8e17-8180a8a7daec_volumeNS' >Thread-37::DEBUG::2013-02-26 04:20:42,190::clusterlock::135::initSANLock::(initSANLock) Initializing SANLock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-37::DEBUG::2013-02-26 04:20:42,311::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-37::INFO::2013-02-26 04:20:42,311::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-37::DEBUG::2013-02-26 04:20:42,311::task::1151::TaskManager.Task::(prepare) Task=`fbc3b7be-fb22-4e2b-a590-2e9a0151e220`::finished: None >Thread-37::DEBUG::2013-02-26 04:20:42,311::task::568::TaskManager.Task::(_updateState) Task=`fbc3b7be-fb22-4e2b-a590-2e9a0151e220`::moving from state preparing -> state finished >Thread-37::DEBUG::2013-02-26 04:20:42,312::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2013-02-26 04:20:42,312::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2013-02-26 04:20:42,312::task::957::TaskManager.Task::(_decref) Task=`fbc3b7be-fb22-4e2b-a590-2e9a0151e220`::ref 0 aborting False >Thread-64::DEBUG::2013-02-26 04:20:42,337::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-64::DEBUG::2013-02-26 04:20:42,338::task::568::TaskManager.Task::(_updateState) Task=`171346a2-8c46-4bb7-b564-0143cccf415c`::moving from state init -> state preparing >Thread-64::INFO::2013-02-26 04:20:42,338::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='cefa67eb-af91-46ac-8e17-8180a8a7daec', options=None) >Thread-64::DEBUG::2013-02-26 04:20:42,339::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`fbc7afbd-fd01-4c15-8d8e-15983700939c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-64::DEBUG::2013-02-26 04:20:42,339::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' for lock type 'shared' >Thread-64::DEBUG::2013-02-26 04:20:42,339::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free. Now locking as 'shared' (1 active user) >Thread-64::DEBUG::2013-02-26 04:20:42,339::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`fbc7afbd-fd01-4c15-8d8e-15983700939c`::Granted request >Thread-64::DEBUG::2013-02-26 04:20:42,340::task::794::TaskManager.Task::(resourceAcquired) Task=`171346a2-8c46-4bb7-b564-0143cccf415c`::_resourcesAcquired: Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec (shared) >Thread-64::DEBUG::2013-02-26 04:20:42,340::task::957::TaskManager.Task::(_decref) Task=`171346a2-8c46-4bb7-b564-0143cccf415c`::ref 1 aborting False >Thread-64::INFO::2013-02-26 04:20:42,341::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '857681690624', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-64::DEBUG::2013-02-26 04:20:42,341::task::1151::TaskManager.Task::(prepare) Task=`171346a2-8c46-4bb7-b564-0143cccf415c`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '857681690624', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-64::DEBUG::2013-02-26 04:20:42,341::task::568::TaskManager.Task::(_updateState) Task=`171346a2-8c46-4bb7-b564-0143cccf415c`::moving from state preparing -> state finished >Thread-64::DEBUG::2013-02-26 04:20:42,342::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec': < ResourceRef 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', isValid: 'True' obj: 'None'>} >Thread-64::DEBUG::2013-02-26 04:20:42,342::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2013-02-26 04:20:42,342::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' >Thread-64::DEBUG::2013-02-26 04:20:42,343::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' (0 active users) >Thread-64::DEBUG::2013-02-26 04:20:42,343::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free, finding out if anyone is waiting for it. >Thread-64::DEBUG::2013-02-26 04:20:42,343::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', Clearing records. >Thread-64::DEBUG::2013-02-26 04:20:42,343::task::957::TaskManager.Task::(_decref) Task=`171346a2-8c46-4bb7-b564-0143cccf415c`::ref 0 aborting False >Thread-65::DEBUG::2013-02-26 04:20:42,462::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-65::DEBUG::2013-02-26 04:20:42,463::task::568::TaskManager.Task::(_updateState) Task=`9a91e849-b5b8-494d-b3be-ab35c6cf5c2f`::moving from state init -> state preparing >Thread-65::INFO::2013-02-26 04:20:42,463::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-65::DEBUG::2013-02-26 04:20:42,464::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-65::DEBUG::2013-02-26 04:20:42,500::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-65::DEBUG::2013-02-26 04:20:42,501::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-65::DEBUG::2013-02-26 04:20:42,501::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-65::DEBUG::2013-02-26 04:20:42,501::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-65::DEBUG::2013-02-26 04:20:42,502::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-65::DEBUG::2013-02-26 04:20:42,527::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-65::DEBUG::2013-02-26 04:20:42,528::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:42,530::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:43,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:44,873::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:44,876::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:45,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:45,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:45,883::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-65::DEBUG::2013-02-26 04:20:45,885::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-65::DEBUG::2013-02-26 04:20:47,888::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-65::DEBUG::2013-02-26 04:20:49,931::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-65::DEBUG::2013-02-26 04:20:49,932::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-65::DEBUG::2013-02-26 04:20:49,932::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-65::DEBUG::2013-02-26 04:20:49,933::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-65::DEBUG::2013-02-26 04:20:49,933::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-65::DEBUG::2013-02-26 04:20:49,933::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-65::DEBUG::2013-02-26 04:20:49,934::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-65::DEBUG::2013-02-26 04:20:49,934::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-65::INFO::2013-02-26 04:20:49,934::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-65::DEBUG::2013-02-26 04:20:49,935::task::1151::TaskManager.Task::(prepare) Task=`9a91e849-b5b8-494d-b3be-ab35c6cf5c2f`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-65::DEBUG::2013-02-26 04:20:49,935::task::568::TaskManager.Task::(_updateState) Task=`9a91e849-b5b8-494d-b3be-ab35c6cf5c2f`::moving from state preparing -> state finished >Thread-65::DEBUG::2013-02-26 04:20:49,935::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-65::DEBUG::2013-02-26 04:20:49,935::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2013-02-26 04:20:49,936::task::957::TaskManager.Task::(_decref) Task=`9a91e849-b5b8-494d-b3be-ab35c6cf5c2f`::ref 0 aborting False >Thread-69::DEBUG::2013-02-26 04:20:50,173::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-69::DEBUG::2013-02-26 04:20:50,173::task::568::TaskManager.Task::(_updateState) Task=`a48c86c9-4910-4baf-bb91-f718dfe7f38d`::moving from state init -> state preparing >Thread-69::INFO::2013-02-26 04:20:50,174::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8', 'port': ''}], options=None) >Thread-69::INFO::2013-02-26 04:20:50,174::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-69::DEBUG::2013-02-26 04:20:50,174::task::1151::TaskManager.Task::(prepare) Task=`a48c86c9-4910-4baf-bb91-f718dfe7f38d`::finished: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-69::DEBUG::2013-02-26 04:20:50,174::task::568::TaskManager.Task::(_updateState) Task=`a48c86c9-4910-4baf-bb91-f718dfe7f38d`::moving from state preparing -> state finished >Thread-69::DEBUG::2013-02-26 04:20:50,174::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69::DEBUG::2013-02-26 04:20:50,175::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2013-02-26 04:20:50,175::task::957::TaskManager.Task::(_decref) Task=`a48c86c9-4910-4baf-bb91-f718dfe7f38d`::ref 0 aborting False >Thread-70::DEBUG::2013-02-26 04:20:50,202::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-70::DEBUG::2013-02-26 04:20:50,202::task::568::TaskManager.Task::(_updateState) Task=`fbc2460e-6c4f-404f-b105-3b7f996e624c`::moving from state init -> state preparing >Thread-70::INFO::2013-02-26 04:20:50,203::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8', 'port': ''}], options=None) >Thread-70::DEBUG::2013-02-26 04:20:50,206::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720 /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-70::INFO::2013-02-26 04:20:50,250::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-70::DEBUG::2013-02-26 04:20:50,250::task::1151::TaskManager.Task::(prepare) Task=`fbc2460e-6c4f-404f-b105-3b7f996e624c`::finished: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-70::DEBUG::2013-02-26 04:20:50,250::task::568::TaskManager.Task::(_updateState) Task=`fbc2460e-6c4f-404f-b105-3b7f996e624c`::moving from state preparing -> state finished >Thread-70::DEBUG::2013-02-26 04:20:50,250::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2013-02-26 04:20:50,251::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2013-02-26 04:20:50,251::task::957::TaskManager.Task::(_decref) Task=`fbc2460e-6c4f-404f-b105-3b7f996e624c`::ref 0 aborting False >Thread-71::DEBUG::2013-02-26 04:20:50,279::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-71::DEBUG::2013-02-26 04:20:50,280::task::568::TaskManager.Task::(_updateState) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::moving from state init -> state preparing >Thread-71::INFO::2013-02-26 04:20:50,280::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', poolName='DataCenter01', masterDom='cefa67eb-af91-46ac-8e17-8180a8a7daec', domList=['cefa67eb-af91-46ac-8e17-8180a8a7daec'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-71::INFO::2013-02-26 04:20:50,280::fileSD::302::Storage.StorageDomain::(validate) sdUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-71::DEBUG::2013-02-26 04:20:50,286::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=86d49c243b1bcc25d3180d9137b3f3250d2be486'] >Thread-71::DEBUG::2013-02-26 04:20:50,287::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`cd92bcb5-6cbd-4cc4-bbfd-7dddaf5b569a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-71::DEBUG::2013-02-26 04:20:50,287::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' for lock type 'exclusive' >Thread-71::DEBUG::2013-02-26 04:20:50,287::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free. Now locking as 'exclusive' (1 active user) >Thread-71::DEBUG::2013-02-26 04:20:50,288::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`cd92bcb5-6cbd-4cc4-bbfd-7dddaf5b569a`::Granted request >Thread-71::DEBUG::2013-02-26 04:20:50,288::task::794::TaskManager.Task::(resourceAcquired) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::_resourcesAcquired: Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7 (exclusive) >Thread-71::DEBUG::2013-02-26 04:20:50,288::task::957::TaskManager.Task::(_decref) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::ref 1 aborting False >Thread-71::DEBUG::2013-02-26 04:20:50,289::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`61851710-4b63-4eaa-9814-a468765ea02e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-71::DEBUG::2013-02-26 04:20:50,289::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' for lock type 'exclusive' >Thread-71::DEBUG::2013-02-26 04:20:50,290::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free. Now locking as 'exclusive' (1 active user) >Thread-71::DEBUG::2013-02-26 04:20:50,290::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`61851710-4b63-4eaa-9814-a468765ea02e`::Granted request >Thread-71::DEBUG::2013-02-26 04:20:50,290::task::794::TaskManager.Task::(resourceAcquired) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::_resourcesAcquired: Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec (exclusive) >Thread-71::DEBUG::2013-02-26 04:20:50,291::task::957::TaskManager.Task::(_decref) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::ref 1 aborting False >Thread-71::INFO::2013-02-26 04:20:50,291::sp::543::Storage.StoragePool::(create) spUUID=723b04cc-dae1-4114-92da-e4e65e12b1d7 poolName=DataCenter01 master_sd=cefa67eb-af91-46ac-8e17-8180a8a7daec domList=['cefa67eb-af91-46ac-8e17-8180a8a7daec'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-71::INFO::2013-02-26 04:20:50,291::fileSD::302::Storage.StorageDomain::(validate) sdUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-71::DEBUG::2013-02-26 04:20:50,295::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=86d49c243b1bcc25d3180d9137b3f3250d2be486'] >Thread-71::DEBUG::2013-02-26 04:20:50,298::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=86d49c243b1bcc25d3180d9137b3f3250d2be486'] >Thread-71::DEBUG::2013-02-26 04:20:50,299::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-71::DEBUG::2013-02-26 04:20:50,299::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-71::DEBUG::2013-02-26 04:20:50,300::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c6bb455e4f2cdf325514ce4a44cb16ce22b03484'] >Thread-71::DEBUG::2013-02-26 04:20:50,371::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-71::INFO::2013-02-26 04:20:50,371::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 250) >Thread-73::DEBUG::2013-02-26 04:20:54,994::task::568::TaskManager.Task::(_updateState) Task=`ece270d5-2d5b-49ef-8c4a-00cbb39dd6ca`::moving from state init -> state preparing >Thread-73::INFO::2013-02-26 04:20:54,995::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2013-02-26 04:20:54,996::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-73::DEBUG::2013-02-26 04:20:54,996::task::1151::TaskManager.Task::(prepare) Task=`ece270d5-2d5b-49ef-8c4a-00cbb39dd6ca`::finished: {} >Thread-73::DEBUG::2013-02-26 04:20:54,996::task::568::TaskManager.Task::(_updateState) Task=`ece270d5-2d5b-49ef-8c4a-00cbb39dd6ca`::moving from state preparing -> state finished >Thread-73::DEBUG::2013-02-26 04:20:54,997::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2013-02-26 04:20:54,997::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2013-02-26 04:20:54,997::task::957::TaskManager.Task::(_decref) Task=`ece270d5-2d5b-49ef-8c4a-00cbb39dd6ca`::ref 0 aborting False >Thread-71::DEBUG::2013-02-26 04:21:11,375::clusterlock::190::SANLock::(acquireHostId) Host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec successfully acquired (id: 250) >Thread-71::INFO::2013-02-26 04:21:11,376::clusterlock::223::SANLock::(acquire) Acquiring cluster lock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 250) >Thread-71::DEBUG::2013-02-26 04:21:11,505::clusterlock::247::SANLock::(acquire) Cluster lock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec successfully acquired (id: 250) >Thread-71::INFO::2013-02-26 04:21:11,505::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 723b04cc-dae1-4114-92da-e4e65e12b1d7 on sdUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-71::DEBUG::2013-02-26 04:21:11,505::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-71::DEBUG::2013-02-26 04:21:11,506::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-71::DEBUG::2013-02-26 04:21:11,509::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Regular', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c6bb455e4f2cdf325514ce4a44cb16ce22b03484'] >Thread-71::DEBUG::2013-02-26 04:21:11,509::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-71::DEBUG::2013-02-26 04:21:11,509::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-71::DEBUG::2013-02-26 04:21:11,509::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-71::DEBUG::2013-02-26 04:21:11,510::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-71::DEBUG::2013-02-26 04:21:11,510::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >Thread-71::DEBUG::2013-02-26 04:21:11,589::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-71::DEBUG::2013-02-26 04:21:11,589::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain cefa67eb-af91-46ac-8e17-8180a8a7daec verified, version 1 >Thread-71::DEBUG::2013-02-26 04:21:11,589::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-71::DEBUG::2013-02-26 04:21:11,589::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-71::DEBUG::2013-02-26 04:21:11,593::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >Thread-76::DEBUG::2013-02-26 04:21:11,595::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-71::DEBUG::2013-02-26 04:21:11,595::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `723b04cc-dae1-4114-92da-e4e65e12b1d7` started monitoring domain `cefa67eb-af91-46ac-8e17-8180a8a7daec` >Thread-71::DEBUG::2013-02-26 04:21:11,596::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-71::WARNING::2013-02-26 04:21:11,597::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/723b04cc-dae1-4114-92da-e4e65e12b1d7 already exists >Thread-71::DEBUG::2013-02-26 04:21:11,604::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-71::DEBUG::2013-02-26 04:21:11,606::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-71::DEBUG::2013-02-26 04:21:11,787::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-71::DEBUG::2013-02-26 04:21:11,788::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-71::INFO::2013-02-26 04:21:11,829::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec to /rhev/data-center/723b04cc-dae1-4114-92da-e4e65e12b1d7/cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-71::INFO::2013-02-26 04:21:11,830::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec to /rhev/data-center/723b04cc-dae1-4114-92da-e4e65e12b1d7/mastersd >Thread-71::INFO::2013-02-26 04:21:11,830::clusterlock::251::SANLock::(release) Releasing cluster lock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-71::DEBUG::2013-02-26 04:21:11,854::clusterlock::262::SANLock::(release) Cluster lock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec successfully released >Thread-71::INFO::2013-02-26 04:21:11,854::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 250) >Thread-71::DEBUG::2013-02-26 04:21:13,855::clusterlock::205::SANLock::(releaseHostId) Host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec released successfully (id: 250) >Thread-76::DEBUG::2013-02-26 04:21:14,271::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-76::INFO::2013-02-26 04:21:14,271::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 250) >Thread-76::DEBUG::2013-02-26 04:21:14,272::clusterlock::205::SANLock::(releaseHostId) Host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec released successfully (id: 250) >Thread-71::INFO::2013-02-26 04:21:14,272::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-71::DEBUG::2013-02-26 04:21:14,273::task::1151::TaskManager.Task::(prepare) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::finished: True >Thread-71::DEBUG::2013-02-26 04:21:14,273::task::568::TaskManager.Task::(_updateState) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::moving from state preparing -> state finished >Thread-71::DEBUG::2013-02-26 04:21:14,273::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec': < ResourceRef 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', isValid: 'True' obj: 'None'>, 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7': < ResourceRef 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', isValid: 'True' obj: 'None'>} >Thread-71::DEBUG::2013-02-26 04:21:14,273::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-71::DEBUG::2013-02-26 04:21:14,274::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' >Thread-71::DEBUG::2013-02-26 04:21:14,274::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' (0 active users) >Thread-71::DEBUG::2013-02-26 04:21:14,274::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free, finding out if anyone is waiting for it. >Thread-71::DEBUG::2013-02-26 04:21:14,275::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', Clearing records. >Thread-71::DEBUG::2013-02-26 04:21:14,275::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' >Thread-71::DEBUG::2013-02-26 04:21:14,275::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' (0 active users) >Thread-71::DEBUG::2013-02-26 04:21:14,275::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free, finding out if anyone is waiting for it. >Thread-71::DEBUG::2013-02-26 04:21:14,276::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', Clearing records. >Thread-71::DEBUG::2013-02-26 04:21:14,276::task::957::TaskManager.Task::(_decref) Task=`ab82a20d-102c-4c24-b5c2-9457202f6630`::ref 0 aborting False >Thread-100::DEBUG::2013-02-26 04:21:14,348::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-100::DEBUG::2013-02-26 04:21:14,348::task::568::TaskManager.Task::(_updateState) Task=`39fd0377-448e-4339-86c9-fb00f037e05f`::moving from state init -> state preparing >Thread-100::INFO::2013-02-26 04:21:14,349::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8', 'port': ''}], options=None) >Thread-100::INFO::2013-02-26 04:21:14,349::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-100::DEBUG::2013-02-26 04:21:14,349::task::1151::TaskManager.Task::(prepare) Task=`39fd0377-448e-4339-86c9-fb00f037e05f`::finished: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-100::DEBUG::2013-02-26 04:21:14,349::task::568::TaskManager.Task::(_updateState) Task=`39fd0377-448e-4339-86c9-fb00f037e05f`::moving from state preparing -> state finished >Thread-100::DEBUG::2013-02-26 04:21:14,350::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2013-02-26 04:21:14,350::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2013-02-26 04:21:14,350::task::957::TaskManager.Task::(_decref) Task=`39fd0377-448e-4339-86c9-fb00f037e05f`::ref 0 aborting False >Thread-101::DEBUG::2013-02-26 04:21:14,378::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-101::DEBUG::2013-02-26 04:21:14,379::task::568::TaskManager.Task::(_updateState) Task=`72eeab46-a4fa-4de4-a627-79a839218180`::moving from state init -> state preparing >Thread-101::INFO::2013-02-26 04:21:14,379::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8', 'port': ''}], options=None) >Thread-101::INFO::2013-02-26 04:21:14,382::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-101::DEBUG::2013-02-26 04:21:14,382::task::1151::TaskManager.Task::(prepare) Task=`72eeab46-a4fa-4de4-a627-79a839218180`::finished: {'statuslist': [{'status': 0, 'id': 'c2ef77c9-e9a4-4fd7-949b-d66bdece3ab8'}]} >Thread-101::DEBUG::2013-02-26 04:21:14,382::task::568::TaskManager.Task::(_updateState) Task=`72eeab46-a4fa-4de4-a627-79a839218180`::moving from state preparing -> state finished >Thread-101::DEBUG::2013-02-26 04:21:14,382::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2013-02-26 04:21:14,383::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2013-02-26 04:21:14,383::task::957::TaskManager.Task::(_decref) Task=`72eeab46-a4fa-4de4-a627-79a839218180`::ref 0 aborting False >Thread-102::DEBUG::2013-02-26 04:21:14,458::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-102::DEBUG::2013-02-26 04:21:14,459::task::568::TaskManager.Task::(_updateState) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::moving from state init -> state preparing >Thread-102::INFO::2013-02-26 04:21:14,459::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', options=None) >Thread-102::ERROR::2013-02-26 04:21:14,459::task::833::TaskManager.Task::(_setError) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 603, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 313, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('723b04cc-dae1-4114-92da-e4e65e12b1d7',) >Thread-102::DEBUG::2013-02-26 04:21:14,461::task::852::TaskManager.Task::(_run) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::Task._run: 5b12f2f4-bb2b-4df1-8db4-16b56b41f574 ('723b04cc-dae1-4114-92da-e4e65e12b1d7',) {} failed - stopping task >Thread-102::DEBUG::2013-02-26 04:21:14,461::task::1177::TaskManager.Task::(stop) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::stopping in state preparing (force False) >Thread-102::DEBUG::2013-02-26 04:21:14,461::task::957::TaskManager.Task::(_decref) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::ref 1 aborting True >Thread-102::INFO::2013-02-26 04:21:14,461::task::1134::TaskManager.Task::(prepare) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-102::DEBUG::2013-02-26 04:21:14,461::task::1139::TaskManager.Task::(prepare) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::Prepare: aborted: Unknown pool id, pool not connected >Thread-102::DEBUG::2013-02-26 04:21:14,462::task::957::TaskManager.Task::(_decref) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::ref 0 aborting True >Thread-102::DEBUG::2013-02-26 04:21:14,462::task::892::TaskManager.Task::(_doAbort) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::Task._doAbort: force False >Thread-102::DEBUG::2013-02-26 04:21:14,462::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2013-02-26 04:21:14,462::task::568::TaskManager.Task::(_updateState) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::moving from state preparing -> state aborting >Thread-102::DEBUG::2013-02-26 04:21:14,462::task::523::TaskManager.Task::(__state_aborting) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::_aborting: recover policy none >Thread-102::DEBUG::2013-02-26 04:21:14,462::task::568::TaskManager.Task::(_updateState) Task=`5b12f2f4-bb2b-4df1-8db4-16b56b41f574`::moving from state aborting -> state failed >Thread-102::DEBUG::2013-02-26 04:21:14,462::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2013-02-26 04:21:14,463::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::ERROR::2013-02-26 04:21:14,463::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('723b04cc-dae1-4114-92da-e4e65e12b1d7',)", 'code': 309}} >Thread-103::DEBUG::2013-02-26 04:21:14,491::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-103::DEBUG::2013-02-26 04:21:14,492::task::568::TaskManager.Task::(_updateState) Task=`6d27b2f3-d935-49ae-94d5-929c2831930e`::moving from state init -> state preparing >Thread-103::INFO::2013-02-26 04:21:14,492::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', hostID=1, scsiKey='723b04cc-dae1-4114-92da-e4e65e12b1d7', msdUUID='cefa67eb-af91-46ac-8e17-8180a8a7daec', masterVersion=1, options=None) >Thread-103::DEBUG::2013-02-26 04:21:14,493::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`bd6e6650-e439-43e4-9abd-af64a2b5794a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-103::DEBUG::2013-02-26 04:21:14,494::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' for lock type 'exclusive' >Thread-103::DEBUG::2013-02-26 04:21:14,494::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free. Now locking as 'exclusive' (1 active user) >Thread-103::DEBUG::2013-02-26 04:21:14,495::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`bd6e6650-e439-43e4-9abd-af64a2b5794a`::Granted request >Thread-103::INFO::2013-02-26 04:21:14,496::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 723b04cc-dae1-4114-92da-e4e65e12b1d7 with master domain: cefa67eb-af91-46ac-8e17-8180a8a7daec (ver = 1) >Thread-103::DEBUG::2013-02-26 04:21:14,496::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:14,497::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:14,497::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:14,498::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:14,498::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:14,499::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:14,499::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-103::DEBUG::2013-02-26 04:21:14,499::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-103::DEBUG::2013-02-26 04:21:14,500::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-103::DEBUG::2013-02-26 04:21:14,500::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-103::DEBUG::2013-02-26 04:21:14,500::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-103::DEBUG::2013-02-26 04:21:14,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-103::DEBUG::2013-02-26 04:21:14,523::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:14,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:15,530::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:39,229::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:40,232::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:40,235::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:41,239::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:42,243::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-103::DEBUG::2013-02-26 04:21:42,246::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-103::DEBUG::2013-02-26 04:21:44,249::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-103::DEBUG::2013-02-26 04:21:47,647::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-103::DEBUG::2013-02-26 04:21:47,648::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,653::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,654::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,654::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,655::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,655::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,655::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-103::DEBUG::2013-02-26 04:21:47,656::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,659::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free cefa67eb-af91-46ac-8e17-8180a8a7daec' (cwd None) >Thread-103::DEBUG::2013-02-26 04:21:47,925::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "cefa67eb-af91-46ac-8e17-8180a8a7daec" not found\n'; <rc> = 5 >Thread-103::WARNING::2013-02-26 04:21:47,927::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "cefa67eb-af91-46ac-8e17-8180a8a7daec" not found'] >Thread-103::DEBUG::2013-02-26 04:21:47,928::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:47,989::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-103::DEBUG::2013-02-26 04:21:47,989::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-103::DEBUG::2013-02-26 04:21:47,994::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >Thread-103::DEBUG::2013-02-26 04:21:47,996::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-103::WARNING::2013-02-26 04:21:47,996::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace cefa67eb-af91-46ac-8e17-8180a8a7daec_imageNS already registered >Thread-103::WARNING::2013-02-26 04:21:48,002::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace cefa67eb-af91-46ac-8e17-8180a8a7daec_volumeNS already registered >Thread-103::DEBUG::2013-02-26 04:21:48,002::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain cefa67eb-af91-46ac-8e17-8180a8a7daec verified, version 1 >Thread-103::DEBUG::2013-02-26 04:21:48,002::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-103::DEBUG::2013-02-26 04:21:48,003::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-103::DEBUG::2013-02-26 04:21:48,006::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >Thread-103::DEBUG::2013-02-26 04:21:48,007::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `723b04cc-dae1-4114-92da-e4e65e12b1d7` started monitoring domain `cefa67eb-af91-46ac-8e17-8180a8a7daec` >Thread-130::DEBUG::2013-02-26 04:21:48,007::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-103::DEBUG::2013-02-26 04:21:48,008::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-103::WARNING::2013-02-26 04:21:48,009::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/723b04cc-dae1-4114-92da-e4e65e12b1d7 already exists >Thread-103::DEBUG::2013-02-26 04:21:48,014::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-103::DEBUG::2013-02-26 04:21:48,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-130::INFO::2013-02-26 04:21:48,033::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 1) >Thread-130::DEBUG::2013-02-26 04:21:48,034::clusterlock::190::SANLock::(acquireHostId) Host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec successfully acquired (id: 1) >Thread-103::DEBUG::2013-02-26 04:21:48,196::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-103::DEBUG::2013-02-26 04:21:48,197::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-103::INFO::2013-02-26 04:21:48,252::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec to /rhev/data-center/723b04cc-dae1-4114-92da-e4e65e12b1d7/cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-103::INFO::2013-02-26 04:21:48,253::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec to /rhev/data-center/723b04cc-dae1-4114-92da-e4e65e12b1d7/mastersd >Thread-103::DEBUG::2013-02-26 04:21:48,254::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' >Thread-103::DEBUG::2013-02-26 04:21:48,254::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' (0 active users) >Thread-103::DEBUG::2013-02-26 04:21:48,254::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free, finding out if anyone is waiting for it. >Thread-103::DEBUG::2013-02-26 04:21:48,255::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', Clearing records. >Thread-103::INFO::2013-02-26 04:21:48,255::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-103::DEBUG::2013-02-26 04:21:48,255::task::1151::TaskManager.Task::(prepare) Task=`6d27b2f3-d935-49ae-94d5-929c2831930e`::finished: True >Thread-103::DEBUG::2013-02-26 04:21:48,256::task::568::TaskManager.Task::(_updateState) Task=`6d27b2f3-d935-49ae-94d5-929c2831930e`::moving from state preparing -> state finished >Thread-103::DEBUG::2013-02-26 04:21:48,256::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-103::DEBUG::2013-02-26 04:21:48,256::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-103::DEBUG::2013-02-26 04:21:48,256::task::957::TaskManager.Task::(_decref) Task=`6d27b2f3-d935-49ae-94d5-929c2831930e`::ref 0 aborting False >Thread-154::DEBUG::2013-02-26 04:21:48,278::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-154::DEBUG::2013-02-26 04:21:48,279::task::568::TaskManager.Task::(_updateState) Task=`56440bbf-f6d8-4362-8776-58d2b21f196d`::moving from state init -> state preparing >Thread-154::INFO::2013-02-26 04:21:48,279::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', options=None) >Thread-154::INFO::2013-02-26 04:21:48,280::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-154::DEBUG::2013-02-26 04:21:48,280::task::1151::TaskManager.Task::(prepare) Task=`56440bbf-f6d8-4362-8776-58d2b21f196d`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-154::DEBUG::2013-02-26 04:21:48,280::task::568::TaskManager.Task::(_updateState) Task=`56440bbf-f6d8-4362-8776-58d2b21f196d`::moving from state preparing -> state finished >Thread-154::DEBUG::2013-02-26 04:21:48,280::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-154::DEBUG::2013-02-26 04:21:48,281::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-154::DEBUG::2013-02-26 04:21:48,281::task::957::TaskManager.Task::(_decref) Task=`56440bbf-f6d8-4362-8776-58d2b21f196d`::ref 0 aborting False >Thread-155::DEBUG::2013-02-26 04:21:48,328::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-155::DEBUG::2013-02-26 04:21:48,329::task::568::TaskManager.Task::(_updateState) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::moving from state init -> state preparing >Thread-155::INFO::2013-02-26 04:21:48,329::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-155::DEBUG::2013-02-26 04:21:48,330::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`39c641a2-be7e-40a9-a7b8-63587b85764a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-155::DEBUG::2013-02-26 04:21:48,330::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' for lock type 'exclusive' >Thread-155::DEBUG::2013-02-26 04:21:48,331::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free. Now locking as 'exclusive' (1 active user) >Thread-155::DEBUG::2013-02-26 04:21:48,331::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`39c641a2-be7e-40a9-a7b8-63587b85764a`::Granted request >Thread-155::DEBUG::2013-02-26 04:21:48,332::task::794::TaskManager.Task::(resourceAcquired) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::_resourcesAcquired: Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7 (exclusive) >Thread-155::DEBUG::2013-02-26 04:21:48,332::task::957::TaskManager.Task::(_decref) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::ref 1 aborting False >Thread-155::INFO::2013-02-26 04:21:48,333::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-155::DEBUG::2013-02-26 04:21:48,333::task::1146::TaskManager.Task::(prepare) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::Prepare: 1 jobs exist, move to acquiring >Thread-155::DEBUG::2013-02-26 04:21:48,333::task::568::TaskManager.Task::(_updateState) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::moving from state preparing -> state acquiring >Thread-155::DEBUG::2013-02-26 04:21:48,333::task::568::TaskManager.Task::(_updateState) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::moving from state acquiring -> state queued >Thread-155::DEBUG::2013-02-26 04:21:48,334::taskManager::50::TaskManager::(_queueTask) queuing task: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-155::DEBUG::2013-02-26 04:21:48,334::taskManager::56::TaskManager::(_queueTask) task queued: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-5::DEBUG::2013-02-26 04:21:48,334::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,335::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: d7b894a8-033a-4677-8880-73cfa0dcc763 running: <bound method Task.commit of <storage.task.Task instance at 0x7f8d2c1103f8>> with: None >Thread-155::DEBUG::2013-02-26 04:21:48,335::task::1148::TaskManager.Task::(prepare) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::returning >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,336::task::1159::TaskManager.Task::(commit) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::committing task: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-155::DEBUG::2013-02-26 04:21:48,337::task::957::TaskManager.Task::(_decref) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::ref 0 aborting False >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,337::task::568::TaskManager.Task::(_updateState) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::moving from state queued -> state running >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,338::task::872::TaskManager.Task::(_runJobs) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x251f8d0>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,339::task::304::TaskManager.Task::(run) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x251f8d0>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,340::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,341::misc::1027::SamplingMethod::(__call__) Got in to sampling method >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,344::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,344::misc::1035::SamplingMethod::(__call__) Returning last result >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:21:48,348::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >d7b894a8-033a-4677-8880-73cfa0dcc763::INFO::2013-02-26 04:21:48,348::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 1) >Thread-156::DEBUG::2013-02-26 04:21:48,915::task::568::TaskManager.Task::(_updateState) Task=`649a69c9-0f05-4146-a7e8-6a88f389f1e5`::moving from state init -> state preparing >Thread-156::INFO::2013-02-26 04:21:48,915::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-156::INFO::2013-02-26 04:21:48,915::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'cefa67eb-af91-46ac-8e17-8180a8a7daec': {'delay': '0.00305390357971', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-156::DEBUG::2013-02-26 04:21:48,915::task::1151::TaskManager.Task::(prepare) Task=`649a69c9-0f05-4146-a7e8-6a88f389f1e5`::finished: {'cefa67eb-af91-46ac-8e17-8180a8a7daec': {'delay': '0.00305390357971', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-156::DEBUG::2013-02-26 04:21:48,916::task::568::TaskManager.Task::(_updateState) Task=`649a69c9-0f05-4146-a7e8-6a88f389f1e5`::moving from state preparing -> state finished >Thread-156::DEBUG::2013-02-26 04:21:48,916::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-156::DEBUG::2013-02-26 04:21:48,916::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-156::DEBUG::2013-02-26 04:21:48,916::task::957::TaskManager.Task::(_decref) Task=`649a69c9-0f05-4146-a7e8-6a88f389f1e5`::ref 0 aborting False >Thread-158::DEBUG::2013-02-26 04:21:49,366::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-158::DEBUG::2013-02-26 04:21:54,639::task::568::TaskManager.Task::(_updateState) Task=`063a7f59-650a-4dfc-a3b7-e599576ce7a9`::moving from state init -> state preparing >Thread-158::INFO::2013-02-26 04:21:54,639::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-158::DEBUG::2013-02-26 04:21:54,639::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-158::DEBUG::2013-02-26 04:21:54,640::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-158::INFO::2013-02-26 04:21:54,640::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-158::DEBUG::2013-02-26 04:21:54,640::task::1151::TaskManager.Task::(prepare) Task=`063a7f59-650a-4dfc-a3b7-e599576ce7a9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-158::DEBUG::2013-02-26 04:21:54,640::task::568::TaskManager.Task::(_updateState) Task=`063a7f59-650a-4dfc-a3b7-e599576ce7a9`::moving from state preparing -> state finished >Thread-158::DEBUG::2013-02-26 04:21:54,640::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-158::DEBUG::2013-02-26 04:21:54,641::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-158::DEBUG::2013-02-26 04:21:54,641::task::957::TaskManager.Task::(_decref) Task=`063a7f59-650a-4dfc-a3b7-e599576ce7a9`::ref 0 aborting False >Thread-161::DEBUG::2013-02-26 04:21:55,665::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-161::DEBUG::2013-02-26 04:21:55,665::task::568::TaskManager.Task::(_updateState) Task=`6a82832b-af38-47a1-9c55-d3e963d78f42`::moving from state init -> state preparing >Thread-161::INFO::2013-02-26 04:21:55,666::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-161::DEBUG::2013-02-26 04:21:55,666::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-161::DEBUG::2013-02-26 04:21:55,666::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-161::INFO::2013-02-26 04:21:55,666::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-161::DEBUG::2013-02-26 04:21:55,666::task::1151::TaskManager.Task::(prepare) Task=`6a82832b-af38-47a1-9c55-d3e963d78f42`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-161::DEBUG::2013-02-26 04:21:55,666::task::568::TaskManager.Task::(_updateState) Task=`6a82832b-af38-47a1-9c55-d3e963d78f42`::moving from state preparing -> state finished >Thread-161::DEBUG::2013-02-26 04:21:55,667::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2013-02-26 04:21:55,667::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2013-02-26 04:21:55,667::task::957::TaskManager.Task::(_decref) Task=`6a82832b-af38-47a1-9c55-d3e963d78f42`::ref 0 aborting False >Thread-162::DEBUG::2013-02-26 04:21:56,690::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-162::DEBUG::2013-02-26 04:21:56,690::task::568::TaskManager.Task::(_updateState) Task=`16448a78-b2de-4547-8570-77e01b301a83`::moving from state init -> state preparing >Thread-162::INFO::2013-02-26 04:21:56,690::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-162::DEBUG::2013-02-26 04:21:56,691::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-162::DEBUG::2013-02-26 04:21:56,691::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-162::INFO::2013-02-26 04:21:56,691::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-162::DEBUG::2013-02-26 04:21:56,691::task::1151::TaskManager.Task::(prepare) Task=`16448a78-b2de-4547-8570-77e01b301a83`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-162::DEBUG::2013-02-26 04:21:56,692::task::568::TaskManager.Task::(_updateState) Task=`16448a78-b2de-4547-8570-77e01b301a83`::moving from state preparing -> state finished >Thread-162::DEBUG::2013-02-26 04:21:56,692::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-162::DEBUG::2013-02-26 04:21:56,692::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-162::DEBUG::2013-02-26 04:21:56,692::task::957::TaskManager.Task::(_decref) Task=`16448a78-b2de-4547-8570-77e01b301a83`::ref 0 aborting False >Thread-163::DEBUG::2013-02-26 04:21:57,715::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-163::DEBUG::2013-02-26 04:21:57,715::task::568::TaskManager.Task::(_updateState) Task=`8f003752-6db4-4350-b2f6-5aec4f491715`::moving from state init -> state preparing >Thread-163::INFO::2013-02-26 04:21:57,715::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-163::DEBUG::2013-02-26 04:21:57,716::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-163::DEBUG::2013-02-26 04:21:57,716::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-163::INFO::2013-02-26 04:21:57,716::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-163::DEBUG::2013-02-26 04:21:57,716::task::1151::TaskManager.Task::(prepare) Task=`8f003752-6db4-4350-b2f6-5aec4f491715`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-163::DEBUG::2013-02-26 04:21:57,716::task::568::TaskManager.Task::(_updateState) Task=`8f003752-6db4-4350-b2f6-5aec4f491715`::moving from state preparing -> state finished >Thread-163::DEBUG::2013-02-26 04:21:57,716::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-163::DEBUG::2013-02-26 04:21:57,717::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-163::DEBUG::2013-02-26 04:21:57,717::task::957::TaskManager.Task::(_decref) Task=`8f003752-6db4-4350-b2f6-5aec4f491715`::ref 0 aborting False >Thread-165::DEBUG::2013-02-26 04:21:58,750::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-165::DEBUG::2013-02-26 04:21:58,750::task::568::TaskManager.Task::(_updateState) Task=`fa04ed0b-cf85-44ce-9654-600cf1e39a9e`::moving from state init -> state preparing >Thread-165::INFO::2013-02-26 04:21:58,750::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-165::DEBUG::2013-02-26 04:21:58,750::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-165::DEBUG::2013-02-26 04:21:58,751::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-165::INFO::2013-02-26 04:21:58,751::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-165::DEBUG::2013-02-26 04:21:58,751::task::1151::TaskManager.Task::(prepare) Task=`fa04ed0b-cf85-44ce-9654-600cf1e39a9e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-165::DEBUG::2013-02-26 04:21:58,751::task::568::TaskManager.Task::(_updateState) Task=`fa04ed0b-cf85-44ce-9654-600cf1e39a9e`::moving from state preparing -> state finished >Thread-165::DEBUG::2013-02-26 04:21:58,751::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-165::DEBUG::2013-02-26 04:21:58,751::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-165::DEBUG::2013-02-26 04:21:58,752::task::957::TaskManager.Task::(_decref) Task=`fa04ed0b-cf85-44ce-9654-600cf1e39a9e`::ref 0 aborting False >Thread-166::DEBUG::2013-02-26 04:21:59,775::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-166::DEBUG::2013-02-26 04:21:59,776::task::568::TaskManager.Task::(_updateState) Task=`2b6cbc9b-1072-4283-8969-d49fb19766e0`::moving from state init -> state preparing >Thread-166::INFO::2013-02-26 04:21:59,776::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-166::DEBUG::2013-02-26 04:21:59,776::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-166::DEBUG::2013-02-26 04:21:59,776::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-166::INFO::2013-02-26 04:21:59,776::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-166::DEBUG::2013-02-26 04:21:59,777::task::1151::TaskManager.Task::(prepare) Task=`2b6cbc9b-1072-4283-8969-d49fb19766e0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-166::DEBUG::2013-02-26 04:21:59,777::task::568::TaskManager.Task::(_updateState) Task=`2b6cbc9b-1072-4283-8969-d49fb19766e0`::moving from state preparing -> state finished >Thread-166::DEBUG::2013-02-26 04:21:59,777::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-166::DEBUG::2013-02-26 04:21:59,777::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-166::DEBUG::2013-02-26 04:21:59,777::task::957::TaskManager.Task::(_decref) Task=`2b6cbc9b-1072-4283-8969-d49fb19766e0`::ref 0 aborting False >Thread-167::DEBUG::2013-02-26 04:22:00,800::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-167::DEBUG::2013-02-26 04:22:00,801::task::568::TaskManager.Task::(_updateState) Task=`cf5bbfe8-6bda-42ca-89ed-0a553c537f47`::moving from state init -> state preparing >Thread-167::INFO::2013-02-26 04:22:00,801::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-167::DEBUG::2013-02-26 04:22:00,801::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-167::DEBUG::2013-02-26 04:22:00,801::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-167::INFO::2013-02-26 04:22:00,802::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-167::DEBUG::2013-02-26 04:22:00,802::task::1151::TaskManager.Task::(prepare) Task=`cf5bbfe8-6bda-42ca-89ed-0a553c537f47`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-167::DEBUG::2013-02-26 04:22:00,802::task::568::TaskManager.Task::(_updateState) Task=`cf5bbfe8-6bda-42ca-89ed-0a553c537f47`::moving from state preparing -> state finished >Thread-167::DEBUG::2013-02-26 04:22:00,802::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-167::DEBUG::2013-02-26 04:22:00,802::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-167::DEBUG::2013-02-26 04:22:00,803::task::957::TaskManager.Task::(_decref) Task=`cf5bbfe8-6bda-42ca-89ed-0a553c537f47`::ref 0 aborting False >Thread-169::DEBUG::2013-02-26 04:22:01,825::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-169::DEBUG::2013-02-26 04:22:01,832::task::568::TaskManager.Task::(_updateState) Task=`323fabe2-1ba9-472a-a193-3c703bb9b253`::moving from state init -> state preparing >Thread-169::INFO::2013-02-26 04:22:01,833::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-169::DEBUG::2013-02-26 04:22:01,833::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-169::DEBUG::2013-02-26 04:22:01,833::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-169::INFO::2013-02-26 04:22:01,833::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-169::DEBUG::2013-02-26 04:22:01,834::task::1151::TaskManager.Task::(prepare) Task=`323fabe2-1ba9-472a-a193-3c703bb9b253`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-169::DEBUG::2013-02-26 04:22:01,834::task::568::TaskManager.Task::(_updateState) Task=`323fabe2-1ba9-472a-a193-3c703bb9b253`::moving from state preparing -> state finished >Thread-169::DEBUG::2013-02-26 04:22:01,834::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-169::DEBUG::2013-02-26 04:22:01,834::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2013-02-26 04:22:01,835::task::957::TaskManager.Task::(_decref) Task=`323fabe2-1ba9-472a-a193-3c703bb9b253`::ref 0 aborting False >Thread-170::DEBUG::2013-02-26 04:22:02,860::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-170::DEBUG::2013-02-26 04:22:02,860::task::568::TaskManager.Task::(_updateState) Task=`4d984248-4cbc-43c0-8209-75302bb5e953`::moving from state init -> state preparing >Thread-170::INFO::2013-02-26 04:22:02,861::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-170::DEBUG::2013-02-26 04:22:02,861::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-170::DEBUG::2013-02-26 04:22:02,861::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-170::INFO::2013-02-26 04:22:02,861::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-170::DEBUG::2013-02-26 04:22:02,861::task::1151::TaskManager.Task::(prepare) Task=`4d984248-4cbc-43c0-8209-75302bb5e953`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-170::DEBUG::2013-02-26 04:22:02,861::task::568::TaskManager.Task::(_updateState) Task=`4d984248-4cbc-43c0-8209-75302bb5e953`::moving from state preparing -> state finished >Thread-170::DEBUG::2013-02-26 04:22:02,861::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-170::DEBUG::2013-02-26 04:22:02,862::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-170::DEBUG::2013-02-26 04:22:02,862::task::957::TaskManager.Task::(_decref) Task=`4d984248-4cbc-43c0-8209-75302bb5e953`::ref 0 aborting False >Thread-171::DEBUG::2013-02-26 04:22:03,895::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-171::DEBUG::2013-02-26 04:22:04,085::task::568::TaskManager.Task::(_updateState) Task=`c1ee5d51-fb34-41cc-b795-11605c6e46c7`::moving from state init -> state preparing >Thread-171::INFO::2013-02-26 04:22:04,085::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-171::DEBUG::2013-02-26 04:22:04,085::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-171::DEBUG::2013-02-26 04:22:04,086::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-171::INFO::2013-02-26 04:22:04,086::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-171::DEBUG::2013-02-26 04:22:04,086::task::1151::TaskManager.Task::(prepare) Task=`c1ee5d51-fb34-41cc-b795-11605c6e46c7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-171::DEBUG::2013-02-26 04:22:04,086::task::568::TaskManager.Task::(_updateState) Task=`c1ee5d51-fb34-41cc-b795-11605c6e46c7`::moving from state preparing -> state finished >Thread-171::DEBUG::2013-02-26 04:22:04,087::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-171::DEBUG::2013-02-26 04:22:04,087::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-171::DEBUG::2013-02-26 04:22:04,087::task::957::TaskManager.Task::(_decref) Task=`c1ee5d51-fb34-41cc-b795-11605c6e46c7`::ref 0 aborting False >Thread-172::DEBUG::2013-02-26 04:22:04,151::task::568::TaskManager.Task::(_updateState) Task=`447c23ab-0d87-459c-8034-8f8c4ec74a08`::moving from state init -> state preparing >Thread-172::INFO::2013-02-26 04:22:04,168::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-172::INFO::2013-02-26 04:22:04,168::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'cefa67eb-af91-46ac-8e17-8180a8a7daec': {'delay': '0.00305390357971', 'lastCheck': '16.1', 'code': 0, 'valid': True}} >Thread-172::DEBUG::2013-02-26 04:22:04,168::task::1151::TaskManager.Task::(prepare) Task=`447c23ab-0d87-459c-8034-8f8c4ec74a08`::finished: {'cefa67eb-af91-46ac-8e17-8180a8a7daec': {'delay': '0.00305390357971', 'lastCheck': '16.1', 'code': 0, 'valid': True}} >Thread-172::DEBUG::2013-02-26 04:22:04,168::task::568::TaskManager.Task::(_updateState) Task=`447c23ab-0d87-459c-8034-8f8c4ec74a08`::moving from state preparing -> state finished >Thread-172::DEBUG::2013-02-26 04:22:04,168::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-172::DEBUG::2013-02-26 04:22:04,168::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-172::DEBUG::2013-02-26 04:22:04,169::task::957::TaskManager.Task::(_decref) Task=`447c23ab-0d87-459c-8034-8f8c4ec74a08`::ref 0 aborting False >Thread-174::DEBUG::2013-02-26 04:22:05,120::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-174::DEBUG::2013-02-26 04:22:05,121::task::568::TaskManager.Task::(_updateState) Task=`470d011b-1178-4b32-a73e-2d996776a1d2`::moving from state init -> state preparing >Thread-174::INFO::2013-02-26 04:22:05,121::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-174::DEBUG::2013-02-26 04:22:05,122::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-174::DEBUG::2013-02-26 04:22:05,122::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-174::INFO::2013-02-26 04:22:05,122::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-174::DEBUG::2013-02-26 04:22:05,122::task::1151::TaskManager.Task::(prepare) Task=`470d011b-1178-4b32-a73e-2d996776a1d2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-174::DEBUG::2013-02-26 04:22:05,123::task::568::TaskManager.Task::(_updateState) Task=`470d011b-1178-4b32-a73e-2d996776a1d2`::moving from state preparing -> state finished >Thread-174::DEBUG::2013-02-26 04:22:05,123::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-174::DEBUG::2013-02-26 04:22:05,123::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-174::DEBUG::2013-02-26 04:22:05,123::task::957::TaskManager.Task::(_decref) Task=`470d011b-1178-4b32-a73e-2d996776a1d2`::ref 0 aborting False >Thread-175::DEBUG::2013-02-26 04:22:06,147::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-175::DEBUG::2013-02-26 04:22:06,441::task::568::TaskManager.Task::(_updateState) Task=`949e971f-a075-4a08-8f6d-d17e01633888`::moving from state init -> state preparing >Thread-175::INFO::2013-02-26 04:22:06,442::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-175::DEBUG::2013-02-26 04:22:06,442::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-175::DEBUG::2013-02-26 04:22:06,442::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-175::INFO::2013-02-26 04:22:06,442::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-175::DEBUG::2013-02-26 04:22:06,442::task::1151::TaskManager.Task::(prepare) Task=`949e971f-a075-4a08-8f6d-d17e01633888`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-175::DEBUG::2013-02-26 04:22:06,443::task::568::TaskManager.Task::(_updateState) Task=`949e971f-a075-4a08-8f6d-d17e01633888`::moving from state preparing -> state finished >Thread-175::DEBUG::2013-02-26 04:22:06,443::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-175::DEBUG::2013-02-26 04:22:06,443::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-175::DEBUG::2013-02-26 04:22:06,443::task::957::TaskManager.Task::(_decref) Task=`949e971f-a075-4a08-8f6d-d17e01633888`::ref 0 aborting False >Thread-177::DEBUG::2013-02-26 04:22:07,477::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:09,350::clusterlock::190::SANLock::(acquireHostId) Host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec successfully acquired (id: 1) >Thread-177::DEBUG::2013-02-26 04:22:29,930::task::568::TaskManager.Task::(_updateState) Task=`06e0945b-9360-498b-bcf3-e3e3d0089ccb`::moving from state init -> state preparing >Thread-177::INFO::2013-02-26 04:22:29,930::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-177::DEBUG::2013-02-26 04:22:29,930::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-177::DEBUG::2013-02-26 04:22:29,931::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-177::INFO::2013-02-26 04:22:29,931::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-177::DEBUG::2013-02-26 04:22:29,931::task::1151::TaskManager.Task::(prepare) Task=`06e0945b-9360-498b-bcf3-e3e3d0089ccb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-177::DEBUG::2013-02-26 04:22:29,931::task::568::TaskManager.Task::(_updateState) Task=`06e0945b-9360-498b-bcf3-e3e3d0089ccb`::moving from state preparing -> state finished >Thread-177::DEBUG::2013-02-26 04:22:29,931::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-177::DEBUG::2013-02-26 04:22:29,932::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-177::DEBUG::2013-02-26 04:22:29,932::task::957::TaskManager.Task::(_decref) Task=`06e0945b-9360-498b-bcf3-e3e3d0089ccb`::ref 0 aborting False >d7b894a8-033a-4677-8880-73cfa0dcc763::INFO::2013-02-26 04:22:29,932::clusterlock::223::SANLock::(acquire) Acquiring cluster lock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 1) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,065::clusterlock::247::SANLock::(acquire) Cluster lock for domain cefa67eb-af91-46ac-8e17-8180a8a7daec successfully acquired (id: 1) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,065::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,073::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7d9c4bce2aada93b6be29b9d223d4aceea3a7da4'] >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,073::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,073::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,073::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b65fd4c42c48cf84318f2a687eb980bf0e8df759'] >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,210::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,281::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`90dba16d-aa0c-4e95-b6df-c21dbecf74e8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,281::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7' for lock type 'exclusive' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,282::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7' is free. Now locking as 'exclusive' (1 active user) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,282::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`90dba16d-aa0c-4e95-b6df-c21dbecf74e8`::Granted request >d7b894a8-033a-4677-8880-73cfa0dcc763::INFO::2013-02-26 04:22:30,283::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `cefa67eb-af91-46ac-8e17-8180a8a7daec` >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,283::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`d7b031e5-2ee1-4c4d-8ab9-6c88b7d4f830`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,283::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' for lock type 'exclusive' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,283::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free. Now locking as 'exclusive' (1 active user) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,284::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`d7b031e5-2ee1-4c4d-8ab9-6c88b7d4f830`::Granted request >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,284::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,285::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free cefa67eb-af91-46ac-8e17-8180a8a7daec' (cwd None) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,562::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "cefa67eb-af91-46ac-8e17-8180a8a7daec" not found\n'; <rc> = 5 >d7b894a8-033a-4677-8880-73cfa0dcc763::WARNING::2013-02-26 04:22:30,564::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "cefa67eb-af91-46ac-8e17-8180a8a7daec" not found'] >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,565::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,617::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,618::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,622::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomain01', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DataCenter01', 'POOL_DOMAINS=cefa67eb-af91-46ac-8e17-8180a8a7daec:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=723b04cc-dae1-4114-92da-e4e65e12b1d7', 'REMOTE_PATH=tiger.qa.lab.tlv.redhat.com:/export/storage_4BCJz0_nfs_2013_02_26_4_4_57_997720', 'ROLE=Master', 'SDUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b65fd4c42c48cf84318f2a687eb980bf0e8df759'] >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,624::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >d7b894a8-033a-4677-8880-73cfa0dcc763::WARNING::2013-02-26 04:22:30,624::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace cefa67eb-af91-46ac-8e17-8180a8a7daec_imageNS already registered >d7b894a8-033a-4677-8880-73cfa0dcc763::WARNING::2013-02-26 04:22:30,624::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace cefa67eb-af91-46ac-8e17-8180a8a7daec_volumeNS already registered >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,625::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,625::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' (0 active users) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,625::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free, finding out if anyone is waiting for it. >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,626::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', Clearing records. >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,626::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,626::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,627::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,627::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,627::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7' (0 active users) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,628::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7' is free, finding out if anyone is waiting for it. >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,628::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_723b04cc-dae1-4114-92da-e4e65e12b1d7', Clearing records. >d7b894a8-033a-4677-8880-73cfa0dcc763::WARNING::2013-02-26 04:22:30,651::sd::600::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec/master/vms) >d7b894a8-033a-4677-8880-73cfa0dcc763::WARNING::2013-02-26 04:22:30,684::sd::605::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720/cefa67eb-af91-46ac-8e17-8180a8a7daec/master/tasks) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,709::sp::309::Storage.StoragePool::(startSpm) ended. >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,709::task::568::TaskManager.Task::(_updateState) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::moving from state running -> state finished >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,710::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7': < ResourceRef 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', isValid: 'True' obj: 'None'>} >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,710::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,710::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,710::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' (0 active users) >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,710::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free, finding out if anyone is waiting for it. >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,711::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', Clearing records. >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,711::task::880::TaskManager.Task::(_runJobs) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::Task.run: exit - success: result >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,711::task::957::TaskManager.Task::(_decref) Task=`d7b894a8-033a-4677-8880-73cfa0dcc763`::ref 0 aborting False >d7b894a8-033a-4677-8880-73cfa0dcc763::DEBUG::2013-02-26 04:22:30,711::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-201::DEBUG::2013-02-26 04:22:30,956::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-201::DEBUG::2013-02-26 04:22:55,259::task::568::TaskManager.Task::(_updateState) Task=`938a7d28-a9c2-40be-8006-96b63f2dd81c`::moving from state init -> state preparing >Thread-201::INFO::2013-02-26 04:22:55,260::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-201::DEBUG::2013-02-26 04:22:55,260::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-201::DEBUG::2013-02-26 04:22:55,261::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'} >Thread-201::INFO::2013-02-26 04:22:55,261::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-201::DEBUG::2013-02-26 04:22:55,261::task::1151::TaskManager.Task::(prepare) Task=`938a7d28-a9c2-40be-8006-96b63f2dd81c`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b894a8-033a-4677-8880-73cfa0dcc763'}} >Thread-201::DEBUG::2013-02-26 04:22:55,261::task::568::TaskManager.Task::(_updateState) Task=`938a7d28-a9c2-40be-8006-96b63f2dd81c`::moving from state preparing -> state finished >Thread-201::DEBUG::2013-02-26 04:22:55,261::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-201::DEBUG::2013-02-26 04:22:55,262::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-201::DEBUG::2013-02-26 04:22:55,262::task::957::TaskManager.Task::(_decref) Task=`938a7d28-a9c2-40be-8006-96b63f2dd81c`::ref 0 aborting False >Thread-203::DEBUG::2013-02-26 04:22:55,282::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-203::DEBUG::2013-02-26 04:22:55,283::task::568::TaskManager.Task::(_updateState) Task=`9387233e-85b0-4e07-bcb1-8af0571a8cd1`::moving from state init -> state preparing >Thread-203::INFO::2013-02-26 04:22:55,283::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', options=None) >Thread-203::INFO::2013-02-26 04:22:55,283::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-203::DEBUG::2013-02-26 04:22:55,283::task::1151::TaskManager.Task::(prepare) Task=`9387233e-85b0-4e07-bcb1-8af0571a8cd1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-203::DEBUG::2013-02-26 04:22:55,284::task::568::TaskManager.Task::(_updateState) Task=`9387233e-85b0-4e07-bcb1-8af0571a8cd1`::moving from state preparing -> state finished >Thread-203::DEBUG::2013-02-26 04:22:55,284::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-203::DEBUG::2013-02-26 04:22:55,284::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2013-02-26 04:22:55,284::task::957::TaskManager.Task::(_decref) Task=`9387233e-85b0-4e07-bcb1-8af0571a8cd1`::ref 0 aborting False >Thread-204::DEBUG::2013-02-26 04:22:55,308::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-204::DEBUG::2013-02-26 04:22:55,308::task::568::TaskManager.Task::(_updateState) Task=`c41b8141-211a-440f-aed1-97dd1dd88a49`::moving from state init -> state preparing >Thread-204::INFO::2013-02-26 04:22:55,308::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='d7b894a8-033a-4677-8880-73cfa0dcc763', spUUID=None, options=None) >Thread-204::DEBUG::2013-02-26 04:22:55,308::taskManager::161::TaskManager::(clearTask) Entry. taskID: d7b894a8-033a-4677-8880-73cfa0dcc763 >Thread-204::DEBUG::2013-02-26 04:22:55,308::taskManager::166::TaskManager::(clearTask) Return. >Thread-204::INFO::2013-02-26 04:22:55,308::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-204::DEBUG::2013-02-26 04:22:55,309::task::1151::TaskManager.Task::(prepare) Task=`c41b8141-211a-440f-aed1-97dd1dd88a49`::finished: None >Thread-204::DEBUG::2013-02-26 04:22:55,309::task::568::TaskManager.Task::(_updateState) Task=`c41b8141-211a-440f-aed1-97dd1dd88a49`::moving from state preparing -> state finished >Thread-204::DEBUG::2013-02-26 04:22:55,309::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-204::DEBUG::2013-02-26 04:22:55,309::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2013-02-26 04:22:55,309::task::957::TaskManager.Task::(_decref) Task=`c41b8141-211a-440f-aed1-97dd1dd88a49`::ref 0 aborting False >Thread-205::DEBUG::2013-02-26 04:22:55,362::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-205::DEBUG::2013-02-26 04:22:55,362::task::568::TaskManager.Task::(_updateState) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::moving from state init -> state preparing >Thread-205::INFO::2013-02-26 04:22:55,362::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='cefa67eb-af91-46ac-8e17-8180a8a7daec', spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', options=None) >Thread-205::DEBUG::2013-02-26 04:22:55,363::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`eab87651-c171-4ea7-9284-5c640d5219ff`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-205::DEBUG::2013-02-26 04:22:55,363::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' for lock type 'exclusive' >Thread-205::DEBUG::2013-02-26 04:22:55,363::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free. Now locking as 'exclusive' (1 active user) >Thread-205::DEBUG::2013-02-26 04:22:55,364::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`eab87651-c171-4ea7-9284-5c640d5219ff`::Granted request >Thread-205::DEBUG::2013-02-26 04:22:55,364::task::794::TaskManager.Task::(resourceAcquired) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::_resourcesAcquired: Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7 (exclusive) >Thread-205::DEBUG::2013-02-26 04:22:55,364::task::957::TaskManager.Task::(_decref) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::ref 1 aborting False >Thread-205::DEBUG::2013-02-26 04:22:55,364::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`5c26193d-3978-4a22-8ef6-28537fde5be3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-205::DEBUG::2013-02-26 04:22:55,365::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' for lock type 'exclusive' >Thread-205::DEBUG::2013-02-26 04:22:55,365::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free. Now locking as 'exclusive' (1 active user) >Thread-205::DEBUG::2013-02-26 04:22:55,365::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec`ReqID=`5c26193d-3978-4a22-8ef6-28537fde5be3`::Granted request >Thread-205::DEBUG::2013-02-26 04:22:55,365::task::794::TaskManager.Task::(resourceAcquired) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::_resourcesAcquired: Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec (exclusive) >Thread-205::DEBUG::2013-02-26 04:22:55,365::task::957::TaskManager.Task::(_decref) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::ref 1 aborting False >Thread-205::INFO::2013-02-26 04:22:55,366::sp::1045::Storage.StoragePool::(activateSD) sdUUID=cefa67eb-af91-46ac-8e17-8180a8a7daec spUUID=723b04cc-dae1-4114-92da-e4e65e12b1d7 >Thread-205::INFO::2013-02-26 04:22:55,366::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-205::DEBUG::2013-02-26 04:22:55,366::task::1151::TaskManager.Task::(prepare) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::finished: None >Thread-205::DEBUG::2013-02-26 04:22:55,366::task::568::TaskManager.Task::(_updateState) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::moving from state preparing -> state finished >Thread-205::DEBUG::2013-02-26 04:22:55,366::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec': < ResourceRef 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', isValid: 'True' obj: 'None'>, 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7': < ResourceRef 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', isValid: 'True' obj: 'None'>} >Thread-205::DEBUG::2013-02-26 04:22:55,367::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-205::DEBUG::2013-02-26 04:22:55,367::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' >Thread-205::DEBUG::2013-02-26 04:22:55,367::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' (0 active users) >Thread-205::DEBUG::2013-02-26 04:22:55,367::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec' is free, finding out if anyone is waiting for it. >Thread-205::DEBUG::2013-02-26 04:22:55,367::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.cefa67eb-af91-46ac-8e17-8180a8a7daec', Clearing records. >Thread-205::DEBUG::2013-02-26 04:22:55,368::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' >Thread-205::DEBUG::2013-02-26 04:22:55,368::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' (0 active users) >Thread-205::DEBUG::2013-02-26 04:22:55,368::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free, finding out if anyone is waiting for it. >Thread-205::DEBUG::2013-02-26 04:22:55,368::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', Clearing records. >Thread-205::DEBUG::2013-02-26 04:22:55,369::task::957::TaskManager.Task::(_decref) Task=`70074850-922f-4bac-a6d3-c0fe4e66f2b9`::ref 0 aborting False >Thread-206::DEBUG::2013-02-26 04:22:55,407::BindingXMLRPC::161::vds::(wrapper) [10.35.70.40] >Thread-206::DEBUG::2013-02-26 04:22:55,408::task::568::TaskManager.Task::(_updateState) Task=`3265e5a1-4352-4bcb-b3fb-8aa1d9f01435`::moving from state init -> state preparing >Thread-206::INFO::2013-02-26 04:22:55,408::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='723b04cc-dae1-4114-92da-e4e65e12b1d7', hostID=1, scsiKey='723b04cc-dae1-4114-92da-e4e65e12b1d7', msdUUID='cefa67eb-af91-46ac-8e17-8180a8a7daec', masterVersion=1, options=None) >Thread-206::DEBUG::2013-02-26 04:22:55,408::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`bfcbfb35-4c90-4498-a1d1-f9aa6f188e67`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-206::DEBUG::2013-02-26 04:22:55,409::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' for lock type 'shared' >Thread-206::DEBUG::2013-02-26 04:22:55,409::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free. Now locking as 'shared' (1 active user) >Thread-206::DEBUG::2013-02-26 04:22:55,409::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7`ReqID=`bfcbfb35-4c90-4498-a1d1-f9aa6f188e67`::Granted request >Thread-206::DEBUG::2013-02-26 04:22:55,409::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain cefa67eb-af91-46ac-8e17-8180a8a7daec verified, version 1 >Thread-206::DEBUG::2013-02-26 04:22:55,410::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' >Thread-206::DEBUG::2013-02-26 04:22:55,410::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' (0 active users) >Thread-206::DEBUG::2013-02-26 04:22:55,410::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7' is free, finding out if anyone is waiting for it. >Thread-206::DEBUG::2013-02-26 04:22:55,410::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.723b04cc-dae1-4114-92da-e4e65e12b1d7', Clearing records. >Thread-206::INFO::2013-02-26 04:22:55,410::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-206::DEBUG::2013-02-26 04:22:55,411::task::1151::TaskManager.Task::(prepare) Task=`3265e5a1-4352-4bcb-b3fb-8aa1d9f01435`::finished: None >Thread-206::DEBUG::2013-02-26 04:22:55,411::task::568::TaskManager.Task::(_updateState) Task=`3265e5a1-4352-4bcb-b3fb-8aa1d9f01435`::moving from state preparing -> state finished >Thread-206::DEBUG::2013-02-26 04:22:55,411::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-206::DEBUG::2013-02-26 04:22:55,411::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-206::DEBUG::2013-02-26 04:22:55,411::task::957::TaskManager.Task::(_decref) Task=`3265e5a1-4352-4bcb-b3fb-8aa1d9f01435`::ref 0 aborting False >Thread-130::DEBUG::2013-02-26 04:23:00,002::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:23:00,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:23:00,598::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >Thread-130::DEBUG::2013-02-26 04:23:00,619::domainMonitor::216::Storage.DomainMonitorThread::(_monitorDomain) Domain cefa67eb-af91-46ac-8e17-8180a8a7daec changed its status to Invalid >Thread-208::DEBUG::2013-02-26 04:23:00,629::misc::1161::Event.Storage.DomainMonitor.onDomainConnectivityStateChange::(_emit) Emitting event >Thread-208::WARNING::2013-02-26 04:23:00,639::misc::1179::Event.Storage.DomainMonitor.onDomainConnectivityStateChange::(_emit) Could not run registered method because of an exception >Traceback (most recent call last): > File "/usr/share/vdsm/storage/misc.py", line 1171, in _emit > logUtils.funcName(func)) > File "/usr/share/vdsm/logUtils.py", line 30, in funcName > return func.func_name >AttributeError: 'functools.partial' object has no attribute 'func_name' >Thread-208::DEBUG::2013-02-26 04:23:00,650::misc::1181::Event.Storage.DomainMonitor.onDomainConnectivityStateChange::(_emit) Event emitted >Thread-130::DEBUG::2013-02-26 04:23:10,639::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:23:10,641::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:23:10,704::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >Thread-130::DEBUG::2013-02-26 04:23:20,708::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:23:20,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:23:20,765::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >Thread-130::DEBUG::2013-02-26 04:23:30,773::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:23:30,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:23:30,837::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >Thread-130::DEBUG::2013-02-26 04:23:40,841::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:23:44,241::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:23:44,298::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >Thread-130::DEBUG::2013-02-26 04:23:54,385::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:23:54,387::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:23:54,442::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >Thread-130::DEBUG::2013-02-26 04:24:04,482::fileSD::488::Storage.StorageDomain::(selftest) Unmounting stale file system /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720 >Thread-130::DEBUG::2013-02-26 04:24:04,485::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720' (cwd None) >Thread-130::ERROR::2013-02-26 04:24:04,551::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain cefa67eb-af91-46ac-8e17-8180a8a7daec monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 186, in _monitorDomain > self.domain.selftest() > File "/usr/share/vdsm/storage/nfsSD.py", line 108, in selftest > fileSD.FileStorageDomain.selftest(self) > File "/usr/share/vdsm/storage/fileSD.py", line 489, in selftest > mount.getMountFromTarget(self.mountpoint).umount() > File "/usr/share/vdsm/storage/mount.py", line 226, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (16, ';umount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\numount.nfs: /rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720: device is busy\n') >MainThread::INFO::2013-02-26 04:24:10,353::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-26 04:24:10,354::task::568::TaskManager.Task::(_updateState) Task=`aaa9a159-81be-4047-a075-5ff5e7d3d44f`::moving from state init -> state preparing >MainThread::DEBUG::2013-02-26 04:24:10,354::clientIF::228::vds::(prepareForShutdown) cannot run prepareForShutdown concurrently >MainThread::INFO::2013-02-26 04:24:10,354::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-26 04:24:10,355::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-26 04:24:10,361::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,363::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,366::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,369::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,371::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,374::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,376::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,379::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,381::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,384::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,386::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,389::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,392::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,394::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,396::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,397::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,399::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,401::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,403::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,404::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,406::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,408::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,413::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,416::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,419::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,421::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,424::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,426::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,429::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,431::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,434::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,436::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,439::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,442::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,444::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-130::DEBUG::2013-02-26 04:24:10,540::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for cefa67eb-af91-46ac-8e17-8180a8a7daec >Thread-130::INFO::2013-02-26 04:24:10,541::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain cefa67eb-af91-46ac-8e17-8180a8a7daec (id: 1) >Thread-130::DEBUG::2013-02-26 04:24:10,541::domainMonitor::162::Storage.DomainMonitorThread::(_monitorLoop) Unable to release the host id 1 for domain cefa67eb-af91-46ac-8e17-8180a8a7daec >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 159, in _monitorLoop > self.domain.releaseHostId(self.hostId, unused=True) > File "/usr/share/vdsm/storage/sd.py", line 439, in releaseHostId > self._clusterLock.releaseHostId(hostId, async, unused) > File "/usr/share/vdsm/storage/clusterlock.py", line 202, in releaseHostId > raise se.ReleaseHostIdFailure(self._sdUUID, e) >ReleaseHostIdFailure: Cannot release host id: ('cefa67eb-af91-46ac-8e17-8180a8a7daec', SanlockException(16, 'Sanlock lockspace remove failure', 'Device or resource busy')) >MainThread::DEBUG::2013-02-26 04:24:10,542::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-26 04:24:10,542::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-26 04:24:10,543::task::1151::TaskManager.Task::(prepare) Task=`aaa9a159-81be-4047-a075-5ff5e7d3d44f`::finished: None >MainThread::DEBUG::2013-02-26 04:24:10,543::task::568::TaskManager.Task::(_updateState) Task=`aaa9a159-81be-4047-a075-5ff5e7d3d44f`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-26 04:24:10,543::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-26 04:24:10,543::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-26 04:24:10,543::task::957::TaskManager.Task::(_decref) Task=`aaa9a159-81be-4047-a075-5ff5e7d3d44f`::ref 0 aborting False >MainThread::INFO::2013-02-26 04:24:10,544::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-02-26 04:24:10,544::vdsm::99::vds::(run) <_MainThread(MainThread, started 140245565163264)> >MainThread::INFO::2013-02-26 04:24:10,544::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140245472601856)> >MainThread::INFO::2013-02-26 04:24:10,544::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-26 04:24:10,544::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 140244305311488)> >MainThread::INFO::2013-02-26 04:24:10,544::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 140245328983808)> >MainThread::INFO::2013-02-26 04:24:10,544::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 140244775073536)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140244722624256)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 140245202876160)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 140245234345728)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 140245213366016)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <WorkerThread(d7b894a8-033a-4677-8880-73cfa0dcc763, started daemon 140245223855872)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 140244764583680)> >MainThread::INFO::2013-02-26 04:24:10,545::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 140245339473664)> >MainThread::INFO::2013-02-26 04:24:10,546::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 140245244835584)> >MainThread::INFO::2013-02-26 04:24:10,546::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 140245192386304)> >MainThread::INFO::2013-02-26 04:24:10,677::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-26 04:24:10,972::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-26 04:24:10,973::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-26 04:24:10,977::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-26 04:24:10,982::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,984::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,986::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,988::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,990::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,992::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,995::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,997::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:10,999::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,001::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,003::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,006::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,008::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,010::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,012::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,014::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,016::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,019::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,021::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,023::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,025::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,027::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,029::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,032::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,034::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,036::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,038::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,040::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,042::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,044::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,047::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,049::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,051::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,053::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,055::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:11,124::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-26 04:24:11,124::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py bb2a034f-dbb0-463c-9150-14024c77f0d4 12564 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-26 04:24:11,389::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-26 04:24:11,389::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-26 04:24:11,389::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-26 04:24:11,389::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-26 04:24:11,390::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-26 04:24:11,390::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-26 04:24:11,408::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-26 04:24:13,130::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::WARNING::2013-02-26 04:24:13,131::supervdsm::183::SuperVdsmProxy::(_connect) Connect to svdsm failed [Errno 2] No such file or directory >MainThread::DEBUG::2013-02-26 04:24:14,132::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::WARNING::2013-02-26 04:24:14,133::supervdsm::183::SuperVdsmProxy::(_connect) Connect to svdsm failed [Errno 2] No such file or directory >MainThread::DEBUG::2013-02-26 04:24:15,134::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::WARNING::2013-02-26 04:24:15,134::supervdsm::183::SuperVdsmProxy::(_connect) Connect to svdsm failed [Errno 2] No such file or directory >MainThread::ERROR::2013-02-26 04:24:15,135::misc::173::Storage.Misc::(panic) Panic: Couldn't connect to supervdsm >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsm.py", line 195, in launch > utils.retry(self._connect, Exception, timeout=60, tries=3) > File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 934, in retry > return func() > File "/usr/share/vdsm/supervdsm.py", line 181, in _connect > self._manager.connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 474, in connect > conn = Client(self._address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >MainThread::INFO::2013-02-26 04:24:15,187::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-26 04:24:15,439::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-26 04:24:15,439::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-26 04:24:15,443::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-26 04:24:15,447::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,449::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,451::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,454::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,456::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,458::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,460::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,462::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,464::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,466::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,468::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,471::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,473::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,475::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,477::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,479::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,481::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,484::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,486::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,488::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,490::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,492::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,495::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,497::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,499::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,501::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,503::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,505::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,508::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,510::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,512::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,514::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,516::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,518::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,521::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 04:24:15,573::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-26 04:24:15,573::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py cd8b97a8-b8a9-41db-8674-209213805525 12593 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-26 04:24:15,835::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-26 04:24:15,835::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-26 04:24:15,836::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-26 04:24:15,836::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-26 04:24:15,836::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-26 04:24:15,837::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-26 04:24:15,838::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-26 04:24:17,580::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-26 04:24:17,587::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-26 04:24:17,588::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-26 04:24:17,818::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-26 04:24:17,819::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-26 04:24:17,822::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-26 04:24:17,822::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center/mnt/tiger.qa.lab.tlv.redhat.com:_export_storage__4BCJz0__nfs__2013__02__26__4__4__57__997720'] >MainThread::DEBUG::2013-02-26 04:24:17,822::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-26 04:24:17,825::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-26 04:24:17,827::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-26 04:24:17,827::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:17,832::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-26 04:24:17,854::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-26 04:24:17,855::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-26 04:24:17,883::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-26 04:24:17,883::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-26 04:24:17,884::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-26 04:24:17,884::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-26 04:24:17,892::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-26 04:24:17,892::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-26 04:24:17,893::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-26 04:24:17,912::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-26 04:24:17,913::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-26 04:24:17,939::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:24:18,040::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:24:18,040::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:18,040::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:18,041::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:24:18,268::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:24:18,268::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:18,269::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:24:18,456::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:24:18,457::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-26 04:24:18,457::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 04:24:18,457::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-26 04:24:18,458::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 04:24:18,458::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:24:18,482::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:24:18,483::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:18,485::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,489::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,492::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,495::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,498::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,504::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 04:24:19,506::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-26 04:24:21,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-26 04:24:23,443::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 04:24:23,443::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:23,449::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:23,449::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:23,449::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:23,449::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:23,450::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 04:24:23,450::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-26 04:24:23,450::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-26 21:37:32,685::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-26 21:37:32,858::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >MainThread::INFO::2013-02-26 21:38:50,719::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-26 22:04:10,752::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-26 22:04:11,431::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-26 22:04:11,431::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-26 22:04:11,476::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-26 22:04:12,210::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,212::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,213::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,215::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,217::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,219::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,220::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,222::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,223::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,225::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,226::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,228::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,230::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,231::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,233::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,235::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,237::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,239::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,241::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,243::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,245::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,246::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,248::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,249::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,251::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,252::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,253::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,255::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,256::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,257::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,258::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,260::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,261::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,262::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,264::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:04:12,375::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-26 22:04:12,376::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 3e8b5f49-cd06-4fae-81fb-5514d7bc557a 12195 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-26 22:04:13,033::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-26 22:04:13,033::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-26 22:04:13,033::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-26 22:04:13,034::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-26 22:04:13,034::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-26 22:04:13,034::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-26 22:04:13,036::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-26 22:04:14,381::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-26 22:04:14,388::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-26 22:04:14,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-26 22:04:14,572::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-26 22:04:14,573::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-26 22:04:14,574::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-26 22:04:14,575::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-26 22:04:14,575::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-26 22:04:14,621::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-26 22:04:14,623::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-26 22:04:14,624::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:14,629::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9|3514f0c542a0003fa|3514f0c542a00040f|3514f0c542a00041f|3514f0c542a00042a|3514f0c542a000432%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-26 22:04:14,649::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-26 22:04:14,650::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-26 22:04:14,706::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-26 22:04:14,706::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-26 22:04:14,713::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-26 22:04:14,718::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-26 22:04:14,719::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-26 22:04:14,723::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-26 22:04:14,723::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-26 22:04:14,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-26 22:04:14,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-26 22:04:14,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:04:14,853::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:04:14,853::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:14,853::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:14,854::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9|3514f0c542a0003fa|3514f0c542a00040f|3514f0c542a00041f|3514f0c542a00042a|3514f0c542a000432%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:04:15,091::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:04:15,092::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:15,092::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9|3514f0c542a0003fa|3514f0c542a00040f|3514f0c542a00041f|3514f0c542a00042a|3514f0c542a000432%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:04:15,327::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:04:15,327::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-26 22:04:15,327::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 22:04:15,327::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-26 22:04:15,328::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 22:04:15,328::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:04:15,355::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:04:15,355::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:15,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:16,361::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:16,363::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:16,365::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:16,366::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:16,368::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:17,372::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:04:17,374::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-26 22:04:19,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:04:22,890::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:04:22,891::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:22,891::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:22,892::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:22,892::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:22,892::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:22,893::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:04:22,893::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-26 22:04:22,893::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-26 22:05:01,234::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-26 22:05:01,702::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-26 22:05:01,869::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-26 22:05:02,151::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-02-26 22:05:02,280::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getCapabilities with () {} >Thread-15::DEBUG::2013-02-26 22:05:02,301::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.70.38'}} >Thread-16::DEBUG::2013-02-26 22:05:02,349::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-02-26 22:05:02,350::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-18::DEBUG::2013-02-26 22:05:05,636::task::568::TaskManager.Task::(_updateState) Task=`f5f4c7c8-b813-496d-a0c6-7ab901bd3d7e`::moving from state init -> state preparing >Thread-18::INFO::2013-02-26 22:05:05,636::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::INFO::2013-02-26 22:05:05,636::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-18::DEBUG::2013-02-26 22:05:05,636::task::1151::TaskManager.Task::(prepare) Task=`f5f4c7c8-b813-496d-a0c6-7ab901bd3d7e`::finished: {} >Thread-18::DEBUG::2013-02-26 22:05:05,636::task::568::TaskManager.Task::(_updateState) Task=`f5f4c7c8-b813-496d-a0c6-7ab901bd3d7e`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-02-26 22:05:05,636::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-02-26 22:05:05,637::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-02-26 22:05:05,637::task::957::TaskManager.Task::(_decref) Task=`f5f4c7c8-b813-496d-a0c6-7ab901bd3d7e`::ref 0 aborting False >Thread-24::DEBUG::2013-02-26 22:05:21,161::task::568::TaskManager.Task::(_updateState) Task=`72730afb-2075-4f42-8a10-02fc49885582`::moving from state init -> state preparing >Thread-24::INFO::2013-02-26 22:05:21,162::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2013-02-26 22:05:21,162::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2013-02-26 22:05:21,162::task::1151::TaskManager.Task::(prepare) Task=`72730afb-2075-4f42-8a10-02fc49885582`::finished: {} >Thread-24::DEBUG::2013-02-26 22:05:21,162::task::568::TaskManager.Task::(_updateState) Task=`72730afb-2075-4f42-8a10-02fc49885582`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-02-26 22:05:21,162::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-02-26 22:05:21,163::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-02-26 22:05:21,163::task::957::TaskManager.Task::(_decref) Task=`72730afb-2075-4f42-8a10-02fc49885582`::ref 0 aborting False >Thread-30::DEBUG::2013-02-26 22:05:36,418::task::568::TaskManager.Task::(_updateState) Task=`a342e4cc-fcd2-4c6c-aab0-130715fd4f42`::moving from state init -> state preparing >Thread-30::INFO::2013-02-26 22:05:36,418::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2013-02-26 22:05:36,418::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-30::DEBUG::2013-02-26 22:05:36,419::task::1151::TaskManager.Task::(prepare) Task=`a342e4cc-fcd2-4c6c-aab0-130715fd4f42`::finished: {} >Thread-30::DEBUG::2013-02-26 22:05:36,419::task::568::TaskManager.Task::(_updateState) Task=`a342e4cc-fcd2-4c6c-aab0-130715fd4f42`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-02-26 22:05:36,419::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-02-26 22:05:36,419::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-02-26 22:05:36,419::task::957::TaskManager.Task::(_decref) Task=`a342e4cc-fcd2-4c6c-aab0-130715fd4f42`::ref 0 aborting False >Thread-36::DEBUG::2013-02-26 22:05:51,745::task::568::TaskManager.Task::(_updateState) Task=`d8c1276b-e946-4293-872c-c77c61e1500f`::moving from state init -> state preparing >Thread-36::INFO::2013-02-26 22:05:51,745::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-36::INFO::2013-02-26 22:05:51,745::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-36::DEBUG::2013-02-26 22:05:51,745::task::1151::TaskManager.Task::(prepare) Task=`d8c1276b-e946-4293-872c-c77c61e1500f`::finished: {} >Thread-36::DEBUG::2013-02-26 22:05:51,746::task::568::TaskManager.Task::(_updateState) Task=`d8c1276b-e946-4293-872c-c77c61e1500f`::moving from state preparing -> state finished >Thread-36::DEBUG::2013-02-26 22:05:51,746::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2013-02-26 22:05:51,746::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2013-02-26 22:05:51,747::task::957::TaskManager.Task::(_decref) Task=`d8c1276b-e946-4293-872c-c77c61e1500f`::ref 0 aborting False >Thread-42::DEBUG::2013-02-26 22:06:07,029::task::568::TaskManager.Task::(_updateState) Task=`125411f6-1fb2-42b1-ae0e-1051bd5dabc7`::moving from state init -> state preparing >Thread-42::INFO::2013-02-26 22:06:07,029::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-42::INFO::2013-02-26 22:06:07,030::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-42::DEBUG::2013-02-26 22:06:07,030::task::1151::TaskManager.Task::(prepare) Task=`125411f6-1fb2-42b1-ae0e-1051bd5dabc7`::finished: {} >Thread-42::DEBUG::2013-02-26 22:06:07,030::task::568::TaskManager.Task::(_updateState) Task=`125411f6-1fb2-42b1-ae0e-1051bd5dabc7`::moving from state preparing -> state finished >Thread-42::DEBUG::2013-02-26 22:06:07,030::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-42::DEBUG::2013-02-26 22:06:07,030::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::DEBUG::2013-02-26 22:06:07,031::task::957::TaskManager.Task::(_decref) Task=`125411f6-1fb2-42b1-ae0e-1051bd5dabc7`::ref 0 aborting False >Thread-48::DEBUG::2013-02-26 22:06:22,279::task::568::TaskManager.Task::(_updateState) Task=`242ef5e9-80ec-443a-a142-aee3df5b42cc`::moving from state init -> state preparing >Thread-48::INFO::2013-02-26 22:06:22,279::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-48::INFO::2013-02-26 22:06:22,279::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-48::DEBUG::2013-02-26 22:06:22,279::task::1151::TaskManager.Task::(prepare) Task=`242ef5e9-80ec-443a-a142-aee3df5b42cc`::finished: {} >Thread-48::DEBUG::2013-02-26 22:06:22,280::task::568::TaskManager.Task::(_updateState) Task=`242ef5e9-80ec-443a-a142-aee3df5b42cc`::moving from state preparing -> state finished >Thread-48::DEBUG::2013-02-26 22:06:22,280::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2013-02-26 22:06:22,280::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2013-02-26 22:06:22,280::task::957::TaskManager.Task::(_decref) Task=`242ef5e9-80ec-443a-a142-aee3df5b42cc`::ref 0 aborting False >Thread-54::DEBUG::2013-02-26 22:06:37,571::task::568::TaskManager.Task::(_updateState) Task=`f2d0ec82-5113-42b8-af64-276a442d91ec`::moving from state init -> state preparing >Thread-54::INFO::2013-02-26 22:07:03,184::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54::INFO::2013-02-26 22:07:03,185::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-54::DEBUG::2013-02-26 22:07:03,185::task::1151::TaskManager.Task::(prepare) Task=`f2d0ec82-5113-42b8-af64-276a442d91ec`::finished: {} >Thread-54::DEBUG::2013-02-26 22:07:03,185::task::568::TaskManager.Task::(_updateState) Task=`f2d0ec82-5113-42b8-af64-276a442d91ec`::moving from state preparing -> state finished >Thread-54::DEBUG::2013-02-26 22:07:03,186::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2013-02-26 22:07:03,186::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2013-02-26 22:07:03,186::task::957::TaskManager.Task::(_decref) Task=`f2d0ec82-5113-42b8-af64-276a442d91ec`::ref 0 aborting False >Thread-60::DEBUG::2013-02-26 22:07:58,604::task::568::TaskManager.Task::(_updateState) Task=`8f1b442c-6b3c-40e6-9702-dda00ae49544`::moving from state init -> state preparing >Thread-60::INFO::2013-02-26 22:07:58,604::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-60::INFO::2013-02-26 22:07:58,605::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-60::DEBUG::2013-02-26 22:07:58,605::task::1151::TaskManager.Task::(prepare) Task=`8f1b442c-6b3c-40e6-9702-dda00ae49544`::finished: {} >Thread-60::DEBUG::2013-02-26 22:07:58,605::task::568::TaskManager.Task::(_updateState) Task=`8f1b442c-6b3c-40e6-9702-dda00ae49544`::moving from state preparing -> state finished >Thread-60::DEBUG::2013-02-26 22:07:58,605::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2013-02-26 22:07:58,605::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2013-02-26 22:07:58,605::task::957::TaskManager.Task::(_decref) Task=`8f1b442c-6b3c-40e6-9702-dda00ae49544`::ref 0 aborting False >Thread-66::DEBUG::2013-02-26 22:08:14,061::task::568::TaskManager.Task::(_updateState) Task=`7781f671-080d-476c-87fd-560a07549a1b`::moving from state init -> state preparing >Thread-66::INFO::2013-02-26 22:08:14,067::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-66::INFO::2013-02-26 22:08:14,067::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-66::DEBUG::2013-02-26 22:08:14,067::task::1151::TaskManager.Task::(prepare) Task=`7781f671-080d-476c-87fd-560a07549a1b`::finished: {} >Thread-66::DEBUG::2013-02-26 22:08:14,068::task::568::TaskManager.Task::(_updateState) Task=`7781f671-080d-476c-87fd-560a07549a1b`::moving from state preparing -> state finished >Thread-66::DEBUG::2013-02-26 22:08:14,068::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-66::DEBUG::2013-02-26 22:08:14,068::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-66::DEBUG::2013-02-26 22:08:14,068::task::957::TaskManager.Task::(_decref) Task=`7781f671-080d-476c-87fd-560a07549a1b`::ref 0 aborting False >Thread-72::DEBUG::2013-02-26 22:09:07,781::task::568::TaskManager.Task::(_updateState) Task=`24fe1330-f9d6-40c2-a6b8-1dcc3233a87a`::moving from state init -> state preparing >Thread-72::INFO::2013-02-26 22:09:14,760::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-72::INFO::2013-02-26 22:09:14,761::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-72::DEBUG::2013-02-26 22:09:14,761::task::1151::TaskManager.Task::(prepare) Task=`24fe1330-f9d6-40c2-a6b8-1dcc3233a87a`::finished: {} >Thread-72::DEBUG::2013-02-26 22:09:14,761::task::568::TaskManager.Task::(_updateState) Task=`24fe1330-f9d6-40c2-a6b8-1dcc3233a87a`::moving from state preparing -> state finished >Thread-72::DEBUG::2013-02-26 22:09:14,761::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-72::DEBUG::2013-02-26 22:09:14,762::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-72::DEBUG::2013-02-26 22:09:14,762::task::957::TaskManager.Task::(_decref) Task=`24fe1330-f9d6-40c2-a6b8-1dcc3233a87a`::ref 0 aborting False >Thread-78::DEBUG::2013-02-26 22:09:55,403::task::568::TaskManager.Task::(_updateState) Task=`8a6b4216-facf-4bb2-b295-126ed3301fa0`::moving from state init -> state preparing >Thread-78::INFO::2013-02-26 22:09:55,404::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-78::INFO::2013-02-26 22:09:55,404::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-78::DEBUG::2013-02-26 22:09:55,404::task::1151::TaskManager.Task::(prepare) Task=`8a6b4216-facf-4bb2-b295-126ed3301fa0`::finished: {} >Thread-78::DEBUG::2013-02-26 22:09:55,404::task::568::TaskManager.Task::(_updateState) Task=`8a6b4216-facf-4bb2-b295-126ed3301fa0`::moving from state preparing -> state finished >Thread-78::DEBUG::2013-02-26 22:09:55,405::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2013-02-26 22:09:55,405::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2013-02-26 22:09:55,405::task::957::TaskManager.Task::(_decref) Task=`8a6b4216-facf-4bb2-b295-126ed3301fa0`::ref 0 aborting False >Thread-84::DEBUG::2013-02-26 22:10:44,519::task::568::TaskManager.Task::(_updateState) Task=`685219f9-b4b9-4ed9-a40f-9bdbf05dc52a`::moving from state init -> state preparing >Thread-84::INFO::2013-02-26 22:10:46,055::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-84::INFO::2013-02-26 22:10:46,055::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-84::DEBUG::2013-02-26 22:10:46,055::task::1151::TaskManager.Task::(prepare) Task=`685219f9-b4b9-4ed9-a40f-9bdbf05dc52a`::finished: {} >Thread-84::DEBUG::2013-02-26 22:10:46,056::task::568::TaskManager.Task::(_updateState) Task=`685219f9-b4b9-4ed9-a40f-9bdbf05dc52a`::moving from state preparing -> state finished >Thread-84::DEBUG::2013-02-26 22:10:46,056::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84::DEBUG::2013-02-26 22:10:46,056::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2013-02-26 22:10:46,056::task::957::TaskManager.Task::(_decref) Task=`685219f9-b4b9-4ed9-a40f-9bdbf05dc52a`::ref 0 aborting False >Thread-87::DEBUG::2013-02-26 22:11:13,632::task::568::TaskManager.Task::(_updateState) Task=`b643c4c8-bfd6-449b-9bd2-6fdbe0562769`::moving from state init -> state preparing >Thread-87::INFO::2013-02-26 22:11:13,638::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-87::INFO::2013-02-26 22:11:13,638::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-87::DEBUG::2013-02-26 22:11:13,638::task::1151::TaskManager.Task::(prepare) Task=`b643c4c8-bfd6-449b-9bd2-6fdbe0562769`::finished: {} >Thread-87::DEBUG::2013-02-26 22:11:13,638::task::568::TaskManager.Task::(_updateState) Task=`b643c4c8-bfd6-449b-9bd2-6fdbe0562769`::moving from state preparing -> state finished >Thread-87::DEBUG::2013-02-26 22:11:13,639::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-87::DEBUG::2013-02-26 22:11:13,639::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-87::DEBUG::2013-02-26 22:11:13,639::task::957::TaskManager.Task::(_decref) Task=`b643c4c8-bfd6-449b-9bd2-6fdbe0562769`::ref 0 aborting False >MainThread::INFO::2013-02-26 22:36:28,366::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-26 22:36:28,374::task::568::TaskManager.Task::(_updateState) Task=`8ffb8ca4-087e-4f77-a42d-8b23abb38f32`::moving from state init -> state preparing >MainThread::INFO::2013-02-26 22:36:28,375::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-26 22:36:28,375::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-26 22:36:28,389::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,391::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,392::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,394::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,396::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,397::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,398::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,399::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,401::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,402::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,403::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,405::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,406::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,407::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,408::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,410::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,411::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,412::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,413::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,415::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,416::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,417::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,418::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,420::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,421::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,422::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,424::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,425::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,426::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,427::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,429::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,430::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,431::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,432::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,434::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:36:28,527::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-26 22:36:28,528::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-26 22:36:28,528::task::1151::TaskManager.Task::(prepare) Task=`8ffb8ca4-087e-4f77-a42d-8b23abb38f32`::finished: None >MainThread::DEBUG::2013-02-26 22:36:28,528::task::568::TaskManager.Task::(_updateState) Task=`8ffb8ca4-087e-4f77-a42d-8b23abb38f32`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-26 22:36:28,528::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-26 22:36:28,528::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-26 22:36:28,528::task::957::TaskManager.Task::(_decref) Task=`8ffb8ca4-087e-4f77-a42d-8b23abb38f32`::ref 0 aborting False >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <_MainThread(MainThread, started 140024635995904)> >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140024543434496)> >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 140024280495872)> >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 140023842203392)> >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 140024400692992)> >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 140024290985728)> >MainThread::INFO::2013-02-26 22:36:28,529::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 140024411182848)> >MainThread::INFO::2013-02-26 22:36:28,530::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 140024270006016)> >MainThread::INFO::2013-02-26 22:36:28,530::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 140024311965440)> >MainThread::INFO::2013-02-26 22:36:28,530::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140023800243968)> >MainThread::INFO::2013-02-26 22:36:28,530::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-26 22:36:28,530::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 140023372441344)> >MainThread::INFO::2013-02-26 22:36:28,530::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 140023852693248)> >MainThread::INFO::2013-02-26 22:36:28,530::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 140024301475584)> >MainThread::INFO::2013-02-26 22:36:28,531::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 140024322455296)> >MainThread::INFO::2013-02-26 22:42:21,719::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-26 22:42:22,079::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-26 22:42:22,080::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-26 22:42:22,090::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-26 22:42:22,735::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,798::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,800::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,801::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,803::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,805::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,806::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,807::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,809::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,810::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,811::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,813::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,814::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,815::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,817::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,818::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,820::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,821::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,822::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,824::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,827::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,829::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,831::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,833::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,834::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,836::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,838::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,839::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,841::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,843::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,844::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,845::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,846::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,848::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,849::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 22:42:22,970::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-26 22:42:22,971::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 827ebf3a-47ce-461b-aa0d-335ade0838d1 17706 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-26 22:42:23,344::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-26 22:42:23,344::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-26 22:42:23,344::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-26 22:42:23,345::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-26 22:42:23,345::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-26 22:42:23,345::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-26 22:42:23,347::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-26 22:42:24,977::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-26 22:42:24,983::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-26 22:42:24,983::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-26 22:42:25,206::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-26 22:42:25,206::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-26 22:42:25,208::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-26 22:42:25,209::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-26 22:42:25,209::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-26 22:42:25,293::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-26 22:42:25,295::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-26 22:42:25,295::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:25,302::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9|3514f0c542a0003fa|3514f0c542a00040f|3514f0c542a00041f|3514f0c542a00042a|3514f0c542a000432|3514f0c542a000443|3514f0c542a000444|3514f0c542a000449|3514f0c542a00044a|3514f0c542a00044b%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:42:25,562::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:42:25,563::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:25,564::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:25,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9|3514f0c542a0003fa|3514f0c542a00040f|3514f0c542a00041f|3514f0c542a00042a|3514f0c542a000432|3514f0c542a000443|3514f0c542a000444|3514f0c542a000449|3514f0c542a00044a|3514f0c542a00044b%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:42:25,764::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:42:25,765::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:25,766::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000286|3514f0c542a00028f|3514f0c542a000296|3514f0c542a0002c6|3514f0c542a0002c7|3514f0c542a0002fa|3514f0c542a0003e9|3514f0c542a0003fa|3514f0c542a00040f|3514f0c542a00041f|3514f0c542a00042a|3514f0c542a000432|3514f0c542a000443|3514f0c542a000444|3514f0c542a000449|3514f0c542a00044a|3514f0c542a00044b%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:42:26,009::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:42:26,010::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-26 22:42:26,010::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 22:42:26,010::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-26 22:42:26,010::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-26 22:42:26,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:42:26,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:42:26,043::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:26,045::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainThread::WARNING::2013-02-26 22:42:26,784::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-26 22:42:26,784::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-26 22:42:26,807::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-26 22:42:26,808::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-26 22:42:26,808::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-26 22:42:26,809::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-26 22:42:26,813::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-26 22:42:26,817::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-26 22:42:26,817::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-26 22:42:26,838::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-26 22:42:26,838::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-26 22:42:26,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,052::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,054::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,056::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,061::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-26 22:42:27,064::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-26 22:42:29,067::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-26 22:42:33,482::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-26 22:42:33,482::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:33,489::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:33,489::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:33,490::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:33,490::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:33,490::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-26 22:42:33,491::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-26 22:42:33,491::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-26 22:42:59,514::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-26 22:43:01,223::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-26 22:43:01,265::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-26 22:43:01,957::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-02-26 22:43:02,026::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getCapabilities with () {} >Thread-15::DEBUG::2013-02-26 22:43:02,049::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.70.38'}} >Thread-16::DEBUG::2013-02-26 22:43:02,074::BindingXMLRPC::913::vds::(wrapper) client [10.35.70.38]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-02-26 22:43:02,075::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-19::DEBUG::2013-02-26 22:43:08,280::task::568::TaskManager.Task::(_updateState) Task=`740a31c5-a05a-4370-9103-aa6f9636887d`::moving from state init -> state preparing >Thread-19::INFO::2013-02-26 22:43:08,280::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::INFO::2013-02-26 22:43:08,281::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-19::DEBUG::2013-02-26 22:43:08,281::task::1151::TaskManager.Task::(prepare) Task=`740a31c5-a05a-4370-9103-aa6f9636887d`::finished: {} >Thread-19::DEBUG::2013-02-26 22:43:08,281::task::568::TaskManager.Task::(_updateState) Task=`740a31c5-a05a-4370-9103-aa6f9636887d`::moving from state preparing -> state finished >Thread-19::DEBUG::2013-02-26 22:43:08,281::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2013-02-26 22:43:08,281::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2013-02-26 22:43:08,281::task::957::TaskManager.Task::(_decref) Task=`740a31c5-a05a-4370-9103-aa6f9636887d`::ref 0 aborting False >Thread-25::DEBUG::2013-02-26 22:43:23,560::task::568::TaskManager.Task::(_updateState) Task=`bb5cdaf4-a216-4d27-8b77-df6eba1a90a9`::moving from state init -> state preparing >Thread-25::INFO::2013-02-26 22:43:23,560::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-25::INFO::2013-02-26 22:43:23,561::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-25::DEBUG::2013-02-26 22:43:23,561::task::1151::TaskManager.Task::(prepare) Task=`bb5cdaf4-a216-4d27-8b77-df6eba1a90a9`::finished: {} >Thread-25::DEBUG::2013-02-26 22:43:23,561::task::568::TaskManager.Task::(_updateState) Task=`bb5cdaf4-a216-4d27-8b77-df6eba1a90a9`::moving from state preparing -> state finished >Thread-25::DEBUG::2013-02-26 22:43:23,561::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-25::DEBUG::2013-02-26 22:43:23,561::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-25::DEBUG::2013-02-26 22:43:23,561::task::957::TaskManager.Task::(_decref) Task=`bb5cdaf4-a216-4d27-8b77-df6eba1a90a9`::ref 0 aborting False >Thread-31::DEBUG::2013-02-26 22:43:38,785::task::568::TaskManager.Task::(_updateState) Task=`88c7c643-47e0-42c5-ad80-5950e1dae57b`::moving from state init -> state preparing >Thread-31::INFO::2013-02-26 22:43:38,786::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-31::INFO::2013-02-26 22:43:38,786::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-31::DEBUG::2013-02-26 22:43:38,786::task::1151::TaskManager.Task::(prepare) Task=`88c7c643-47e0-42c5-ad80-5950e1dae57b`::finished: {} >Thread-31::DEBUG::2013-02-26 22:43:38,786::task::568::TaskManager.Task::(_updateState) Task=`88c7c643-47e0-42c5-ad80-5950e1dae57b`::moving from state preparing -> state finished >Thread-31::DEBUG::2013-02-26 22:43:38,787::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-31::DEBUG::2013-02-26 22:43:38,787::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-31::DEBUG::2013-02-26 22:43:38,787::task::957::TaskManager.Task::(_decref) Task=`88c7c643-47e0-42c5-ad80-5950e1dae57b`::ref 0 aborting False >Thread-37::DEBUG::2013-02-26 22:43:54,014::task::568::TaskManager.Task::(_updateState) Task=`249b7fa2-38a4-4e69-8b53-f996953bba97`::moving from state init -> state preparing >Thread-37::INFO::2013-02-26 22:43:54,014::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-37::INFO::2013-02-26 22:43:54,014::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-37::DEBUG::2013-02-26 22:43:54,014::task::1151::TaskManager.Task::(prepare) Task=`249b7fa2-38a4-4e69-8b53-f996953bba97`::finished: {} >Thread-37::DEBUG::2013-02-26 22:43:54,015::task::568::TaskManager.Task::(_updateState) Task=`249b7fa2-38a4-4e69-8b53-f996953bba97`::moving from state preparing -> state finished >Thread-37::DEBUG::2013-02-26 22:43:54,015::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2013-02-26 22:43:54,015::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2013-02-26 22:43:54,015::task::957::TaskManager.Task::(_decref) Task=`249b7fa2-38a4-4e69-8b53-f996953bba97`::ref 0 aborting False >Thread-43::DEBUG::2013-02-26 22:44:09,236::task::568::TaskManager.Task::(_updateState) Task=`aa209fc6-88c9-4841-8f11-69c769a9e5da`::moving from state init -> state preparing >Thread-43::INFO::2013-02-26 22:44:09,236::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-43::INFO::2013-02-26 22:44:09,237::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-43::DEBUG::2013-02-26 22:44:09,237::task::1151::TaskManager.Task::(prepare) Task=`aa209fc6-88c9-4841-8f11-69c769a9e5da`::finished: {} >Thread-43::DEBUG::2013-02-26 22:44:09,237::task::568::TaskManager.Task::(_updateState) Task=`aa209fc6-88c9-4841-8f11-69c769a9e5da`::moving from state preparing -> state finished >Thread-43::DEBUG::2013-02-26 22:44:09,237::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-43::DEBUG::2013-02-26 22:44:09,237::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2013-02-26 22:44:09,237::task::957::TaskManager.Task::(_decref) Task=`aa209fc6-88c9-4841-8f11-69c769a9e5da`::ref 0 aborting False >Thread-49::DEBUG::2013-02-26 22:44:24,537::task::568::TaskManager.Task::(_updateState) Task=`d52353fa-6c38-49a3-b6a3-c10fde52b213`::moving from state init -> state preparing >Thread-49::INFO::2013-02-26 22:44:24,638::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-49::INFO::2013-02-26 22:44:24,640::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-49::DEBUG::2013-02-26 22:44:24,643::task::1151::TaskManager.Task::(prepare) Task=`d52353fa-6c38-49a3-b6a3-c10fde52b213`::finished: {} >Thread-49::DEBUG::2013-02-26 22:44:24,645::task::568::TaskManager.Task::(_updateState) Task=`d52353fa-6c38-49a3-b6a3-c10fde52b213`::moving from state preparing -> state finished >Thread-49::DEBUG::2013-02-26 22:44:24,648::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49::DEBUG::2013-02-26 22:44:24,650::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2013-02-26 22:44:24,653::task::957::TaskManager.Task::(_decref) Task=`d52353fa-6c38-49a3-b6a3-c10fde52b213`::ref 0 aborting False >Thread-55::DEBUG::2013-02-26 22:44:40,004::task::568::TaskManager.Task::(_updateState) Task=`f3415778-9d02-43f5-89a7-596b6dfd9088`::moving from state init -> state preparing >Thread-55::INFO::2013-02-26 22:44:40,004::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55::INFO::2013-02-26 22:44:40,005::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-55::DEBUG::2013-02-26 22:44:40,005::task::1151::TaskManager.Task::(prepare) Task=`f3415778-9d02-43f5-89a7-596b6dfd9088`::finished: {} >Thread-55::DEBUG::2013-02-26 22:44:40,005::task::568::TaskManager.Task::(_updateState) Task=`f3415778-9d02-43f5-89a7-596b6dfd9088`::moving from state preparing -> state finished >Thread-55::DEBUG::2013-02-26 22:44:40,005::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55::DEBUG::2013-02-26 22:44:40,005::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55::DEBUG::2013-02-26 22:44:40,005::task::957::TaskManager.Task::(_decref) Task=`f3415778-9d02-43f5-89a7-596b6dfd9088`::ref 0 aborting False >Thread-61::DEBUG::2013-02-26 22:44:55,328::task::568::TaskManager.Task::(_updateState) Task=`2c5ff5aa-125d-43fe-847e-6c115ed86407`::moving from state init -> state preparing >Thread-61::INFO::2013-02-26 22:44:55,328::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-61::INFO::2013-02-26 22:44:55,328::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-61::DEBUG::2013-02-26 22:44:55,329::task::1151::TaskManager.Task::(prepare) Task=`2c5ff5aa-125d-43fe-847e-6c115ed86407`::finished: {} >Thread-61::DEBUG::2013-02-26 22:44:55,329::task::568::TaskManager.Task::(_updateState) Task=`2c5ff5aa-125d-43fe-847e-6c115ed86407`::moving from state preparing -> state finished >Thread-61::DEBUG::2013-02-26 22:44:55,329::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2013-02-26 22:44:55,329::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2013-02-26 22:44:55,329::task::957::TaskManager.Task::(_decref) Task=`2c5ff5aa-125d-43fe-847e-6c115ed86407`::ref 0 aborting False >Thread-67::DEBUG::2013-02-26 22:45:42,134::task::568::TaskManager.Task::(_updateState) Task=`3c405954-0589-4e87-8f0a-1eb2daf346f0`::moving from state init -> state preparing >Thread-67::INFO::2013-02-26 22:45:44,122::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-67::INFO::2013-02-26 22:45:44,122::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-67::DEBUG::2013-02-26 22:45:44,122::task::1151::TaskManager.Task::(prepare) Task=`3c405954-0589-4e87-8f0a-1eb2daf346f0`::finished: {} >Thread-67::DEBUG::2013-02-26 22:45:44,123::task::568::TaskManager.Task::(_updateState) Task=`3c405954-0589-4e87-8f0a-1eb2daf346f0`::moving from state preparing -> state finished >Thread-67::DEBUG::2013-02-26 22:45:44,123::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2013-02-26 22:45:44,123::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2013-02-26 22:45:44,123::task::957::TaskManager.Task::(_decref) Task=`3c405954-0589-4e87-8f0a-1eb2daf346f0`::ref 0 aborting False >Thread-73::DEBUG::2013-02-26 22:46:31,743::task::568::TaskManager.Task::(_updateState) Task=`82525273-b644-419b-92ac-3198d49abb9f`::moving from state init -> state preparing >Thread-73::INFO::2013-02-26 22:46:31,749::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2013-02-26 22:46:31,749::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-73::DEBUG::2013-02-26 22:46:31,749::task::1151::TaskManager.Task::(prepare) Task=`82525273-b644-419b-92ac-3198d49abb9f`::finished: {} >Thread-73::DEBUG::2013-02-26 22:46:31,749::task::568::TaskManager.Task::(_updateState) Task=`82525273-b644-419b-92ac-3198d49abb9f`::moving from state preparing -> state finished >Thread-73::DEBUG::2013-02-26 22:46:31,750::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2013-02-26 22:46:31,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2013-02-26 22:46:31,750::task::957::TaskManager.Task::(_decref) Task=`82525273-b644-419b-92ac-3198d49abb9f`::ref 0 aborting False >Thread-79::DEBUG::2013-02-26 22:46:46,975::task::568::TaskManager.Task::(_updateState) Task=`9f99cbdb-c06e-4db8-ba06-01bbb237c79c`::moving from state init -> state preparing >Thread-79::INFO::2013-02-26 22:46:46,975::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-79::INFO::2013-02-26 22:46:46,975::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-79::DEBUG::2013-02-26 22:46:46,976::task::1151::TaskManager.Task::(prepare) Task=`9f99cbdb-c06e-4db8-ba06-01bbb237c79c`::finished: {} >Thread-79::DEBUG::2013-02-26 22:46:46,976::task::568::TaskManager.Task::(_updateState) Task=`9f99cbdb-c06e-4db8-ba06-01bbb237c79c`::moving from state preparing -> state finished >Thread-79::DEBUG::2013-02-26 22:46:46,976::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-79::DEBUG::2013-02-26 22:46:46,976::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-79::DEBUG::2013-02-26 22:46:46,976::task::957::TaskManager.Task::(_decref) Task=`9f99cbdb-c06e-4db8-ba06-01bbb237c79c`::ref 0 aborting False >Thread-85::DEBUG::2013-02-26 22:47:36,498::task::568::TaskManager.Task::(_updateState) Task=`c49638b1-0fe1-4c2e-a42e-214a2bf785a2`::moving from state init -> state preparing >Thread-85::INFO::2013-02-26 22:47:48,740::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-85::INFO::2013-02-26 22:47:48,740::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-85::DEBUG::2013-02-26 22:47:48,740::task::1151::TaskManager.Task::(prepare) Task=`c49638b1-0fe1-4c2e-a42e-214a2bf785a2`::finished: {} >Thread-85::DEBUG::2013-02-26 22:47:48,741::task::568::TaskManager.Task::(_updateState) Task=`c49638b1-0fe1-4c2e-a42e-214a2bf785a2`::moving from state preparing -> state finished >Thread-85::DEBUG::2013-02-26 22:47:48,741::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-85::DEBUG::2013-02-26 22:47:48,741::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-85::DEBUG::2013-02-26 22:47:48,741::task::957::TaskManager.Task::(_decref) Task=`c49638b1-0fe1-4c2e-a42e-214a2bf785a2`::ref 0 aborting False >Thread-91::DEBUG::2013-02-26 22:48:22,961::task::568::TaskManager.Task::(_updateState) Task=`4420ce8a-7330-4719-b3a7-511495dff264`::moving from state init -> state preparing >Thread-91::INFO::2013-02-26 22:48:22,962::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2013-02-26 22:48:22,962::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-91::DEBUG::2013-02-26 22:48:22,962::task::1151::TaskManager.Task::(prepare) Task=`4420ce8a-7330-4719-b3a7-511495dff264`::finished: {} >Thread-91::DEBUG::2013-02-26 22:48:22,962::task::568::TaskManager.Task::(_updateState) Task=`4420ce8a-7330-4719-b3a7-511495dff264`::moving from state preparing -> state finished >Thread-91::DEBUG::2013-02-26 22:48:22,962::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2013-02-26 22:48:22,962::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2013-02-26 22:48:22,963::task::957::TaskManager.Task::(_decref) Task=`4420ce8a-7330-4719-b3a7-511495dff264`::ref 0 aborting False >Thread-95::DEBUG::2013-02-26 22:49:09,945::task::568::TaskManager.Task::(_updateState) Task=`fd13447c-fd07-4cb2-b998-e2a972e90174`::moving from state init -> state preparing >Thread-95::INFO::2013-02-26 22:49:11,606::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-95::INFO::2013-02-26 22:49:11,606::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-95::DEBUG::2013-02-26 22:49:11,606::task::1151::TaskManager.Task::(prepare) Task=`fd13447c-fd07-4cb2-b998-e2a972e90174`::finished: {} >Thread-95::DEBUG::2013-02-26 22:49:11,607::task::568::TaskManager.Task::(_updateState) Task=`fd13447c-fd07-4cb2-b998-e2a972e90174`::moving from state preparing -> state finished >Thread-95::DEBUG::2013-02-26 22:49:11,607::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-95::DEBUG::2013-02-26 22:49:11,608::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-95::DEBUG::2013-02-26 22:49:11,608::task::957::TaskManager.Task::(_decref) Task=`fd13447c-fd07-4cb2-b998-e2a972e90174`::ref 0 aborting False >Thread-97::DEBUG::2013-02-26 22:58:50,548::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-97::DEBUG::2013-02-26 22:58:50,598::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.70.38'}} >Thread-98::DEBUG::2013-02-26 23:06:07,345::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-98::DEBUG::2013-02-26 23:06:07,520::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.160.55'}} >Thread-99::DEBUG::2013-02-26 23:10:19,021::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-99::DEBUG::2013-02-26 23:10:25,205::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.160.55'}} >MainThread::INFO::2013-02-26 23:11:03,017::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-26 23:11:03,025::task::568::TaskManager.Task::(_updateState) Task=`0bc0ff18-51e3-493e-b881-cd9bfc02d35e`::moving from state init -> state preparing >MainThread::INFO::2013-02-26 23:11:03,025::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-26 23:11:03,026::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-26 23:11:03,038::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,039::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,041::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,042::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,043::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,044::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,046::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,047::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,048::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,050::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,051::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,052::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,053::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,055::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,056::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,057::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,059::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,060::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,061::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,062::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,064::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,065::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,066::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,068::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,069::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,070::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,071::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,073::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,074::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,075::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,076::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,078::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,079::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,080::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,082::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-26 23:11:03,205::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-26 23:11:03,205::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-26 23:11:03,205::task::1151::TaskManager.Task::(prepare) Task=`0bc0ff18-51e3-493e-b881-cd9bfc02d35e`::finished: None >MainThread::DEBUG::2013-02-26 23:11:03,205::task::568::TaskManager.Task::(_updateState) Task=`0bc0ff18-51e3-493e-b881-cd9bfc02d35e`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-26 23:11:03,206::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-26 23:11:03,206::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-26 23:11:03,206::task::957::TaskManager.Task::(_decref) Task=`0bc0ff18-51e3-493e-b881-cd9bfc02d35e`::ref 0 aborting False >MainThread::INFO::2013-02-26 23:11:03,206::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-02-26 23:11:03,207::vdsm::99::vds::(run) <_MainThread(MainThread, started 139818252883712)> >MainThread::INFO::2013-02-26 23:11:03,207::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 139818160322304)> >MainThread::INFO::2013-02-26 23:11:03,207::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 139817627154176)> >MainThread::INFO::2013-02-26 23:11:03,207::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 139817616664320)> >MainThread::INFO::2013-02-26 23:11:03,207::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 139817595684608)> >MainThread::INFO::2013-02-26 23:11:03,208::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-26 23:11:03,208::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 139817125922560)> >MainThread::INFO::2013-02-26 23:11:03,208::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 139818027689728)> >MainThread::INFO::2013-02-26 23:11:03,208::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 139817985730304)> >MainThread::INFO::2013-02-26 23:11:03,209::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 139817996220160)> >MainThread::INFO::2013-02-26 23:11:03,209::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 139817606174464)> >MainThread::INFO::2013-02-26 23:11:03,209::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139817146902272)> >MainThread::INFO::2013-02-26 23:11:03,209::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 139817975240448)> >MainThread::INFO::2013-02-26 23:11:03,209::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 139818017199872)> >MainThread::INFO::2013-02-26 23:11:03,210::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 139818006710016)> >MainThread::INFO::2013-02-28 21:56:14,290::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-28 21:56:15,809::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-28 21:56:15,809::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-28 21:56:15,825::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-28 21:56:16,604::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,606::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,607::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,608::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,610::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,611::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,612::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,614::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,616::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,618::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,619::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,621::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,623::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,625::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,627::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,629::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,631::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,632::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,634::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,635::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,637::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,638::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,640::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,642::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,643::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,645::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,646::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,648::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,650::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,652::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,654::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,656::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,658::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,659::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,660::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 21:56:16,778::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-28 21:56:16,779::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 8a84a8cd-c086-4ec6-aac9-f80a79791bb7 9446 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-28 21:56:17,066::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-28 21:56:17,066::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-28 21:56:17,066::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-28 21:56:17,066::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-28 21:56:17,067::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-28 21:56:17,067::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-28 21:56:17,069::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-28 21:56:18,786::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-28 21:56:18,795::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-28 21:56:18,796::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-28 21:56:18,992::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-28 21:56:18,992::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-28 21:56:18,995::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-28 21:56:18,995::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-28 21:56:18,995::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-28 21:56:19,020::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-28 21:56:19,022::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-28 21:56:19,023::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:19,028::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-28 21:56:19,047::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-28 21:56:19,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-28 21:56:19,091::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-28 21:56:19,091::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-28 21:56:19,092::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-28 21:56:19,096::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-28 21:56:19,097::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-28 21:56:19,101::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-28 21:56:19,101::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-28 21:56:19,121::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-28 21:56:19,122::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-28 21:56:19,149::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 21:56:19,235::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 21:56:19,235::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:19,236::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:19,236::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-28 21:56:19,428::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 21:56:19,429::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:19,537::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-28 21:56:19,720::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 21:56:19,720::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-28 21:56:19,720::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 21:56:19,721::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-28 21:56:19,721::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 21:56:19,721::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-28 21:56:19,745::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 21:56:19,745::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:19,747::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,750::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,753::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,756::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,761::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 21:56:20,763::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-28 21:56:22,766::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-28 21:56:25,123::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 21:56:25,123::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:25,130::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:25,130::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:25,131::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:25,131::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:25,131::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 21:56:25,132::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-28 21:56:25,132::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-28 21:57:17,709::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-28 21:57:18,193::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-28 21:57:18,239::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-28 21:57:18,559::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-02-28 21:57:18,629::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getCapabilities with () {} >Thread-15::DEBUG::2013-02-28 21:57:18,651::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.50'}} >Thread-16::DEBUG::2013-02-28 21:57:18,691::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-02-28 21:57:18,692::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-18::DEBUG::2013-02-28 21:57:21,891::task::568::TaskManager.Task::(_updateState) Task=`59cfe03f-4eb2-4df9-af7b-ddfd62248642`::moving from state init -> state preparing >Thread-18::INFO::2013-02-28 21:57:21,892::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::INFO::2013-02-28 21:57:21,892::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-18::DEBUG::2013-02-28 21:57:21,892::task::1151::TaskManager.Task::(prepare) Task=`59cfe03f-4eb2-4df9-af7b-ddfd62248642`::finished: {} >Thread-18::DEBUG::2013-02-28 21:57:21,892::task::568::TaskManager.Task::(_updateState) Task=`59cfe03f-4eb2-4df9-af7b-ddfd62248642`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-02-28 21:57:21,893::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-02-28 21:57:21,893::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-02-28 21:57:21,893::task::957::TaskManager.Task::(_decref) Task=`59cfe03f-4eb2-4df9-af7b-ddfd62248642`::ref 0 aborting False >Thread-24::DEBUG::2013-02-28 21:57:37,205::task::568::TaskManager.Task::(_updateState) Task=`1f5254a5-0567-447a-aa58-61e659fa974e`::moving from state init -> state preparing >Thread-24::INFO::2013-02-28 21:57:37,295::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2013-02-28 21:57:37,295::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2013-02-28 21:57:37,295::task::1151::TaskManager.Task::(prepare) Task=`1f5254a5-0567-447a-aa58-61e659fa974e`::finished: {} >Thread-24::DEBUG::2013-02-28 21:57:37,296::task::568::TaskManager.Task::(_updateState) Task=`1f5254a5-0567-447a-aa58-61e659fa974e`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-02-28 21:57:37,296::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-02-28 21:57:37,296::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-02-28 21:57:37,296::task::957::TaskManager.Task::(_decref) Task=`1f5254a5-0567-447a-aa58-61e659fa974e`::ref 0 aborting False >Thread-30::DEBUG::2013-02-28 21:57:52,584::task::568::TaskManager.Task::(_updateState) Task=`4502d192-d4c8-4c09-9865-567ea165a03b`::moving from state init -> state preparing >Thread-30::INFO::2013-02-28 21:57:52,585::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2013-02-28 21:57:52,585::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-30::DEBUG::2013-02-28 21:57:52,585::task::1151::TaskManager.Task::(prepare) Task=`4502d192-d4c8-4c09-9865-567ea165a03b`::finished: {} >Thread-30::DEBUG::2013-02-28 21:57:52,585::task::568::TaskManager.Task::(_updateState) Task=`4502d192-d4c8-4c09-9865-567ea165a03b`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-02-28 21:57:52,586::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-02-28 21:57:52,586::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-02-28 21:57:52,586::task::957::TaskManager.Task::(_decref) Task=`4502d192-d4c8-4c09-9865-567ea165a03b`::ref 0 aborting False >Thread-35::DEBUG::2013-02-28 21:58:02,307::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-35::DEBUG::2013-02-28 21:58:02,307::task::568::TaskManager.Task::(_updateState) Task=`86ad3e91-384b-4c78-9c8a-700e288a09e1`::moving from state init -> state preparing >Thread-35::INFO::2013-02-28 21:58:02,308::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-35::DEBUG::2013-02-28 21:58:02,308::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-35::DEBUG::2013-02-28 21:58:02,336::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2013-02-28 21:58:02,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-35::DEBUG::2013-02-28 21:58:02,354::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2013-02-28 21:58:02,355::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-35::DEBUG::2013-02-28 21:58:02,370::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::INFO::2013-02-28 21:58:02,371::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-35::DEBUG::2013-02-28 21:58:02,372::task::1151::TaskManager.Task::(prepare) Task=`86ad3e91-384b-4c78-9c8a-700e288a09e1`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-35::DEBUG::2013-02-28 21:58:02,372::task::568::TaskManager.Task::(_updateState) Task=`86ad3e91-384b-4c78-9c8a-700e288a09e1`::moving from state preparing -> state finished >Thread-35::DEBUG::2013-02-28 21:58:02,372::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-35::DEBUG::2013-02-28 21:58:02,372::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-35::DEBUG::2013-02-28 21:58:02,373::task::957::TaskManager.Task::(_decref) Task=`86ad3e91-384b-4c78-9c8a-700e288a09e1`::ref 0 aborting False >Thread-36::DEBUG::2013-02-28 21:58:02,408::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-36::DEBUG::2013-02-28 21:58:02,408::task::568::TaskManager.Task::(_updateState) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::moving from state init -> state preparing >Thread-36::INFO::2013-02-28 21:58:02,409::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', poolName='storage_sanity_31_dc', masterDom='b7765268-5d28-443d-be93-8dd49837a9cc', domList=['b7765268-5d28-443d-be93-8dd49837a9cc'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-36::DEBUG::2013-02-28 21:58:02,409::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-36::DEBUG::2013-02-28 21:58:02,409::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-36::DEBUG::2013-02-28 21:58:02,410::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-36::DEBUG::2013-02-28 21:58:02,410::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-36::DEBUG::2013-02-28 21:58:02,410::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:02,436::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:02,437::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:02,439::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:03,442::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:04,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:04,465::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:05,468::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:05,471::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:05,473::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-36::DEBUG::2013-02-28 21:58:06,475::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-38::DEBUG::2013-02-28 21:58:07,860::task::568::TaskManager.Task::(_updateState) Task=`db216f04-ea73-4ae9-8d5f-056b1f6e965c`::moving from state init -> state preparing >Thread-38::INFO::2013-02-28 21:58:07,861::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-38::INFO::2013-02-28 21:58:07,861::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-38::DEBUG::2013-02-28 21:58:07,861::task::1151::TaskManager.Task::(prepare) Task=`db216f04-ea73-4ae9-8d5f-056b1f6e965c`::finished: {} >Thread-38::DEBUG::2013-02-28 21:58:07,861::task::568::TaskManager.Task::(_updateState) Task=`db216f04-ea73-4ae9-8d5f-056b1f6e965c`::moving from state preparing -> state finished >Thread-38::DEBUG::2013-02-28 21:58:07,861::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-38::DEBUG::2013-02-28 21:58:07,862::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2013-02-28 21:58:07,862::task::957::TaskManager.Task::(_decref) Task=`db216f04-ea73-4ae9-8d5f-056b1f6e965c`::ref 0 aborting False >Thread-36::DEBUG::2013-02-28 21:58:08,478::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:10,831::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:10,831::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,837::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,837::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,837::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,837::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,838::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,838::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-36::DEBUG::2013-02-28 21:58:10,838::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:10,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:11,649::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:11,650::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:11,651::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-36::DEBUG::2013-02-28 21:58:11,651::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/metadata' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:13,138::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:13,138::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,138::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,139::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:13,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000326147 s, 6.3 MB/s\n'; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:13,145::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000326147 s, 6.3 MB/s'], size: 2048 >Thread-36::DEBUG::2013-02-28 21:58:13,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-36::WARNING::2013-02-28 21:58:13,146::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-36::DEBUG::2013-02-28 21:58:13,146::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-36::DEBUG::2013-02-28 21:58:13,146::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,147::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,147::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,147::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,147::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,148::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:13,382::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:13,383::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:13,383::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', '_SHA_CKSUM=9c53d6d172a1260439a355dc75772d0786263cfb', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data'] >Thread-36::DEBUG::2013-02-28 21:58:13,384::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/ids' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:14,756::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:14,757::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:14,757::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:14,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/leases' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:16,254::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:16,254::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:16,254::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:16,255::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/inbox b7765268-5d28-443d-be93-8dd49837a9cc/outbox b7765268-5d28-443d-be93-8dd49837a9cc/master' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:17,790::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:17,790::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:17,791::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:17,791::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:17,792::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:18,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:18,045::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,046::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'b7765268-5d28-443d-be93-8dd49837a9cc_imageNS' >Thread-36::DEBUG::2013-02-28 21:58:18,046::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'b7765268-5d28-443d-be93-8dd49837a9cc_volumeNS' >Thread-36::DEBUG::2013-02-28 21:58:18,046::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'b7765268-5d28-443d-be93-8dd49837a9cc_lvmActivationNS' >Thread-36::INFO::2013-02-28 21:58:18,047::blockSD::818::Storage.StorageDomain::(validate) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc >Thread-36::DEBUG::2013-02-28 21:58:18,047::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:18,291::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:18,291::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,292::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,292::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,293::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,293::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,294::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:18,538::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:18,540::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,540::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', '_SHA_CKSUM=9c53d6d172a1260439a355dc75772d0786263cfb', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data'] >Thread-36::DEBUG::2013-02-28 21:58:18,543::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`ad8453d0-538d-470a-8323-b2dba287f193`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-36::DEBUG::2013-02-28 21:58:18,543::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' for lock type 'exclusive' >Thread-36::DEBUG::2013-02-28 21:58:18,543::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free. Now locking as 'exclusive' (1 active user) >Thread-36::DEBUG::2013-02-28 21:58:18,544::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`ad8453d0-538d-470a-8323-b2dba287f193`::Granted request >Thread-36::DEBUG::2013-02-28 21:58:18,544::task::794::TaskManager.Task::(resourceAcquired) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::_resourcesAcquired: Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72 (exclusive) >Thread-36::DEBUG::2013-02-28 21:58:18,545::task::957::TaskManager.Task::(_decref) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::ref 1 aborting False >Thread-36::DEBUG::2013-02-28 21:58:18,545::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`91d7e582-543d-44ff-b1cb-1680758761cb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-36::DEBUG::2013-02-28 21:58:18,546::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'exclusive' >Thread-36::DEBUG::2013-02-28 21:58:18,546::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'exclusive' (1 active user) >Thread-36::DEBUG::2013-02-28 21:58:18,546::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`91d7e582-543d-44ff-b1cb-1680758761cb`::Granted request >Thread-36::DEBUG::2013-02-28 21:58:18,547::task::794::TaskManager.Task::(resourceAcquired) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (exclusive) >Thread-36::DEBUG::2013-02-28 21:58:18,547::task::957::TaskManager.Task::(_decref) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::ref 1 aborting False >Thread-36::INFO::2013-02-28 21:58:18,548::sp::543::Storage.StoragePool::(create) spUUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72 poolName=storage_sanity_31_dc master_sd=b7765268-5d28-443d-be93-8dd49837a9cc domList=['b7765268-5d28-443d-be93-8dd49837a9cc'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-36::INFO::2013-02-28 21:58:18,548::blockSD::818::Storage.StorageDomain::(validate) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc >Thread-36::DEBUG::2013-02-28 21:58:18,549::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:18,796::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:18,797::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,797::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,798::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,798::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,798::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:18,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:18,998::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:19,000::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,000::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', '_SHA_CKSUM=9c53d6d172a1260439a355dc75772d0786263cfb', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data'] >Thread-36::DEBUG::2013-02-28 21:58:19,001::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,002::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,002::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,002::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,003::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:19,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:19,195::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,196::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', '_SHA_CKSUM=9c53d6d172a1260439a355dc75772d0786263cfb', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data'] >Thread-36::DEBUG::2013-02-28 21:58:19,217::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-36::DEBUG::2013-02-28 21:58:19,217::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-36::DEBUG::2013-02-28 21:58:19,218::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=master_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'ROLE=Regular', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', '_SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f'] >Thread-36::DEBUG::2013-02-28 21:58:19,218::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,218::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,218::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,219::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,219::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,220::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:19,410::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:19,412::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,413::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_LEASETIMESEC=60, MDT_IOOPTIMEOUTSEC=10, MDT__SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f removing=MDT_LEASETIMESEC=5, MDT__SHA_CKSUM=9c53d6d172a1260439a355dc75772d0786263cfb, MDT_IOOPTIMEOUTSEC=1 >Thread-36::DEBUG::2013-02-28 21:58:19,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_LEASETIMESEC=5 --deltag MDT__SHA_CKSUM=9c53d6d172a1260439a355dc75772d0786263cfb --deltag MDT_IOOPTIMEOUTSEC=1 --addtag MDT_LEASETIMESEC=60 --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT__SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:19,899::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:19,899::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,900::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:19,900::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-36::INFO::2013-02-28 21:58:19,901::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 250) >Thread-44::DEBUG::2013-02-28 21:58:23,132::task::568::TaskManager.Task::(_updateState) Task=`6ac7510f-58d0-4e28-a74f-7fd479ff7b1a`::moving from state init -> state preparing >Thread-44::INFO::2013-02-28 21:58:23,132::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-44::INFO::2013-02-28 21:58:23,132::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-44::DEBUG::2013-02-28 21:58:23,132::task::1151::TaskManager.Task::(prepare) Task=`6ac7510f-58d0-4e28-a74f-7fd479ff7b1a`::finished: {} >Thread-44::DEBUG::2013-02-28 21:58:23,133::task::568::TaskManager.Task::(_updateState) Task=`6ac7510f-58d0-4e28-a74f-7fd479ff7b1a`::moving from state preparing -> state finished >Thread-44::DEBUG::2013-02-28 21:58:23,133::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2013-02-28 21:58:23,133::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2013-02-28 21:58:23,133::task::957::TaskManager.Task::(_decref) Task=`6ac7510f-58d0-4e28-a74f-7fd479ff7b1a`::ref 0 aborting False >Thread-36::DEBUG::2013-02-28 21:58:59,907::clusterlock::190::SANLock::(acquireHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc successfully acquired (id: 250) >Thread-36::DEBUG::2013-02-28 21:58:59,909::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,909::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,909::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,909::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,910::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-36::DEBUG::2013-02-28 21:58:59,910::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-36::DEBUG::2013-02-28 21:58:59,916::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000417641 s, 4.9 MB/s\n'; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:58:59,916::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000417641 s, 4.9 MB/s'], size: 2048 >Thread-36::DEBUG::2013-02-28 21:58:59,917::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-36::WARNING::2013-02-28 21:58:59,917::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-36::DEBUG::2013-02-28 21:58:59,917::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-36::DEBUG::2013-02-28 21:58:59,918::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,918::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,919::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,919::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,919::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:58:59,920::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:59:00,117::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:59:00,118::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,119::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f'] >Thread-36::INFO::2013-02-28 21:59:00,119::clusterlock::223::SANLock::(acquire) Acquiring cluster lock for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 250) >Thread-36::DEBUG::2013-02-28 21:59:00,128::clusterlock::247::SANLock::(acquire) Cluster lock for domain b7765268-5d28-443d-be93-8dd49837a9cc successfully acquired (id: 250) >Thread-36::INFO::2013-02-28 21:59:00,129::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 8afb550a-e69f-41d1-bcbe-7813fdda3b72 on sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc >Thread-36::DEBUG::2013-02-28 21:59:00,129::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-36::DEBUG::2013-02-28 21:59:00,129::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-36::DEBUG::2013-02-28 21:59:00,129::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,130::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,130::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,130::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,130::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,131::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:59:00,350::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:59:00,352::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,352::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f'] >Thread-36::DEBUG::2013-02-28 21:59:00,353::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-36::DEBUG::2013-02-28 21:59:00,353::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-36::DEBUG::2013-02-28 21:59:00,353::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-36::DEBUG::2013-02-28 21:59:00,353::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-36::DEBUG::2013-02-28 21:59:00,353::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=master_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'ROLE=Master', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', '_SHA_CKSUM=9e740e10ec748cc1aff5d65883d94994d45b7dce'] >Thread-36::DEBUG::2013-02-28 21:59:00,354::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,354::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,354::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,354::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,355::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,355::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:59:00,595::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:59:00,596::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:00,597::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_ROLE=Master, MDT_POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72, MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT_POOL_DESCRIPTION=storage_sanity_31_dc, MDT_MASTER_VERSION=1, MDT__SHA_CKSUM=9e740e10ec748cc1aff5d65883d94994d45b7dce, MDT_POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active removing=MDT_POOL_UUID=, MDT__SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f, MDT_ROLE=Regular >Thread-36::DEBUG::2013-02-28 21:59:00,598::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=dffd8c73069fc7f8968ecd50263a56254ad0873f --deltag MDT_POOL_UUID= --deltag MDT_ROLE=Regular --addtag MDT__SHA_CKSUM=9e740e10ec748cc1aff5d65883d94994d45b7dce --addtag MDT_POOL_DESCRIPTION=storage_sanity_31_dc --addtag MDT_POOL_SPM_ID=-1 --addtag MDT_MASTER_VERSION=1 --addtag MDT_ROLE=Master --addtag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72 --addtag MDT_POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-50::DEBUG::2013-02-28 21:59:02,490::task::568::TaskManager.Task::(_updateState) Task=`dd4edad2-ebee-4f9d-8dfe-d896069c73bf`::moving from state init -> state preparing >Thread-50::INFO::2013-02-28 21:59:03,442::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-50::INFO::2013-02-28 21:59:03,442::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-50::DEBUG::2013-02-28 21:59:03,442::task::1151::TaskManager.Task::(prepare) Task=`dd4edad2-ebee-4f9d-8dfe-d896069c73bf`::finished: {} >Thread-50::DEBUG::2013-02-28 21:59:03,443::task::568::TaskManager.Task::(_updateState) Task=`dd4edad2-ebee-4f9d-8dfe-d896069c73bf`::moving from state preparing -> state finished >Thread-50::DEBUG::2013-02-28 21:59:03,443::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-50::DEBUG::2013-02-28 21:59:03,443::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-50::DEBUG::2013-02-28 21:59:03,443::task::957::TaskManager.Task::(_decref) Task=`dd4edad2-ebee-4f9d-8dfe-d896069c73bf`::ref 0 aborting False >Thread-36::DEBUG::2013-02-28 21:59:03,730::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:59:03,730::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,730::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,730::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-36::DEBUG::2013-02-28 21:59:03,731::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain b7765268-5d28-443d-be93-8dd49837a9cc verified, version 1 >Thread-36::DEBUG::2013-02-28 21:59:03,731::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-36::DEBUG::2013-02-28 21:59:03,731::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-36::DEBUG::2013-02-28 21:59:03,732::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,732::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,732::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,732::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,733::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:03,734::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:59:04,439::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:59:04,440::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:04,441::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=9e740e10ec748cc1aff5d65883d94994d45b7dce', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_SPM_LVER=-1', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active'] >Thread-36::DEBUG::2013-02-28 21:59:04,441::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8afb550a-e69f-41d1-bcbe-7813fdda3b72` started monitoring domain `b7765268-5d28-443d-be93-8dd49837a9cc` >Thread-52::DEBUG::2013-02-28 21:59:04,442::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for b7765268-5d28-443d-be93-8dd49837a9cc >Thread-36::DEBUG::2013-02-28 21:59:04,442::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-36::WARNING::2013-02-28 21:59:04,444::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72 already exists >Thread-52::DEBUG::2013-02-28 21:59:04,447::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-36::DEBUG::2013-02-28 21:59:04,455::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-02-28 21:59:04,456::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-36::DEBUG::2013-02-28 21:59:17,901::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-02-28 21:59:17,903::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-52::DEBUG::2013-02-28 21:59:17,982::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-52::DEBUG::2013-02-28 21:59:18,022::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-52::DEBUG::2013-02-28 21:59:18,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000280481 s, 14.6 MB/s\n'; <rc> = 0 >Thread-36::WARNING::2013-02-28 21:59:33,767::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc/images already exists >Thread-36::WARNING::2013-02-28 21:59:33,767::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc/dom_md already exists >Thread-36::INFO::2013-02-28 21:59:33,768::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc to /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc >Thread-36::INFO::2013-02-28 21:59:33,768::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc to /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd >Thread-36::INFO::2013-02-28 21:59:33,768::clusterlock::251::SANLock::(release) Releasing cluster lock for domain b7765268-5d28-443d-be93-8dd49837a9cc >Thread-36::DEBUG::2013-02-28 21:59:33,770::clusterlock::262::SANLock::(release) Cluster lock for domain b7765268-5d28-443d-be93-8dd49837a9cc successfully released >Thread-36::INFO::2013-02-28 21:59:33,770::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 250) >Thread-36::DEBUG::2013-02-28 21:59:35,771::clusterlock::205::SANLock::(releaseHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc released successfully (id: 250) >Thread-52::DEBUG::2013-02-28 21:59:43,684::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-52::DEBUG::2013-02-28 21:59:54,192::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000298789 s, 13.7 MB/s\n'; <rc> = 0 >Thread-52::INFO::2013-02-28 21:59:54,194::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 250) >Thread-52::DEBUG::2013-02-28 21:59:54,195::clusterlock::190::SANLock::(acquireHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc successfully acquired (id: 250) >Thread-52::DEBUG::2013-02-28 21:59:54,195::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for b7765268-5d28-443d-be93-8dd49837a9cc >Thread-52::INFO::2013-02-28 21:59:54,195::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 250) >Thread-52::DEBUG::2013-02-28 21:59:55,197::clusterlock::205::SANLock::(releaseHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc released successfully (id: 250) >Thread-36::INFO::2013-02-28 21:59:55,209::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-36::DEBUG::2013-02-28 21:59:55,213::task::1151::TaskManager.Task::(prepare) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::finished: True >Thread-36::DEBUG::2013-02-28 21:59:55,216::task::568::TaskManager.Task::(_updateState) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::moving from state preparing -> state finished >Thread-36::DEBUG::2013-02-28 21:59:55,220::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>, 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72': < ResourceRef 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', isValid: 'True' obj: 'None'>} >Thread-36::DEBUG::2013-02-28 21:59:55,224::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2013-02-28 21:59:55,230::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-36::DEBUG::2013-02-28 21:59:55,234::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-36::DEBUG::2013-02-28 21:59:55,237::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-36::DEBUG::2013-02-28 21:59:55,240::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-36::DEBUG::2013-02-28 21:59:55,246::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' >Thread-36::DEBUG::2013-02-28 21:59:55,250::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' (0 active users) >Thread-36::DEBUG::2013-02-28 21:59:55,253::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free, finding out if anyone is waiting for it. >Thread-36::DEBUG::2013-02-28 21:59:55,255::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', Clearing records. >Thread-36::DEBUG::2013-02-28 21:59:55,260::task::957::TaskManager.Task::(_decref) Task=`376138b6-09dd-43b6-b2e7-05bbe9af2c57`::ref 0 aborting False >Thread-79::DEBUG::2013-02-28 21:59:55,510::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-79::DEBUG::2013-02-28 21:59:55,523::task::568::TaskManager.Task::(_updateState) Task=`65e574fb-e07f-45eb-abf7-febb6638ace6`::moving from state init -> state preparing >Thread-79::INFO::2013-02-28 21:59:55,529::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-79::DEBUG::2013-02-28 21:59:55,539::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-79::DEBUG::2013-02-28 21:59:55,829::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-79::DEBUG::2013-02-28 21:59:55,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-79::DEBUG::2013-02-28 21:59:56,130::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-79::DEBUG::2013-02-28 21:59:56,142::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-79::DEBUG::2013-02-28 21:59:56,375::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-79::INFO::2013-02-28 21:59:56,385::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-79::DEBUG::2013-02-28 21:59:56,389::task::1151::TaskManager.Task::(prepare) Task=`65e574fb-e07f-45eb-abf7-febb6638ace6`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-79::DEBUG::2013-02-28 21:59:56,393::task::568::TaskManager.Task::(_updateState) Task=`65e574fb-e07f-45eb-abf7-febb6638ace6`::moving from state preparing -> state finished >Thread-79::DEBUG::2013-02-28 21:59:56,397::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-79::DEBUG::2013-02-28 21:59:56,399::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-79::DEBUG::2013-02-28 21:59:56,403::task::957::TaskManager.Task::(_decref) Task=`65e574fb-e07f-45eb-abf7-febb6638ace6`::ref 0 aborting False >Thread-81::DEBUG::2013-02-28 22:00:00,278::task::568::TaskManager.Task::(_updateState) Task=`e744aa46-24e5-4917-8b78-ec194d297e41`::moving from state init -> state preparing >Thread-81::INFO::2013-02-28 22:00:00,278::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2013-02-28 22:00:00,278::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-81::DEBUG::2013-02-28 22:00:00,278::task::1151::TaskManager.Task::(prepare) Task=`e744aa46-24e5-4917-8b78-ec194d297e41`::finished: {} >Thread-81::DEBUG::2013-02-28 22:00:00,279::task::568::TaskManager.Task::(_updateState) Task=`e744aa46-24e5-4917-8b78-ec194d297e41`::moving from state preparing -> state finished >Thread-81::DEBUG::2013-02-28 22:00:00,279::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2013-02-28 22:00:00,279::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2013-02-28 22:00:00,279::task::957::TaskManager.Task::(_decref) Task=`e744aa46-24e5-4917-8b78-ec194d297e41`::ref 0 aborting False >Thread-87::DEBUG::2013-02-28 22:00:15,528::task::568::TaskManager.Task::(_updateState) Task=`76cc32cb-7917-4f14-846d-50155613c076`::moving from state init -> state preparing >Thread-87::INFO::2013-02-28 22:00:15,534::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-87::INFO::2013-02-28 22:00:15,534::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-87::DEBUG::2013-02-28 22:00:15,535::task::1151::TaskManager.Task::(prepare) Task=`76cc32cb-7917-4f14-846d-50155613c076`::finished: {} >Thread-87::DEBUG::2013-02-28 22:00:15,535::task::568::TaskManager.Task::(_updateState) Task=`76cc32cb-7917-4f14-846d-50155613c076`::moving from state preparing -> state finished >Thread-87::DEBUG::2013-02-28 22:00:15,535::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-87::DEBUG::2013-02-28 22:00:15,535::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-87::DEBUG::2013-02-28 22:00:15,535::task::957::TaskManager.Task::(_decref) Task=`76cc32cb-7917-4f14-846d-50155613c076`::ref 0 aborting False >Thread-93::DEBUG::2013-02-28 22:00:32,919::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-93::DEBUG::2013-02-28 22:00:49,630::task::568::TaskManager.Task::(_updateState) Task=`6daae4cf-d29a-4709-9d37-4f63124c65d5`::moving from state init -> state preparing >Thread-93::INFO::2013-02-28 22:00:49,640::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', hostID=1, scsiKey='8afb550a-e69f-41d1-bcbe-7813fdda3b72', msdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', masterVersion=1, options=None) >Thread-93::DEBUG::2013-02-28 22:00:49,651::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`5faf82e7-bfe6-451c-9a9e-23f5e231fd64`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-93::DEBUG::2013-02-28 22:00:49,654::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' for lock type 'exclusive' >Thread-93::DEBUG::2013-02-28 22:00:49,659::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free. Now locking as 'exclusive' (1 active user) >Thread-93::DEBUG::2013-02-28 22:00:49,660::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`5faf82e7-bfe6-451c-9a9e-23f5e231fd64`::Granted request >Thread-93::INFO::2013-02-28 22:00:49,660::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 with master domain: b7765268-5d28-443d-be93-8dd49837a9cc (ver = 1) >Thread-93::DEBUG::2013-02-28 22:00:49,661::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:00:49,661::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:00:49,661::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:00:49,661::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:00:49,662::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:00:49,662::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:00:49,662::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-93::DEBUG::2013-02-28 22:00:49,662::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-93::DEBUG::2013-02-28 22:00:49,662::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-93::DEBUG::2013-02-28 22:00:49,663::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-93::DEBUG::2013-02-28 22:00:49,663::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-93::DEBUG::2013-02-28 22:00:49,709::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:00:49,709::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:49,713::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:49,715::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:49,717::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:50,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:50,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:50,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:50,727::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-93::DEBUG::2013-02-28 22:00:50,729::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-93::DEBUG::2013-02-28 22:00:52,733::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-94::DEBUG::2013-02-28 22:00:52,758::task::568::TaskManager.Task::(_updateState) Task=`922e82fa-a2e2-498c-83db-739e6a6b2dd9`::moving from state init -> state preparing >Thread-94::INFO::2013-02-28 22:00:53,554::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-94::INFO::2013-02-28 22:00:53,554::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-94::DEBUG::2013-02-28 22:00:53,555::task::1151::TaskManager.Task::(prepare) Task=`922e82fa-a2e2-498c-83db-739e6a6b2dd9`::finished: {} >Thread-94::DEBUG::2013-02-28 22:00:53,555::task::568::TaskManager.Task::(_updateState) Task=`922e82fa-a2e2-498c-83db-739e6a6b2dd9`::moving from state preparing -> state finished >Thread-94::DEBUG::2013-02-28 22:00:53,555::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-94::DEBUG::2013-02-28 22:00:53,555::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-94::DEBUG::2013-02-28 22:00:53,556::task::957::TaskManager.Task::(_decref) Task=`922e82fa-a2e2-498c-83db-739e6a6b2dd9`::ref 0 aborting False >Thread-93::DEBUG::2013-02-28 22:01:42,318::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:42,319::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,326::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,326::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,326::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,327::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,327::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,327::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-93::DEBUG::2013-02-28 22:01:42,328::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:42,331::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:43,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:43,745::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,746::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-93::DEBUG::2013-02-28 22:01:43,747::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:43,754::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000279151 s, 7.3 MB/s\n'; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:43,755::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000279151 s, 7.3 MB/s'], size: 2048 >Thread-93::DEBUG::2013-02-28 22:01:43,755::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-93::WARNING::2013-02-28 22:01:43,755::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-93::DEBUG::2013-02-28 22:01:43,761::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-93::DEBUG::2013-02-28 22:01:43,762::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,762::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,763::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,763::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,763::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,764::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:43,963::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:43,965::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,965::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active', '_SHA_CKSUM=3d27ea30e5b60a957bb85db5a0dc026e3aceb75b', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0'] >Thread-93::DEBUG::2013-02-28 22:01:43,966::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:43,966::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:44,157::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:44,157::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-93::WARNING::2013-02-28 22:01:44,158::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_imageNS already registered >Thread-93::WARNING::2013-02-28 22:01:44,158::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_volumeNS already registered >Thread-93::WARNING::2013-02-28 22:01:44,158::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_lvmActivationNS already registered >Thread-93::DEBUG::2013-02-28 22:01:44,159::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain b7765268-5d28-443d-be93-8dd49837a9cc verified, version 1 >Thread-93::DEBUG::2013-02-28 22:01:44,159::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-93::DEBUG::2013-02-28 22:01:44,159::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-93::DEBUG::2013-02-28 22:01:44,159::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,160::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,160::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,160::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,160::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:44,355::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:44,357::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,357::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active', '_SHA_CKSUM=3d27ea30e5b60a957bb85db5a0dc026e3aceb75b', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0'] >Thread-93::DEBUG::2013-02-28 22:01:44,359::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8afb550a-e69f-41d1-bcbe-7813fdda3b72` started monitoring domain `b7765268-5d28-443d-be93-8dd49837a9cc` >Thread-99::DEBUG::2013-02-28 22:01:44,359::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for b7765268-5d28-443d-be93-8dd49837a9cc >Thread-93::DEBUG::2013-02-28 22:01:44,359::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-93::WARNING::2013-02-28 22:01:44,361::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72 already exists >Thread-99::DEBUG::2013-02-28 22:01:44,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:44,369::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-93::DEBUG::2013-02-28 22:01:44,371::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-99::DEBUG::2013-02-28 22:01:44,578::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:01:44,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:44,586::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:44,589::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-99::DEBUG::2013-02-28 22:01:44,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000299143 s, 13.7 MB/s\n'; <rc> = 0 >Thread-99::INFO::2013-02-28 22:01:44,635::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 1) >Thread-99::DEBUG::2013-02-28 22:01:44,639::clusterlock::190::SANLock::(acquireHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc successfully acquired (id: 1) >Thread-93::WARNING::2013-02-28 22:01:44,647::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc/images already exists >Thread-93::WARNING::2013-02-28 22:01:44,648::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc/dom_md already exists >Thread-93::INFO::2013-02-28 22:01:44,649::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc to /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc >Thread-93::INFO::2013-02-28 22:01:44,649::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc to /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd >Thread-93::DEBUG::2013-02-28 22:01:44,650::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-93::DEBUG::2013-02-28 22:01:44,652::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:44,660::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00219139 s, 1.9 MB/s\n'; <rc> = 0 >Thread-93::INFO::2013-02-28 22:01:44,661::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-93::DEBUG::2013-02-28 22:01:44,661::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-93::DEBUG::2013-02-28 22:01:45,669::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00162 s, 4.1 kB/s\n'; <rc> = 0 >Thread-93::DEBUG::2013-02-28 22:01:45,670::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 >Thread-93::DEBUG::2013-02-28 22:01:45,670::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 on master domain b7765268-5d28-443d-be93-8dd49837a9cc >Thread-93::DEBUG::2013-02-28 22:01:45,670::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' >Thread-93::DEBUG::2013-02-28 22:01:45,671::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' (0 active users) >Thread-93::DEBUG::2013-02-28 22:01:45,671::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free, finding out if anyone is waiting for it. >Thread-93::DEBUG::2013-02-28 22:01:45,671::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', Clearing records. >Thread-93::INFO::2013-02-28 22:01:45,671::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-93::DEBUG::2013-02-28 22:01:45,671::task::1151::TaskManager.Task::(prepare) Task=`6daae4cf-d29a-4709-9d37-4f63124c65d5`::finished: True >Thread-93::DEBUG::2013-02-28 22:01:45,672::task::568::TaskManager.Task::(_updateState) Task=`6daae4cf-d29a-4709-9d37-4f63124c65d5`::moving from state preparing -> state finished >Thread-93::DEBUG::2013-02-28 22:01:45,672::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-93::DEBUG::2013-02-28 22:01:45,672::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-93::DEBUG::2013-02-28 22:01:45,672::task::957::TaskManager.Task::(_decref) Task=`6daae4cf-d29a-4709-9d37-4f63124c65d5`::ref 0 aborting False >Thread-130::DEBUG::2013-02-28 22:01:50,151::task::568::TaskManager.Task::(_updateState) Task=`dfd3bdaa-f351-4821-ab13-4e31a3402479`::moving from state init -> state preparing >Thread-130::INFO::2013-02-28 22:01:50,151::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-130::INFO::2013-02-28 22:01:50,151::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.0150051116943', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-130::DEBUG::2013-02-28 22:01:50,151::task::1151::TaskManager.Task::(prepare) Task=`dfd3bdaa-f351-4821-ab13-4e31a3402479`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.0150051116943', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-130::DEBUG::2013-02-28 22:01:50,152::task::568::TaskManager.Task::(_updateState) Task=`dfd3bdaa-f351-4821-ab13-4e31a3402479`::moving from state preparing -> state finished >Thread-130::DEBUG::2013-02-28 22:01:50,152::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-130::DEBUG::2013-02-28 22:01:50,152::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-130::DEBUG::2013-02-28 22:01:50,152::task::957::TaskManager.Task::(_decref) Task=`dfd3bdaa-f351-4821-ab13-4e31a3402479`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:01:54,643::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:01:54,653::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000466278 s, 8.8 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:02:04,657::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:02:04,666::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000382037 s, 10.7 MB/s\n'; <rc> = 0 >Thread-136::DEBUG::2013-02-28 22:02:05,564::task::568::TaskManager.Task::(_updateState) Task=`8559f71f-f864-4312-9833-2d725abcc756`::moving from state init -> state preparing >Thread-136::INFO::2013-02-28 22:02:05,570::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136::INFO::2013-02-28 22:02:05,571::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.00998115539551', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-136::DEBUG::2013-02-28 22:02:05,571::task::1151::TaskManager.Task::(prepare) Task=`8559f71f-f864-4312-9833-2d725abcc756`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.00998115539551', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-136::DEBUG::2013-02-28 22:02:05,571::task::568::TaskManager.Task::(_updateState) Task=`8559f71f-f864-4312-9833-2d725abcc756`::moving from state preparing -> state finished >Thread-136::DEBUG::2013-02-28 22:02:05,571::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2013-02-28 22:02:05,572::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2013-02-28 22:02:05,572::task::957::TaskManager.Task::(_decref) Task=`8559f71f-f864-4312-9833-2d725abcc756`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:02:14,685::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:02:22,495::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00045139 s, 9.1 MB/s\n'; <rc> = 0 >Thread-142::DEBUG::2013-02-28 22:02:28,562::task::568::TaskManager.Task::(_updateState) Task=`0b70b1ab-8887-4f18-b580-b9c12ecf6971`::moving from state init -> state preparing >Thread-99::DEBUG::2013-02-28 22:02:32,499::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-142::INFO::2013-02-28 22:02:33,595::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-142::INFO::2013-02-28 22:02:33,596::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '7.81548404694', 'lastCheck': '11.1', 'code': 0, 'valid': True}} >Thread-142::DEBUG::2013-02-28 22:02:33,603::task::1151::TaskManager.Task::(prepare) Task=`0b70b1ab-8887-4f18-b580-b9c12ecf6971`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '7.81548404694', 'lastCheck': '11.1', 'code': 0, 'valid': True}} >Thread-142::DEBUG::2013-02-28 22:02:33,605::task::568::TaskManager.Task::(_updateState) Task=`0b70b1ab-8887-4f18-b580-b9c12ecf6971`::moving from state preparing -> state finished >Thread-142::DEBUG::2013-02-28 22:02:33,606::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-142::DEBUG::2013-02-28 22:02:33,608::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-142::DEBUG::2013-02-28 22:02:33,610::task::957::TaskManager.Task::(_decref) Task=`0b70b1ab-8887-4f18-b580-b9c12ecf6971`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:02:33,621::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0003351 s, 12.2 MB/s\n'; <rc> = 0 >Thread-145::DEBUG::2013-02-28 22:02:38,938::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmCreate with ({'custom': {}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'cpuType': 'Nehalem', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '0ee182f7-f7fe-420b-b579-76cff3203390'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '94f976f6-73b3-4d25-898c-0faf68c8f4ef', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'specParams': {}, 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d', 'specParams': {}, 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': '327503e9-2748-4882-8710-26253129307d', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:f9', 'linkActive': 'true', 'network': 'rhevm', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '637268c0-a8fb-45c2-bf1e-2b47d1094547', 'device': 'bridge', 'type': 'interface'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '684e73fe-4d50-4993-87d9-9b98d2ec07fa'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '41ea81eb-56bc-43e4-86d4-fdd9a1ab84a9'}], 'smp': '1', 'vmType': 'kvm', 'timeOffset': '0', 'memSize': 512, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smartcardEnable': 'false', 'vmName': 'vm_test1', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} >Thread-145::INFO::2013-02-28 22:02:38,938::API::625::vds::(_getNetworkIp) network None: using 0 >Thread-145::INFO::2013-02-28 22:02:38,939::clientIF::346::vds::(createVm) vmContainerLock acquired by vm 06f93b88-853f-4b80-88ee-834da856316d >Thread-146::DEBUG::2013-02-28 22:02:38,974::vm::655::vm.Vm::(_startUnderlyingVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Start >Thread-145::DEBUG::2013-02-28 22:02:38,975::clientIF::360::vds::(createVm) Total desktops after creation of 06f93b88-853f-4b80-88ee-834da856316d is 1 >Thread-145::DEBUG::2013-02-28 22:02:38,975::BindingXMLRPC::920::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'pid': '0', 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '0ee182f7-f7fe-420b-b579-76cff3203390'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '94f976f6-73b3-4d25-898c-0faf68c8f4ef', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'specParams': {}, 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d', 'specParams': {}, 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': '327503e9-2748-4882-8710-26253129307d', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:f9', 'linkActive': 'true', 'network': 'rhevm', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '637268c0-a8fb-45c2-bf1e-2b47d1094547', 'device': 'bridge', 'type': 'interface'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '684e73fe-4d50-4993-87d9-9b98d2ec07fa'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '41ea81eb-56bc-43e4-86d4-fdd9a1ab84a9'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 512, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm_test1', 'display': 'qxl', 'nice': '0'}} >Thread-146::DEBUG::2013-02-28 22:02:38,977::vm::659::vm.Vm::(_startUnderlyingVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::_ongoingCreations acquired >Thread-146::INFO::2013-02-28 22:02:38,977::libvirtvm::1445::vm.Vm::(_run) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::VM wrapper has started >Thread-146::DEBUG::2013-02-28 22:02:38,978::task::568::TaskManager.Task::(_updateState) Task=`1d2b787c-f0ab-4242-a5d8-c561177389a5`::moving from state init -> state preparing >Thread-146::INFO::2013-02-28 22:02:38,978::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781', options=None) >Thread-146::DEBUG::2013-02-28 22:02:38,978::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-146::DEBUG::2013-02-28 22:02:38,979::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-146::DEBUG::2013-02-28 22:02:39,208::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:02:39,218::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-146::INFO::2013-02-28 22:02:39,219::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-146::DEBUG::2013-02-28 22:02:39,219::task::1151::TaskManager.Task::(prepare) Task=`1d2b787c-f0ab-4242-a5d8-c561177389a5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-146::DEBUG::2013-02-28 22:02:39,219::task::568::TaskManager.Task::(_updateState) Task=`1d2b787c-f0ab-4242-a5d8-c561177389a5`::moving from state preparing -> state finished >Thread-146::DEBUG::2013-02-28 22:02:39,220::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-146::DEBUG::2013-02-28 22:02:39,220::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-02-28 22:02:39,220::task::957::TaskManager.Task::(_decref) Task=`1d2b787c-f0ab-4242-a5d8-c561177389a5`::ref 0 aborting False >Thread-146::DEBUG::2013-02-28 22:02:39,221::task::568::TaskManager.Task::(_updateState) Task=`9c2eaa77-981f-489e-a624-63aeaee2f9bb`::moving from state init -> state preparing >Thread-146::INFO::2013-02-28 22:02:39,221::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff', options=None) >Thread-146::INFO::2013-02-28 22:02:39,222::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-146::DEBUG::2013-02-28 22:02:39,222::task::1151::TaskManager.Task::(prepare) Task=`9c2eaa77-981f-489e-a624-63aeaee2f9bb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-146::DEBUG::2013-02-28 22:02:39,222::task::568::TaskManager.Task::(_updateState) Task=`9c2eaa77-981f-489e-a624-63aeaee2f9bb`::moving from state preparing -> state finished >Thread-146::DEBUG::2013-02-28 22:02:39,223::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-146::DEBUG::2013-02-28 22:02:39,223::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-02-28 22:02:39,223::task::957::TaskManager.Task::(_decref) Task=`9c2eaa77-981f-489e-a624-63aeaee2f9bb`::ref 0 aborting False >Thread-146::INFO::2013-02-28 22:02:39,223::clientIF::328::vds::(prepareVolumePath) prepared volume path: >Thread-146::DEBUG::2013-02-28 22:02:39,224::task::568::TaskManager.Task::(_updateState) Task=`64fa13ae-9a58-4757-b8af-9398d0e49362`::moving from state init -> state preparing >Thread-146::INFO::2013-02-28 22:02:39,224::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781') >Thread-146::DEBUG::2013-02-28 22:02:39,225::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`165e39ca-1a2b-4762-a865-e6a57d5f0700`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-146::DEBUG::2013-02-28 22:02:39,225::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'shared' >Thread-146::DEBUG::2013-02-28 22:02:39,225::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'shared' (1 active user) >Thread-146::DEBUG::2013-02-28 22:02:39,226::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`165e39ca-1a2b-4762-a865-e6a57d5f0700`::Granted request >Thread-146::DEBUG::2013-02-28 22:02:39,226::task::794::TaskManager.Task::(resourceAcquired) Task=`64fa13ae-9a58-4757-b8af-9398d0e49362`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (shared) >Thread-146::DEBUG::2013-02-28 22:02:39,227::task::957::TaskManager.Task::(_decref) Task=`64fa13ae-9a58-4757-b8af-9398d0e49362`::ref 1 aborting False >Thread-146::DEBUG::2013-02-28 22:02:39,228::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-146::DEBUG::2013-02-28 22:02:39,235::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000334915 s, 1.5 MB/s\n'; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:02:39,236::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000334915 s, 1.5 MB/s'], size: 512 >Thread-146::INFO::2013-02-28 22:02:39,236::image::345::Storage.Image::(getChain) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc imgUUID=bed96b16-65fe-4281-9bdc-3661d6b826b9 chain=[<storage.blockVolume.BlockVolume object at 0x1f80990>] >Thread-146::DEBUG::2013-02-28 22:02:39,237::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/6ceb99ca-1a46-473b-be36-f9d526087781' (cwd None) >Thread-99::DEBUG::2013-02-28 22:02:43,631::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:02:55,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000298617 s, 13.7 MB/s\n'; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:02:55,249::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:02:55,250::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-146::DEBUG::2013-02-28 22:02:55,251::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-146::INFO::2013-02-28 22:02:55,251::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}]} >Thread-146::DEBUG::2013-02-28 22:02:55,252::task::1151::TaskManager.Task::(prepare) Task=`64fa13ae-9a58-4757-b8af-9398d0e49362`::finished: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}]} >Thread-146::DEBUG::2013-02-28 22:02:55,252::task::568::TaskManager.Task::(_updateState) Task=`64fa13ae-9a58-4757-b8af-9398d0e49362`::moving from state preparing -> state finished >Thread-146::DEBUG::2013-02-28 22:02:55,252::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>} >Thread-146::DEBUG::2013-02-28 22:02:55,253::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-02-28 22:02:55,253::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-146::DEBUG::2013-02-28 22:02:55,254::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-146::DEBUG::2013-02-28 22:02:55,254::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-146::DEBUG::2013-02-28 22:02:55,254::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-146::DEBUG::2013-02-28 22:02:55,255::task::957::TaskManager.Task::(_decref) Task=`64fa13ae-9a58-4757-b8af-9398d0e49362`::ref 0 aborting False >Thread-146::INFO::2013-02-28 22:02:55,255::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781 >Thread-146::DEBUG::2013-02-28 22:02:55,256::task::568::TaskManager.Task::(_updateState) Task=`f7e33393-de26-4689-bd6e-440e30e78204`::moving from state init -> state preparing >Thread-146::INFO::2013-02-28 22:02:55,256::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff') >Thread-146::DEBUG::2013-02-28 22:02:55,257::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`d3e1e7a5-ef8f-4873-88d4-89c17de706c6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-146::DEBUG::2013-02-28 22:02:55,257::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'shared' >Thread-146::DEBUG::2013-02-28 22:02:55,257::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'shared' (1 active user) >Thread-146::DEBUG::2013-02-28 22:02:55,258::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`d3e1e7a5-ef8f-4873-88d4-89c17de706c6`::Granted request >Thread-146::DEBUG::2013-02-28 22:02:55,258::task::794::TaskManager.Task::(resourceAcquired) Task=`f7e33393-de26-4689-bd6e-440e30e78204`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (shared) >Thread-146::DEBUG::2013-02-28 22:02:55,259::task::957::TaskManager.Task::(_decref) Task=`f7e33393-de26-4689-bd6e-440e30e78204`::ref 1 aborting False >Thread-146::DEBUG::2013-02-28 22:02:55,260::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-146::DEBUG::2013-02-28 22:02:55,268::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000292464 s, 1.8 MB/s\n'; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:02:55,268::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000292464 s, 1.8 MB/s'], size: 512 >Thread-146::INFO::2013-02-28 22:02:55,269::image::345::Storage.Image::(getChain) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc imgUUID=327503e9-2748-4882-8710-26253129307d chain=[<storage.blockVolume.BlockVolume object at 0x1f80dd0>] >Thread-146::DEBUG::2013-02-28 22:02:55,269::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/21edebf6-8c88-41fd-aa21-825b8ebd47ff' (cwd None) >Thread-151::DEBUG::2013-02-28 22:02:58,227::task::568::TaskManager.Task::(_updateState) Task=`a7b119c8-3733-4754-b9e4-a6a8a5e1e3bf`::moving from state init -> state preparing >Thread-99::DEBUG::2013-02-28 22:03:05,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-151::INFO::2013-02-28 22:03:19,249::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-151::INFO::2013-02-28 22:03:19,249::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '11.5638968945', 'lastCheck': '24.1', 'code': 0, 'valid': True}} >Thread-151::DEBUG::2013-02-28 22:03:19,256::task::1151::TaskManager.Task::(prepare) Task=`a7b119c8-3733-4754-b9e4-a6a8a5e1e3bf`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '11.5638968945', 'lastCheck': '24.1', 'code': 0, 'valid': True}} >Thread-151::DEBUG::2013-02-28 22:03:19,256::task::568::TaskManager.Task::(_updateState) Task=`a7b119c8-3733-4754-b9e4-a6a8a5e1e3bf`::moving from state preparing -> state finished >Thread-151::DEBUG::2013-02-28 22:03:19,257::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2013-02-28 22:03:19,258::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-151::DEBUG::2013-02-28 22:03:19,260::task::957::TaskManager.Task::(_decref) Task=`a7b119c8-3733-4754-b9e4-a6a8a5e1e3bf`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:03:19,272::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000356817 s, 11.5 MB/s\n'; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:03:20,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:03:20,755::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-146::DEBUG::2013-02-28 22:03:20,755::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-146::INFO::2013-02-28 22:03:20,756::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]} >Thread-146::DEBUG::2013-02-28 22:03:20,756::task::1151::TaskManager.Task::(prepare) Task=`f7e33393-de26-4689-bd6e-440e30e78204`::finished: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]} >Thread-146::DEBUG::2013-02-28 22:03:20,756::task::568::TaskManager.Task::(_updateState) Task=`f7e33393-de26-4689-bd6e-440e30e78204`::moving from state preparing -> state finished >Thread-146::DEBUG::2013-02-28 22:03:20,756::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>} >Thread-146::DEBUG::2013-02-28 22:03:20,756::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-02-28 22:03:20,757::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-146::DEBUG::2013-02-28 22:03:20,757::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-146::DEBUG::2013-02-28 22:03:20,757::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-146::DEBUG::2013-02-28 22:03:20,757::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-146::DEBUG::2013-02-28 22:03:20,758::task::957::TaskManager.Task::(_decref) Task=`f7e33393-de26-4689-bd6e-440e30e78204`::ref 0 aborting False >Thread-146::INFO::2013-02-28 22:03:20,758::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff >Thread-146::DEBUG::2013-02-28 22:03:20,770::libvirtvm::1500::vm.Vm::(_run) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>vm_test1</name> > <uuid>06f93b88-853f-4b80-88ee-834da856316d</uuid> > <memory>524288</memory> > <currentMemory>524288</currentMemory> > <vcpu>1</vcpu> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/vm_test1.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/vm_test1.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <sound model="ich6"/> > <video> > <model heads="1" type="qxl" vram="65536"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:16:81:f9"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <boot order="1"/> > </interface> > <memballoon model="virtio"/> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial></serial> > </disk> > <disk device="disk" snapshot="no" type="block"> > <source dev="/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781"/> > <target bus="virtio" dev="vda"/> > <serial>bed96b16-65fe-4281-9bdc-3661d6b826b9</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <source dev="/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff"/> > <target bus="virtio" dev="vdb"/> > <serial>327503e9-2748-4882-8710-26253129307d</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.4.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.4.0.4.el6</entry> > <entry name="serial">70a2f218-c088-4421-a726-dce0602f06f0</entry> > <entry name="uuid">06f93b88-853f-4b80-88ee-834da856316d</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="1" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2013-02-28 22:03:26,579::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Started detail 0 opaque None >Thread-146::DEBUG::2013-02-28 22:03:26,645::utils::346::vm.Vm::(start) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Start statistics collection >Thread-155::DEBUG::2013-02-28 22:03:26,650::utils::375::vm.Vm::(run) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Stats thread started >Thread-146::DEBUG::2013-02-28 22:03:26,658::vmChannels::144::vds::(register) Add fileno 17 to listener's channels. >Thread-146::WARNING::2013-02-28 22:03:26,660::libvirtvm::1862::vm.Vm::(_readPauseCode) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::_readPauseCode unsupported by libvirt vm >Thread-155::DEBUG::2013-02-28 22:03:26,665::task::568::TaskManager.Task::(_updateState) Task=`0ed0e71b-c0a0-4678-a147-ab40e2781021`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:03:26,666::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781', options=None) >Thread-155::INFO::2013-02-28 22:03:26,666::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-155::DEBUG::2013-02-28 22:03:26,666::task::1151::TaskManager.Task::(prepare) Task=`0ed0e71b-c0a0-4678-a147-ab40e2781021`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-155::DEBUG::2013-02-28 22:03:26,666::task::568::TaskManager.Task::(_updateState) Task=`0ed0e71b-c0a0-4678-a147-ab40e2781021`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-02-28 22:03:26,666::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:03:26,667::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:03:26,667::task::957::TaskManager.Task::(_decref) Task=`0ed0e71b-c0a0-4678-a147-ab40e2781021`::ref 0 aborting False >Thread-155::DEBUG::2013-02-28 22:03:26,667::task::568::TaskManager.Task::(_updateState) Task=`0687c2bf-1aed-41e4-ab19-1062ffba50a8`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:03:26,667::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff', options=None) >Thread-155::INFO::2013-02-28 22:03:26,668::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-155::DEBUG::2013-02-28 22:03:26,668::task::1151::TaskManager.Task::(prepare) Task=`0687c2bf-1aed-41e4-ab19-1062ffba50a8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-155::DEBUG::2013-02-28 22:03:26,668::task::568::TaskManager.Task::(_updateState) Task=`0687c2bf-1aed-41e4-ab19-1062ffba50a8`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-02-28 22:03:26,668::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:03:26,668::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:03:26,668::task::957::TaskManager.Task::(_decref) Task=`0687c2bf-1aed-41e4-ab19-1062ffba50a8`::ref 0 aborting False >Thread-146::DEBUG::2013-02-28 22:03:26,744::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >Thread-146::DEBUG::2013-02-28 22:03:26,795::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-146::DEBUG::2013-02-28 22:03:26,796::vm::676::vm.Vm::(_startUnderlyingVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::_ongoingCreations released >VM Channels Listener::DEBUG::2013-02-28 22:03:27,595::vmChannels::71::vds::(_do_add_channels) fileno 17 was added to unconnected channels. >VM Channels Listener::DEBUG::2013-02-28 22:03:27,596::vmChannels::103::vds::(_handle_unconnected) Trying to connect fileno 17. >VM Channels Listener::DEBUG::2013-02-28 22:03:27,596::guestIF::104::vm.Vm::(_connect) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Attempting connection to /var/lib/libvirt/qemu/channels/vm_test1.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2013-02-28 22:03:27,598::guestIF::106::vm.Vm::(_connect) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Connected to /var/lib/libvirt/qemu/channels/vm_test1.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2013-02-28 22:03:27,598::vmChannels::106::vds::(_handle_unconnected) Connect fileno 17 was succeed. >Thread-157::DEBUG::2013-02-28 22:03:28,735::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-157::DEBUG::2013-02-28 22:03:28,735::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-157::DEBUG::2013-02-28 22:03:28,735::libvirtvm::249::vm.Vm::(_getNetworkStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Network stats not available >Thread-157::DEBUG::2013-02-28 22:03:28,736::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-157::DEBUG::2013-02-28 22:03:28,736::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-157::DEBUG::2013-02-28 22:03:28,736::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-157::DEBUG::2013-02-28 22:03:28,736::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-157::DEBUG::2013-02-28 22:03:28,736::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-157::DEBUG::2013-02-28 22:03:28,737::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-157::DEBUG::2013-02-28 22:03:28,737::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '18278', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '3025873655517668991', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:16:81:f9', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '2.08', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-99::DEBUG::2013-02-28 22:03:29,279::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:03:29,288::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287178 s, 14.3 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2013-02-28 22:03:32,134::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-160::DEBUG::2013-02-28 22:03:32,141::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-160::DEBUG::2013-02-28 22:03:32,146::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-160::DEBUG::2013-02-28 22:03:32,149::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-160::DEBUG::2013-02-28 22:03:32,152::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-160::DEBUG::2013-02-28 22:03:32,155::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-160::DEBUG::2013-02-28 22:03:32,157::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-160::DEBUG::2013-02-28 22:03:32,160::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-160::DEBUG::2013-02-28 22:03:32,166::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '18278', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '3025873655517668991', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:f9', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'elapsedTime': '53', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-162::DEBUG::2013-02-28 22:03:35,243::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-162::DEBUG::2013-02-28 22:03:35,243::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-162::DEBUG::2013-02-28 22:03:35,243::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-162::DEBUG::2013-02-28 22:03:35,244::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-162::DEBUG::2013-02-28 22:03:35,244::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-162::DEBUG::2013-02-28 22:03:35,244::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-162::DEBUG::2013-02-28 22:03:35,244::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-162::DEBUG::2013-02-28 22:03:35,244::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-162::DEBUG::2013-02-28 22:03:35,245::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '18278', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '3025873655517668991', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:f9', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '2.23', 'elapsedTime': '56', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-163::DEBUG::2013-02-28 22:03:38,280::task::568::TaskManager.Task::(_updateState) Task=`128a15b4-30eb-4063-a2c0-6e3d37d7b2da`::moving from state init -> state preparing >Thread-163::INFO::2013-02-28 22:03:38,301::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-163::INFO::2013-02-28 22:03:38,301::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.00868606567383', 'lastCheck': '9.0', 'code': 0, 'valid': True}} >Thread-163::DEBUG::2013-02-28 22:03:38,302::task::1151::TaskManager.Task::(prepare) Task=`128a15b4-30eb-4063-a2c0-6e3d37d7b2da`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.00868606567383', 'lastCheck': '9.0', 'code': 0, 'valid': True}} >Thread-163::DEBUG::2013-02-28 22:03:38,302::task::568::TaskManager.Task::(_updateState) Task=`128a15b4-30eb-4063-a2c0-6e3d37d7b2da`::moving from state preparing -> state finished >Thread-163::DEBUG::2013-02-28 22:03:38,302::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-163::DEBUG::2013-02-28 22:03:38,302::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-163::DEBUG::2013-02-28 22:03:38,302::task::957::TaskManager.Task::(_decref) Task=`128a15b4-30eb-4063-a2c0-6e3d37d7b2da`::ref 0 aborting False >Thread-164::DEBUG::2013-02-28 22:03:38,344::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-164::DEBUG::2013-02-28 22:03:38,344::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-164::DEBUG::2013-02-28 22:03:38,344::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-164::DEBUG::2013-02-28 22:03:38,345::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-164::DEBUG::2013-02-28 22:03:38,345::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-164::DEBUG::2013-02-28 22:03:38,345::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-164::DEBUG::2013-02-28 22:03:38,345::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-99::DEBUG::2013-02-28 22:03:39,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:03:39,737::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000384407 s, 10.7 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:03:49,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:03:52,708::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000347547 s, 11.8 MB/s\n'; <rc> = 0 >Thread-166::DEBUG::2013-02-28 22:03:52,730::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-166::DEBUG::2013-02-28 22:03:52,730::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-166::DEBUG::2013-02-28 22:03:52,731::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-166::DEBUG::2013-02-28 22:03:52,731::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-166::DEBUG::2013-02-28 22:03:52,731::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-166::DEBUG::2013-02-28 22:03:52,731::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-166::DEBUG::2013-02-28 22:03:52,732::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-166::DEBUG::2013-02-28 22:03:52,732::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-166::DEBUG::2013-02-28 22:03:52,732::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '18278', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '3025873655517668991', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:f9', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.4', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '10.99', 'elapsedTime': '73', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2013-02-28 22:03:57,643::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-99::DEBUG::2013-02-28 22:04:02,712::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:04:18,846::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258016 s, 15.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2013-02-28 22:04:27,845::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-170::DEBUG::2013-02-28 22:04:27,978::task::568::TaskManager.Task::(_updateState) Task=`72ad453e-a4ac-487a-a20c-89b3724ef6be`::moving from state init -> state preparing >Thread-170::INFO::2013-02-28 22:04:28,891::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-170::INFO::2013-02-28 22:04:28,891::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '16.1340248585', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-170::DEBUG::2013-02-28 22:04:28,891::task::1151::TaskManager.Task::(prepare) Task=`72ad453e-a4ac-487a-a20c-89b3724ef6be`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '16.1340248585', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-170::DEBUG::2013-02-28 22:04:28,892::task::568::TaskManager.Task::(_updateState) Task=`72ad453e-a4ac-487a-a20c-89b3724ef6be`::moving from state preparing -> state finished >Thread-170::DEBUG::2013-02-28 22:04:28,892::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-170::DEBUG::2013-02-28 22:04:28,892::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-170::DEBUG::2013-02-28 22:04:28,893::task::957::TaskManager.Task::(_decref) Task=`72ad453e-a4ac-487a-a20c-89b3724ef6be`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:04:28,849::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:04:28,907::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000299088 s, 13.7 MB/s\n'; <rc> = 0 >Thread-171::DEBUG::2013-02-28 22:04:28,970::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-171::DEBUG::2013-02-28 22:04:28,971::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-171::DEBUG::2013-02-28 22:04:28,971::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-171::DEBUG::2013-02-28 22:04:28,971::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-171::DEBUG::2013-02-28 22:04:28,972::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-171::DEBUG::2013-02-28 22:04:28,972::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-99::DEBUG::2013-02-28 22:04:38,911::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2013-02-28 22:04:57,936::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-155::INFO::2013-02-28 22:04:59,497::libvirtvm::141::vm.Vm::(_highWrite) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::b7765268-5d28-443d-be93-8dd49837a9cc/6ceb99ca-1a46-473b-be36-f9d526087781 apparent: 1073741824 capacity: 6442450944, alloc: 686161408, phys: 1073741824 >Thread-155::DEBUG::2013-02-28 22:04:59,498::vm::896::vm.Vm::(__extendDriveVolume) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Requesting an extension for the volume: {'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'} >Thread-155::DEBUG::2013-02-28 22:04:59,501::task::568::TaskManager.Task::(_updateState) Task=`30194226-c61d-4fb4-81f6-290596b40693`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:04:59,503::logUtils::37::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', volDict={'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'}, newSize=2147483648, callbackFunc=<bound method LibvirtVm.__afterVolumeExtension of <libvirtvm.LibvirtVm object at 0x7fbe8c1a0b50>>) >Thread-155::DEBUG::2013-02-28 22:04:59,505::storage_mailbox::109::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: b7765268-5d28-443d-be93-8dd49837a9cc, volume: 6ceb99ca-1a46-473b-be36-f9d526087781 >Thread-155::INFO::2013-02-28 22:04:59,507::logUtils::39::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-128::DEBUG::2013-02-28 22:04:59,508::storage_mailbox::373::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\xcc\xa97\x98\xd4\x8d\x93\xbe=D(]hRv\xb7\x81w\x08&\xd5\xf96\xbe;GF\x1a\xca\x99\xebl000000000000080000000000000' >Thread-155::DEBUG::2013-02-28 22:04:59,509::task::1151::TaskManager.Task::(prepare) Task=`30194226-c61d-4fb4-81f6-290596b40693`::finished: None >Thread-155::DEBUG::2013-02-28 22:04:59,511::task::568::TaskManager.Task::(_updateState) Task=`30194226-c61d-4fb4-81f6-290596b40693`::moving from state preparing -> state finished >Thread-128::DEBUG::2013-02-28 22:04:59,512::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-155::DEBUG::2013-02-28 22:04:59,513::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:04:59,521::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:04:59,526::task::957::TaskManager.Task::(_decref) Task=`30194226-c61d-4fb4-81f6-290596b40693`::ref 0 aborting False >Thread-128::DEBUG::2013-02-28 22:04:59,535::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00145285 s, 2.8 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:04:59,535::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000389848 s, 10.5 MB/s\n'; <rc> = 0 >Thread-128::INFO::2013-02-28 22:04:59,536::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-128::DEBUG::2013-02-28 22:04:59,538::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-128::DEBUG::2013-02-28 22:05:00,548::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00399 s, 4.1 kB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:05:09,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2013-02-28 22:05:28,530::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-99::DEBUG::2013-02-28 22:05:29,580::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640935 s, 6.4 MB/s\n'; <rc> = 0 >Thread-155::INFO::2013-02-28 22:05:30,556::libvirtvm::141::vm.Vm::(_highWrite) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::b7765268-5d28-443d-be93-8dd49837a9cc/6ceb99ca-1a46-473b-be36-f9d526087781 apparent: 1073741824 capacity: 6442450944, alloc: 945421824, phys: 1073741824 >Thread-155::DEBUG::2013-02-28 22:05:30,556::vm::896::vm.Vm::(__extendDriveVolume) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Requesting an extension for the volume: {'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'} >Thread-155::DEBUG::2013-02-28 22:05:30,557::task::568::TaskManager.Task::(_updateState) Task=`c6e21d4b-112a-4315-821e-811d3a6132e9`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:05:30,557::logUtils::37::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', volDict={'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'}, newSize=2147483648, callbackFunc=<bound method LibvirtVm.__afterVolumeExtension of <libvirtvm.LibvirtVm object at 0x7fbe8c1a0b50>>) >Thread-155::DEBUG::2013-02-28 22:05:30,557::storage_mailbox::109::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: b7765268-5d28-443d-be93-8dd49837a9cc, volume: 6ceb99ca-1a46-473b-be36-f9d526087781 >Thread-155::INFO::2013-02-28 22:05:30,557::logUtils::39::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-155::DEBUG::2013-02-28 22:05:30,558::task::1151::TaskManager.Task::(prepare) Task=`c6e21d4b-112a-4315-821e-811d3a6132e9`::finished: None >Thread-155::DEBUG::2013-02-28 22:05:30,558::task::568::TaskManager.Task::(_updateState) Task=`c6e21d4b-112a-4315-821e-811d3a6132e9`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-02-28 22:05:30,558::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:05:30,558::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:05:30,558::task::957::TaskManager.Task::(_decref) Task=`c6e21d4b-112a-4315-821e-811d3a6132e9`::ref 0 aborting False >Thread-128::DEBUG::2013-02-28 22:05:31,552::storage_mailbox::362::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7fbe8c12a9e0> >Thread-128::DEBUG::2013-02-28 22:05:31,553::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-128::DEBUG::2013-02-28 22:05:31,561::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00172904 s, 2.4 MB/s\n'; <rc> = 0 >Thread-128::DEBUG::2013-02-28 22:05:31,562::storage_mailbox::307::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\xcc\xa97\x98\xd4\x8d\x93\xbe=D(]hRv\xb7\x81w\x08&\xd5\xf96\xbe;GF\x1a\xca\x99\xebl000000000000080000000000000' >Thread-128::INFO::2013-02-28 22:05:31,562::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-125::DEBUG::2013-02-28 22:05:31,562::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:31,564::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: dbcb5a3a-53fc-43f1-959d-d25b506cac59 running: <function runTask at 0x1b392a8> with: (<bound method LibvirtVm.__afterVolumeExtension of <libvirtvm.LibvirtVm object at 0x7fbe8c1a0b50>>, {'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'}) >Thread-128::DEBUG::2013-02-28 22:05:31,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:31,571::task::568::TaskManager.Task::(_updateState) Task=`538a3c03-c2fc-4967-b4a7-a67756d10875`::moving from state init -> state preparing >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:31,573::vm::855::vm.Vm::(__verifyVolumeExtension) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Refreshing drive volume for vda (domainID: b7765268-5d28-443d-be93-8dd49837a9cc, volumeID: 6ceb99ca-1a46-473b-be36-f9d526087781) >libvirtEventLoop::DEBUG::2013-02-28 22:05:31,799::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Suspended detail 0 opaque None >libvirtEventLoop::DEBUG::2013-02-28 22:05:31,960::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Suspended detail 0 opaque None >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:31,960::task::568::TaskManager.Task::(_updateState) Task=`a69a8f50-febe-4127-aa9f-9f8a94e52d4b`::moving from state init -> state preparing >dbcb5a3a-53fc-43f1-959d-d25b506cac59::INFO::2013-02-28 22:05:31,961::logUtils::37::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781') >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:31,961::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:31,962::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:32,199::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:32,208::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:32,209::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh b7765268-5d28-443d-be93-8dd49837a9cc/6ceb99ca-1a46-473b-be36-f9d526087781' (cwd None) >Thread-128::DEBUG::2013-02-28 22:05:32,576::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00531 s, 4.1 kB/s\n'; <rc> = 0 >Thread-175::DEBUG::2013-02-28 22:05:32,614::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-175::DEBUG::2013-02-28 22:05:32,753::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-175::DEBUG::2013-02-28 22:05:32,753::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-175::DEBUG::2013-02-28 22:05:32,753::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-175::DEBUG::2013-02-28 22:05:32,753::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-175::DEBUG::2013-02-28 22:05:32,754::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-175::DEBUG::2013-02-28 22:05:32,754::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-175::DEBUG::2013-02-28 22:05:32,754::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Paused', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '18278', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '3025873655517668991', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:f9', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.1', 'rxRate': '2.8', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayType': 'qxl', 'cpuUser': '47.95', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.19', 'elapsedTime': '173', 'vmType': 'kvm', 'cpuSys': '19.54', 'appsList': [], 'guestIPs': ''}]} >Thread-155::INFO::2013-02-28 22:05:32,757::libvirtvm::141::vm.Vm::(_highWrite) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::b7765268-5d28-443d-be93-8dd49837a9cc/6ceb99ca-1a46-473b-be36-f9d526087781 apparent: 1073741824 capacity: 6442450944, alloc: 985792000, phys: 1073741824 >Thread-155::DEBUG::2013-02-28 22:05:32,758::vm::896::vm.Vm::(__extendDriveVolume) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Requesting an extension for the volume: {'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'} >Thread-155::DEBUG::2013-02-28 22:05:32,758::task::568::TaskManager.Task::(_updateState) Task=`f445a55c-c153-4963-9bbb-19e449da32e0`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:05:32,759::logUtils::37::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', volDict={'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'}, newSize=2147483648, callbackFunc=<bound method LibvirtVm.__afterVolumeExtension of <libvirtvm.LibvirtVm object at 0x7fbe8c1a0b50>>) >Thread-155::DEBUG::2013-02-28 22:05:32,759::storage_mailbox::109::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: b7765268-5d28-443d-be93-8dd49837a9cc, volume: 6ceb99ca-1a46-473b-be36-f9d526087781 >Thread-155::INFO::2013-02-28 22:05:32,760::logUtils::39::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-155::DEBUG::2013-02-28 22:05:32,760::task::1151::TaskManager.Task::(prepare) Task=`f445a55c-c153-4963-9bbb-19e449da32e0`::finished: None >Thread-155::DEBUG::2013-02-28 22:05:32,761::task::568::TaskManager.Task::(_updateState) Task=`f445a55c-c153-4963-9bbb-19e449da32e0`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-02-28 22:05:32,761::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:05:32,761::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:05:32,762::task::957::TaskManager.Task::(_decref) Task=`f445a55c-c153-4963-9bbb-19e449da32e0`::ref 0 aborting False >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,049::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,049::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,049::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >dbcb5a3a-53fc-43f1-959d-d25b506cac59::INFO::2013-02-28 22:05:33,049::logUtils::39::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,050::task::1151::TaskManager.Task::(prepare) Task=`a69a8f50-febe-4127-aa9f-9f8a94e52d4b`::finished: None >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,050::task::568::TaskManager.Task::(_updateState) Task=`a69a8f50-febe-4127-aa9f-9f8a94e52d4b`::moving from state preparing -> state finished >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,050::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,050::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:33,050::task::957::TaskManager.Task::(_decref) Task=`a69a8f50-febe-4127-aa9f-9f8a94e52d4b`::ref 0 aborting False >Thread-128::DEBUG::2013-02-28 22:05:34,755::storage_mailbox::373::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 128, end: 192, len: 4096, message(2/63): '1xtnd\xcc\xa97\x98\xd4\x8d\x93\xbe=D(]hRv\xb7\x81w\x08&\xd5\xf96\xbe;GF\x1a\xca\x99\xebl000000000000080000000000000' >Thread-99::DEBUG::2013-02-28 22:05:39,585::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-128::DEBUG::2013-02-28 22:05:51,315::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >libvirtEventLoop::DEBUG::2013-02-28 22:05:51,322::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Resumed detail 0 opaque None >Thread-128::DEBUG::2013-02-28 22:05:51,348::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00190622 s, 2.1 MB/s\n'; <rc> = 0 >Thread-128::INFO::2013-02-28 22:05:51,370::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-128::DEBUG::2013-02-28 22:05:51,370::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-99::DEBUG::2013-02-28 22:05:51,350::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000318936 s, 12.8 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2013-02-28 22:05:51,476::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Resumed detail 0 opaque None >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,477::task::568::TaskManager.Task::(_updateState) Task=`1c876fb0-6d4f-45a3-b755-62c1125924b5`::moving from state init -> state preparing >dbcb5a3a-53fc-43f1-959d-d25b506cac59::INFO::2013-02-28 22:05:51,478::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781', options=None) >dbcb5a3a-53fc-43f1-959d-d25b506cac59::INFO::2013-02-28 22:05:51,479::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,479::task::1151::TaskManager.Task::(prepare) Task=`1c876fb0-6d4f-45a3-b755-62c1125924b5`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,479::task::568::TaskManager.Task::(_updateState) Task=`1c876fb0-6d4f-45a3-b755-62c1125924b5`::moving from state preparing -> state finished >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,480::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,480::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,480::task::957::TaskManager.Task::(_decref) Task=`1c876fb0-6d4f-45a3-b755-62c1125924b5`::ref 0 aborting False >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:51,480::vm::875::vm.Vm::(__verifyVolumeExtension) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Verifying extension for volume 6ceb99ca-1a46-473b-be36-f9d526087781, requested size 2147483648, current size 2147483648 >Thread-128::DEBUG::2013-02-28 22:05:52,399::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00674 s, 4.1 kB/s\n'; <rc> = 0 >Thread-177::DEBUG::2013-02-28 22:05:54,507::task::568::TaskManager.Task::(_updateState) Task=`c84c82ed-b40b-461c-9cb5-6f8c1be97c44`::moving from state init -> state preparing >Thread-177::INFO::2013-02-28 22:05:58,546::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-177::INFO::2013-02-28 22:05:58,546::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '11.7919850349', 'lastCheck': '7.2', 'code': 0, 'valid': True}} >Thread-177::DEBUG::2013-02-28 22:05:58,547::task::1151::TaskManager.Task::(prepare) Task=`c84c82ed-b40b-461c-9cb5-6f8c1be97c44`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '11.7919850349', 'lastCheck': '7.2', 'code': 0, 'valid': True}} >Thread-177::DEBUG::2013-02-28 22:05:58,547::task::568::TaskManager.Task::(_updateState) Task=`c84c82ed-b40b-461c-9cb5-6f8c1be97c44`::moving from state preparing -> state finished >Thread-177::DEBUG::2013-02-28 22:05:58,547::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-177::DEBUG::2013-02-28 22:05:58,547::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-177::DEBUG::2013-02-28 22:05:58,547::task::957::TaskManager.Task::(_decref) Task=`c84c82ed-b40b-461c-9cb5-6f8c1be97c44`::ref 0 aborting False >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:58,548::task::1151::TaskManager.Task::(prepare) Task=`538a3c03-c2fc-4967-b4a7-a67756d10875`::finished: None >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:58,548::task::568::TaskManager.Task::(_updateState) Task=`538a3c03-c2fc-4967-b4a7-a67756d10875`::moving from state preparing -> state finished >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:58,548::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:58,549::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:58,549::task::957::TaskManager.Task::(_decref) Task=`538a3c03-c2fc-4967-b4a7-a67756d10875`::ref 0 aborting False >dbcb5a3a-53fc-43f1-959d-d25b506cac59::DEBUG::2013-02-28 22:05:58,550::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >VM Channels Listener::DEBUG::2013-02-28 22:05:58,587::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-178::DEBUG::2013-02-28 22:05:58,631::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-178::DEBUG::2013-02-28 22:05:58,631::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-178::DEBUG::2013-02-28 22:05:58,631::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-178::DEBUG::2013-02-28 22:05:58,632::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-178::DEBUG::2013-02-28 22:05:58,632::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-178::DEBUG::2013-02-28 22:05:58,632::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-128::DEBUG::2013-02-28 22:06:00,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-99::DEBUG::2013-02-28 22:06:01,381::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-128::DEBUG::2013-02-28 22:06:26,250::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00183535 s, 2.2 MB/s\n'; <rc> = 0 >Thread-128::DEBUG::2013-02-28 22:06:26,251::storage_mailbox::307::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\xcc\xa97\x98\xd4\x8d\x93\xbe=D(]hRv\xb7\x81w\x08&\xd5\xf96\xbe;GF\x1a\xca\x99\xebl000000000000080000000000000' >Thread-124::DEBUG::2013-02-28 22:06:26,253::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-128::INFO::2013-02-28 22:06:26,253::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:26,254::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8 running: <function runTask at 0x1b392a8> with: (<bound method LibvirtVm.__afterVolumeExtension of <libvirtvm.LibvirtVm object at 0x7fbe8c1a0b50>>, {'newSize': 2048, 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72'}) >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:26,257::task::568::TaskManager.Task::(_updateState) Task=`8dcf0440-0c5f-4428-bfb7-89cf1cc00216`::moving from state init -> state preparing >Thread-128::DEBUG::2013-02-28 22:06:26,257::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:26,259::vm::855::vm.Vm::(__verifyVolumeExtension) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Refreshing drive volume for vda (domainID: b7765268-5d28-443d-be93-8dd49837a9cc, volumeID: 6ceb99ca-1a46-473b-be36-f9d526087781) >Thread-99::DEBUG::2013-02-28 22:06:26,270::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000356115 s, 11.5 MB/s\n'; <rc> = 0 >Thread-128::DEBUG::2013-02-28 22:06:27,270::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00617 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2013-02-28 22:06:28,627::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-128::DEBUG::2013-02-28 22:06:29,273::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-128::DEBUG::2013-02-28 22:06:29,282::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00260981 s, 1.6 MB/s\n'; <rc> = 0 >Thread-128::INFO::2013-02-28 22:06:29,282::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-128::DEBUG::2013-02-28 22:06:29,283::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >libvirtEventLoop::DEBUG::2013-02-28 22:06:30,177::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Suspended detail 0 opaque None >Thread-128::DEBUG::2013-02-28 22:06:30,289::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00158 s, 4.1 kB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2013-02-28 22:06:30,341::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Suspended detail 0 opaque None >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,344::task::568::TaskManager.Task::(_updateState) Task=`0eaee418-cd3b-4a85-a01d-51538a2f8236`::moving from state init -> state preparing >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::INFO::2013-02-28 22:06:30,345::logUtils::37::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781') >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,345::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,346::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,568::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,644::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,645::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh b7765268-5d28-443d-be93-8dd49837a9cc/6ceb99ca-1a46-473b-be36-f9d526087781' (cwd None) >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,939::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,939::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,940::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::INFO::2013-02-28 22:06:30,940::logUtils::39::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,941::task::1151::TaskManager.Task::(prepare) Task=`0eaee418-cd3b-4a85-a01d-51538a2f8236`::finished: None >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,941::task::568::TaskManager.Task::(_updateState) Task=`0eaee418-cd3b-4a85-a01d-51538a2f8236`::moving from state preparing -> state finished >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,941::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,942::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:30,942::task::957::TaskManager.Task::(_decref) Task=`0eaee418-cd3b-4a85-a01d-51538a2f8236`::ref 0 aborting False >libvirtEventLoop::DEBUG::2013-02-28 22:06:31,038::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Resumed detail 0 opaque None >libvirtEventLoop::DEBUG::2013-02-28 22:06:31,098::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Resumed detail 0 opaque None >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,098::task::568::TaskManager.Task::(_updateState) Task=`a36a9393-bb41-4ff2-8aa3-06e49a870072`::moving from state init -> state preparing >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::INFO::2013-02-28 22:06:31,099::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781', options=None) >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::INFO::2013-02-28 22:06:31,099::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,099::task::1151::TaskManager.Task::(prepare) Task=`a36a9393-bb41-4ff2-8aa3-06e49a870072`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,100::task::568::TaskManager.Task::(_updateState) Task=`a36a9393-bb41-4ff2-8aa3-06e49a870072`::moving from state preparing -> state finished >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,100::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,100::task::957::TaskManager.Task::(_decref) Task=`a36a9393-bb41-4ff2-8aa3-06e49a870072`::ref 0 aborting False >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,100::vm::875::vm.Vm::(__verifyVolumeExtension) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Verifying extension for volume 6ceb99ca-1a46-473b-be36-f9d526087781, requested size 2147483648, current size 2147483648 >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,173::task::1151::TaskManager.Task::(prepare) Task=`8dcf0440-0c5f-4428-bfb7-89cf1cc00216`::finished: None >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,173::task::568::TaskManager.Task::(_updateState) Task=`8dcf0440-0c5f-4428-bfb7-89cf1cc00216`::moving from state preparing -> state finished >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,174::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,174::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,174::task::957::TaskManager.Task::(_decref) Task=`8dcf0440-0c5f-4428-bfb7-89cf1cc00216`::ref 0 aborting False >a9cb3bd8-ca01-4cbb-a64d-e9baeb80daa8::DEBUG::2013-02-28 22:06:31,174::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-99::DEBUG::2013-02-28 22:06:36,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:06:36,283::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024604 s, 16.6 MB/s\n'; <rc> = 0 >Thread-183::DEBUG::2013-02-28 22:06:39,290::task::568::TaskManager.Task::(_updateState) Task=`59bb2f68-8b01-42cb-8b5c-739e93c5e91e`::moving from state init -> state preparing >Thread-183::INFO::2013-02-28 22:06:39,296::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-183::INFO::2013-02-28 22:06:39,296::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.00974202156067', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-183::DEBUG::2013-02-28 22:06:39,296::task::1151::TaskManager.Task::(prepare) Task=`59bb2f68-8b01-42cb-8b5c-739e93c5e91e`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.00974202156067', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-183::DEBUG::2013-02-28 22:06:39,297::task::568::TaskManager.Task::(_updateState) Task=`59bb2f68-8b01-42cb-8b5c-739e93c5e91e`::moving from state preparing -> state finished >Thread-183::DEBUG::2013-02-28 22:06:39,297::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-183::DEBUG::2013-02-28 22:06:39,297::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-183::DEBUG::2013-02-28 22:06:39,297::task::957::TaskManager.Task::(_decref) Task=`59bb2f68-8b01-42cb-8b5c-739e93c5e91e`::ref 0 aborting False >Thread-184::DEBUG::2013-02-28 22:06:39,331::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-184::DEBUG::2013-02-28 22:06:39,331::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-184::DEBUG::2013-02-28 22:06:39,331::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-184::DEBUG::2013-02-28 22:06:39,331::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-184::DEBUG::2013-02-28 22:06:39,331::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-184::DEBUG::2013-02-28 22:06:39,332::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-99::DEBUG::2013-02-28 22:06:46,289::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain b7765268-5d28-443d-be93-8dd49837a9cc >VM Channels Listener::DEBUG::2013-02-28 22:06:58,667::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-99::DEBUG::2013-02-28 22:07:09,902::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-99::DEBUG::2013-02-28 22:07:09,903::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:07:09,913::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000304348 s, 6.7 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:07:09,914::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000304348 s, 6.7 MB/s'], size: 2048 >Thread-99::DEBUG::2013-02-28 22:07:09,914::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-99::WARNING::2013-02-28 22:07:09,914::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-99::DEBUG::2013-02-28 22:07:09,920::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-99::DEBUG::2013-02-28 22:07:09,920::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-99::DEBUG::2013-02-28 22:07:09,920::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-99::DEBUG::2013-02-28 22:07:09,921::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-99::DEBUG::2013-02-28 22:07:09,921::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-99::DEBUG::2013-02-28 22:07:09,921::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-99::DEBUG::2013-02-28 22:07:09,922::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-99::DEBUG::2013-02-28 22:07:10,163::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:07:10,165::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-99::DEBUG::2013-02-28 22:07:10,165::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active', '_SHA_CKSUM=3d27ea30e5b60a957bb85db5a0dc026e3aceb75b', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0'] >Thread-99::WARNING::2013-02-28 22:07:10,166::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_imageNS already registered >Thread-99::WARNING::2013-02-28 22:07:10,166::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_volumeNS already registered >Thread-99::WARNING::2013-02-28 22:07:10,166::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_lvmActivationNS already registered >Thread-99::DEBUG::2013-02-28 22:07:10,167::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-99::DEBUG::2013-02-28 22:07:10,358::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:07:10,358::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:07:10,368::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000264464 s, 15.5 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:07:20,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2013-02-28 22:07:28,924::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >libvirtEventLoop::DEBUG::2013-02-28 22:07:36,716::vm::787::vm.Vm::(onReboot) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::reboot event >Thread-99::DEBUG::2013-02-28 22:07:36,721::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000341946 s, 12.0 MB/s\n'; <rc> = 0 >Thread-189::DEBUG::2013-02-28 22:07:39,742::task::568::TaskManager.Task::(_updateState) Task=`043e0eb6-0e1e-4d6c-8803-cb06c7611879`::moving from state init -> state preparing >Thread-99::DEBUG::2013-02-28 22:07:46,739::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2013-02-28 22:07:59,748::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Thread-189::INFO::2013-02-28 22:08:12,273::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-189::INFO::2013-02-28 22:08:12,287::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '16.3488659859', 'lastCheck': '35.6', 'code': 0, 'valid': True}} >Thread-189::DEBUG::2013-02-28 22:08:12,449::task::1151::TaskManager.Task::(prepare) Task=`043e0eb6-0e1e-4d6c-8803-cb06c7611879`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '16.3488659859', 'lastCheck': '35.6', 'code': 0, 'valid': True}} >Thread-189::DEBUG::2013-02-28 22:08:12,465::task::568::TaskManager.Task::(_updateState) Task=`043e0eb6-0e1e-4d6c-8803-cb06c7611879`::moving from state preparing -> state finished >Thread-189::DEBUG::2013-02-28 22:08:12,480::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2013-02-28 22:08:12,496::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2013-02-28 22:08:12,512::task::957::TaskManager.Task::(_decref) Task=`043e0eb6-0e1e-4d6c-8803-cb06c7611879`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:08:12,613::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473518 s, 865 kB/s\n'; <rc> = 0 >Thread-190::DEBUG::2013-02-28 22:08:13,000::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-190::DEBUG::2013-02-28 22:08:13,005::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-190::DEBUG::2013-02-28 22:08:13,009::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-190::DEBUG::2013-02-28 22:08:13,013::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-190::DEBUG::2013-02-28 22:08:13,017::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-190::DEBUG::2013-02-28 22:08:13,022::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-192::DEBUG::2013-02-28 22:08:16,150::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-192::DEBUG::2013-02-28 22:08:16,151::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-192::DEBUG::2013-02-28 22:08:16,151::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-192::DEBUG::2013-02-28 22:08:16,151::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-192::DEBUG::2013-02-28 22:08:16,152::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-192::DEBUG::2013-02-28 22:08:16,152::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-192::DEBUG::2013-02-28 22:08:16,152::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-192::DEBUG::2013-02-28 22:08:16,153::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '18278', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '3025873655517668991', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:f9', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayType': 'qxl', 'cpuUser': '73.80', 'disks': {u'vda': {'truesize': '2147483648', 'apparentsize': '2147483648', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.63', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '6.46', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2013-02-28 22:08:17,571::guestIF::167::vm.Vm::(_handleMessage) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::u'None' >Thread-99::DEBUG::2013-02-28 22:08:22,795::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-155::DEBUG::2013-02-28 22:08:37,741::task::568::TaskManager.Task::(_updateState) Task=`f5532780-bfe3-49e5-a2e5-7964b8c84e99`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:08:37,743::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='bed96b16-65fe-4281-9bdc-3661d6b826b9', volUUID='6ceb99ca-1a46-473b-be36-f9d526087781', options=None) >Thread-155::INFO::2013-02-28 22:08:37,745::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-99::DEBUG::2013-02-28 22:08:37,746::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000298344 s, 13.7 MB/s\n'; <rc> = 0 >Thread-155::DEBUG::2013-02-28 22:08:37,746::task::1151::TaskManager.Task::(prepare) Task=`f5532780-bfe3-49e5-a2e5-7964b8c84e99`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-155::DEBUG::2013-02-28 22:08:37,748::task::568::TaskManager.Task::(_updateState) Task=`f5532780-bfe3-49e5-a2e5-7964b8c84e99`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-02-28 22:08:37,749::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:08:37,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:08:37,751::task::957::TaskManager.Task::(_decref) Task=`f5532780-bfe3-49e5-a2e5-7964b8c84e99`::ref 0 aborting False >Thread-155::DEBUG::2013-02-28 22:08:37,753::task::568::TaskManager.Task::(_updateState) Task=`21c712d6-a1ce-4e83-b2cd-eb13ce9ee157`::moving from state init -> state preparing >Thread-155::INFO::2013-02-28 22:08:37,754::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff', options=None) >Thread-155::INFO::2013-02-28 22:08:37,756::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-155::DEBUG::2013-02-28 22:08:37,757::task::1151::TaskManager.Task::(prepare) Task=`21c712d6-a1ce-4e83-b2cd-eb13ce9ee157`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-155::DEBUG::2013-02-28 22:08:37,757::task::568::TaskManager.Task::(_updateState) Task=`21c712d6-a1ce-4e83-b2cd-eb13ce9ee157`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-02-28 22:08:37,757::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-02-28 22:08:37,757::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-02-28 22:08:37,758::task::957::TaskManager.Task::(_decref) Task=`21c712d6-a1ce-4e83-b2cd-eb13ce9ee157`::ref 0 aborting False >Thread-194::DEBUG::2013-02-28 22:08:37,763::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmGetStats with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-194::DEBUG::2013-02-28 22:08:37,763::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc stats not available >Thread-194::DEBUG::2013-02-28 22:08:37,763::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda stats not available >Thread-194::DEBUG::2013-02-28 22:08:37,764::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb stats not available >Thread-194::DEBUG::2013-02-28 22:08:37,764::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk hdc latency not available >Thread-194::DEBUG::2013-02-28 22:08:37,764::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vda latency not available >Thread-194::DEBUG::2013-02-28 22:08:37,764::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdb latency not available >Thread-194::DEBUG::2013-02-28 22:08:37,765::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '17', 'acpiEnable': 'true', 'pid': '18278', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memoryStats': {u'swap_out': '0', u'majflt': '0', u'mem_free': '433848', u'swap_in': '0', u'pageflt': '7', u'mem_total': '502448', u'mem_unused': '382728'}, 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'disksUsage': [{u'path': u'/', u'total': '2778382336', u'used': '728047616', u'fs': u'ext4'}, {u'path': u'/proc/bus/usb', u'total': '0', u'used': '0', u'fs': u'usbfs'}, {u'path': u'/boot', u'total': '507744256', u'used': '33193984', u'fs': u'ext4'}, {u'path': u'/home', u'total': '263987200', u'used': '10502144', u'fs': u'ext4'}], 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:f9', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'displayType': 'qxl', 'guestName': u'vm-162-249.scl.lab.tlv.redhat.com', 'elapsedTime': '61', 'vmType': 'kvm', 'cpuSys': '15.22', 'appsList': [u'kernel-2.6.32-358.el6', u'rhevm-guest-agent-common-1.0.7-4.el6ev'], 'guestOs': u'2.6.32-358.el6.x86_64', 'status': 'Running', 'hash': '3025873655517668991', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'displayIp': '0', 'lastLogout': 1362082056.746104, 'lastUser': 'Unknown', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '2147483648', 'apparentsize': '2147483648', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}, u'vdb': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '19.22', 'cpuUser': '47.85', 'lastLogin': 1362082097.5716939, 'guestIPs': u'10.35.162.249', 'netIfaces': [{u'inet6': [u'fe80::21a:4aff:fe16:81f9'], u'hw': u'00:1a:4a:16:81:f9', u'inet': [u'10.35.162.249'], u'name': u'eth0'}]}]} >Thread-99::DEBUG::2013-02-28 22:08:47,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-196::DEBUG::2013-02-28 22:08:53,712::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmHotplugDisk with ({'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'drive': {'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'device': 'disk', 'shared': 'true', 'propagateErrors': 'off', 'type': 'disk'}},) {} >Thread-196::DEBUG::2013-02-28 22:09:10,031::task::568::TaskManager.Task::(_updateState) Task=`90e468e9-f095-41e9-b56a-f6f2460b8fba`::moving from state init -> state preparing >Thread-196::INFO::2013-02-28 22:09:10,034::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='d7d2fa5b-ce6f-4442-9564-d528b71ea448', volUUID='6fa15b4b-eeda-4f99-af47-bf80af6bb280') >Thread-196::DEBUG::2013-02-28 22:09:10,038::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`a354497b-4c92-43db-be5d-13ef707dcb7b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-196::DEBUG::2013-02-28 22:09:10,039::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'shared' >Thread-196::DEBUG::2013-02-28 22:09:10,041::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'shared' (1 active user) >Thread-196::DEBUG::2013-02-28 22:09:10,042::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`a354497b-4c92-43db-be5d-13ef707dcb7b`::Granted request >Thread-196::DEBUG::2013-02-28 22:09:10,045::task::794::TaskManager.Task::(resourceAcquired) Task=`90e468e9-f095-41e9-b56a-f6f2460b8fba`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (shared) >Thread-196::DEBUG::2013-02-28 22:09:10,046::task::957::TaskManager.Task::(_decref) Task=`90e468e9-f095-41e9-b56a-f6f2460b8fba`::ref 1 aborting False >Thread-99::DEBUG::2013-02-28 22:09:10,048::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000305629 s, 13.4 MB/s\n'; <rc> = 0 >Thread-196::DEBUG::2013-02-28 22:09:10,049::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-196::DEBUG::2013-02-28 22:09:10,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-196::DEBUG::2013-02-28 22:09:10,314::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-196::DEBUG::2013-02-28 22:09:10,327::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-196::DEBUG::2013-02-28 22:09:10,328::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-196::DEBUG::2013-02-28 22:09:10,337::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000295974 s, 1.7 MB/s\n'; <rc> = 0 >Thread-196::DEBUG::2013-02-28 22:09:10,337::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000295974 s, 1.7 MB/s'], size: 512 >Thread-196::INFO::2013-02-28 22:09:10,338::image::345::Storage.Image::(getChain) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc imgUUID=d7d2fa5b-ce6f-4442-9564-d528b71ea448 chain=[<storage.blockVolume.BlockVolume object at 0x20d3210>] >Thread-196::DEBUG::2013-02-28 22:09:10,339::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b7765268-5d28-443d-be93-8dd49837a9cc/6fa15b4b-eeda-4f99-af47-bf80af6bb280' (cwd None) >Thread-196::DEBUG::2013-02-28 22:09:17,308::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-196::DEBUG::2013-02-28 22:09:17,309::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-196::DEBUG::2013-02-28 22:09:17,309::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-196::INFO::2013-02-28 22:09:17,310::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448'}]} >Thread-196::DEBUG::2013-02-28 22:09:17,310::task::1151::TaskManager.Task::(prepare) Task=`90e468e9-f095-41e9-b56a-f6f2460b8fba`::finished: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448'}]} >Thread-196::DEBUG::2013-02-28 22:09:17,310::task::568::TaskManager.Task::(_updateState) Task=`90e468e9-f095-41e9-b56a-f6f2460b8fba`::moving from state preparing -> state finished >Thread-196::DEBUG::2013-02-28 22:09:17,310::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>} >Thread-196::DEBUG::2013-02-28 22:09:17,311::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-196::DEBUG::2013-02-28 22:09:17,311::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-196::DEBUG::2013-02-28 22:09:17,311::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-196::DEBUG::2013-02-28 22:09:17,311::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-196::DEBUG::2013-02-28 22:09:17,312::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-196::DEBUG::2013-02-28 22:09:17,312::task::957::TaskManager.Task::(_decref) Task=`90e468e9-f095-41e9-b56a-f6f2460b8fba`::ref 0 aborting False >Thread-196::INFO::2013-02-28 22:09:17,312::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280 >Thread-196::DEBUG::2013-02-28 22:09:17,312::task::568::TaskManager.Task::(_updateState) Task=`abf54a8d-f3d8-47e6-b033-d45e21105897`::moving from state init -> state preparing >Thread-196::INFO::2013-02-28 22:09:17,313::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='d7d2fa5b-ce6f-4442-9564-d528b71ea448', volUUID='6fa15b4b-eeda-4f99-af47-bf80af6bb280', options=None) >Thread-196::INFO::2013-02-28 22:09:17,313::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-196::DEBUG::2013-02-28 22:09:17,313::task::1151::TaskManager.Task::(prepare) Task=`abf54a8d-f3d8-47e6-b033-d45e21105897`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-196::DEBUG::2013-02-28 22:09:17,314::task::568::TaskManager.Task::(_updateState) Task=`abf54a8d-f3d8-47e6-b033-d45e21105897`::moving from state preparing -> state finished >Thread-196::DEBUG::2013-02-28 22:09:17,314::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-196::DEBUG::2013-02-28 22:09:17,314::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-196::DEBUG::2013-02-28 22:09:17,314::task::957::TaskManager.Task::(_decref) Task=`abf54a8d-f3d8-47e6-b033-d45e21105897`::ref 0 aborting False >Thread-196::DEBUG::2013-02-28 22:09:17,316::libvirtvm::1779::vm.Vm::(hotplugDisk) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Hotplug disk xml: <disk device="disk" snapshot="no" type="block"> > <source dev="/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280"/> > <target bus="virtio" dev="vdc"/> > <shareable/> > <serial>d7d2fa5b-ce6f-4442-9564-d528b71ea448</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> ></disk> > >Thread-198::DEBUG::2013-02-28 22:09:19,416::task::568::TaskManager.Task::(_updateState) Task=`6602bdd7-cfb6-4464-99ea-f3d449b95b8b`::moving from state init -> state preparing >Thread-99::DEBUG::2013-02-28 22:09:20,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-198::INFO::2013-02-28 22:09:26,634::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-198::INFO::2013-02-28 22:09:26,644::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '22.291367054', 'lastCheck': '16.6', 'code': 0, 'valid': True}} >Thread-198::DEBUG::2013-02-28 22:09:26,646::task::1151::TaskManager.Task::(prepare) Task=`6602bdd7-cfb6-4464-99ea-f3d449b95b8b`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '22.291367054', 'lastCheck': '16.6', 'code': 0, 'valid': True}} >Thread-198::DEBUG::2013-02-28 22:09:26,648::task::568::TaskManager.Task::(_updateState) Task=`6602bdd7-cfb6-4464-99ea-f3d449b95b8b`::moving from state preparing -> state finished >Thread-198::DEBUG::2013-02-28 22:09:26,649::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-198::DEBUG::2013-02-28 22:09:26,651::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-198::DEBUG::2013-02-28 22:09:26,653::task::957::TaskManager.Task::(_decref) Task=`6602bdd7-cfb6-4464-99ea-f3d449b95b8b`::ref 0 aborting False >Thread-99::DEBUG::2013-02-28 22:09:26,678::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000437178 s, 9.4 MB/s\n'; <rc> = 0 >Thread-199::DEBUG::2013-02-28 22:09:26,715::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdc stats not available >Thread-199::DEBUG::2013-02-28 22:09:26,717::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Disk vdc latency not available >Thread-196::DEBUG::2013-02-28 22:09:26,733::BindingXMLRPC::920::vds::(wrapper) return vmHotplugDisk with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'pid': '18278', 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'alias': u'sound0', 'specParams': {}, 'deviceId': '684e73fe-4d50-4993-87d9-9b98d2ec07fa', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'ich6', 'type': 'sound'}, {'alias': u'video0', 'specParams': {'vram': '65536'}, 'deviceId': '0ee182f7-f7fe-420b-b579-76cff3203390', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:f9', 'linkActive': True, 'network': 'rhevm', 'alias': u'net0', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '637268c0-a8fb-45c2-bf1e-2b47d1094547', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'target': 524288, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '41ea81eb-56bc-43e4-86d4-fdd9a1ab84a9', 'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '94f976f6-73b3-4d25-898c-0faf68c8f4ef', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '0', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'cow', 'deviceId': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'specParams': {}, 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}]}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '1', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk1', 'imageID': '327503e9-2748-4882-8710-26253129307d', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'cow', 'deviceId': '327503e9-2748-4882-8710-26253129307d', 'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdb', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'specParams': {}, 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '2', 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'readonly': 'False', 'shared': 'true', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'raw', 'deviceId': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'address': {u'slot': u'0x09', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'alias': u'virtio-disk2', 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448'}]}], 'smp': '1', 'vmType': 'kvm', 'memSize': 512, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm_test1', 'display': 'qxl', 'nice': '0'}} >Thread-99::DEBUG::2013-02-28 22:09:36,692::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:09:36,704::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000364781 s, 11.2 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-02-28 22:09:38,139::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmHotunplugDisk with ({'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'drive': {'iface': 'virtio', 'format': 'cow', 'optional': 'false', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d', 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': '327503e9-2748-4882-8710-26253129307d', 'address': {'bus': '0x00', ' slot': '0x07', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}},) {} >Thread-203::DEBUG::2013-02-28 22:09:40,435::task::568::TaskManager.Task::(_updateState) Task=`11831219-a524-442a-9ab1-e71450e0ee28`::moving from state init -> state preparing >Thread-203::INFO::2013-02-28 22:09:40,435::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff') >Thread-203::DEBUG::2013-02-28 22:09:40,436::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`3bd16a61-6b1d-4db3-a9a6-7e69e56cc0ca`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-203::DEBUG::2013-02-28 22:09:40,436::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'shared' >Thread-203::DEBUG::2013-02-28 22:09:40,436::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'shared' (1 active user) >Thread-203::DEBUG::2013-02-28 22:09:43,838::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`3bd16a61-6b1d-4db3-a9a6-7e69e56cc0ca`::Granted request >Thread-203::DEBUG::2013-02-28 22:09:43,839::task::794::TaskManager.Task::(resourceAcquired) Task=`11831219-a524-442a-9ab1-e71450e0ee28`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (shared) >Thread-203::DEBUG::2013-02-28 22:09:43,840::task::957::TaskManager.Task::(_decref) Task=`11831219-a524-442a-9ab1-e71450e0ee28`::ref 1 aborting False >Thread-203::DEBUG::2013-02-28 22:09:43,841::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-203::DEBUG::2013-02-28 22:09:43,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000403891 s, 1.3 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-02-28 22:09:43,851::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000403891 s, 1.3 MB/s'], size: 512 >Thread-203::INFO::2013-02-28 22:09:43,851::image::345::Storage.Image::(getChain) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc imgUUID=327503e9-2748-4882-8710-26253129307d chain=[<storage.blockVolume.BlockVolume object at 0x7fbe8c1c7b90>] >Thread-203::INFO::2013-02-28 22:09:43,852::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]} >Thread-203::DEBUG::2013-02-28 22:09:43,852::task::1151::TaskManager.Task::(prepare) Task=`11831219-a524-442a-9ab1-e71450e0ee28`::finished: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]} >Thread-203::DEBUG::2013-02-28 22:09:43,852::task::568::TaskManager.Task::(_updateState) Task=`11831219-a524-442a-9ab1-e71450e0ee28`::moving from state preparing -> state finished >Thread-203::DEBUG::2013-02-28 22:09:43,853::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>} >Thread-203::DEBUG::2013-02-28 22:09:43,853::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2013-02-28 22:09:43,853::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-203::DEBUG::2013-02-28 22:09:43,854::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-203::DEBUG::2013-02-28 22:09:43,854::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-203::DEBUG::2013-02-28 22:09:43,855::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-203::DEBUG::2013-02-28 22:09:43,855::task::957::TaskManager.Task::(_decref) Task=`11831219-a524-442a-9ab1-e71450e0ee28`::ref 0 aborting False >Thread-203::INFO::2013-02-28 22:09:43,855::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff >Thread-203::DEBUG::2013-02-28 22:09:43,858::libvirtvm::1819::vm.Vm::(hotunplugDisk) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Hotunplug disk xml: <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x07" type="pci"/> > <source dev="/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff"/> > <target bus="virtio" dev="vdb"/> > <serial>327503e9-2748-4882-8710-26253129307d</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> ></disk> > >Thread-99::DEBUG::2013-02-28 22:09:46,707::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:09:46,717::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000365152 s, 11.2 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-02-28 22:09:48,447::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >Thread-203::DEBUG::2013-02-28 22:09:48,513::BindingXMLRPC::920::vds::(wrapper) return vmHotunplugDisk with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'pid': '18278', 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'alias': u'sound0', 'specParams': {}, 'deviceId': '684e73fe-4d50-4993-87d9-9b98d2ec07fa', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'ich6', 'type': 'sound'}, {'alias': u'video0', 'specParams': {'vram': '65536'}, 'deviceId': '0ee182f7-f7fe-420b-b579-76cff3203390', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:f9', 'linkActive': True, 'network': 'rhevm', 'alias': u'net0', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '637268c0-a8fb-45c2-bf1e-2b47d1094547', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'target': 524288, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '41ea81eb-56bc-43e4-86d4-fdd9a1ab84a9', 'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '94f976f6-73b3-4d25-898c-0faf68c8f4ef', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '0', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'cow', 'deviceId': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'specParams': {}, 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '2', 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'readonly': 'False', 'shared': 'true', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'raw', 'deviceId': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'address': {u'slot': u'0x09', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'alias': u'virtio-disk2', 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448'}]}], 'smp': '1', 'vmType': 'kvm', 'memSize': 512, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm_test1', 'display': 'qxl', 'nice': '0'}} >VM Channels Listener::DEBUG::2013-02-28 22:09:49,002::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Thread-204::DEBUG::2013-02-28 22:09:49,475::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmHotunplugDisk with ({'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'drive': {'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448', 'address': {'bus': '0x00', ' slot': '0x09', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'true', 'propagateErrors': 'off', 'type': 'disk'}},) {} >Thread-204::DEBUG::2013-02-28 22:09:49,476::task::568::TaskManager.Task::(_updateState) Task=`a1da8475-6057-45ee-95f6-78a5ed7062d8`::moving from state init -> state preparing >Thread-204::INFO::2013-02-28 22:09:49,476::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='d7d2fa5b-ce6f-4442-9564-d528b71ea448', volUUID='6fa15b4b-eeda-4f99-af47-bf80af6bb280') >Thread-204::DEBUG::2013-02-28 22:09:49,477::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`4647a248-f19b-42c4-aac4-6e4ad01def99`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-204::DEBUG::2013-02-28 22:09:49,477::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'shared' >Thread-204::DEBUG::2013-02-28 22:09:49,477::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'shared' (1 active user) >Thread-204::DEBUG::2013-02-28 22:09:49,478::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`4647a248-f19b-42c4-aac4-6e4ad01def99`::Granted request >Thread-204::DEBUG::2013-02-28 22:09:49,478::task::794::TaskManager.Task::(resourceAcquired) Task=`a1da8475-6057-45ee-95f6-78a5ed7062d8`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (shared) >Thread-204::DEBUG::2013-02-28 22:09:49,478::task::957::TaskManager.Task::(_decref) Task=`a1da8475-6057-45ee-95f6-78a5ed7062d8`::ref 1 aborting False >Thread-204::DEBUG::2013-02-28 22:09:49,479::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-204::DEBUG::2013-02-28 22:09:49,480::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-204::DEBUG::2013-02-28 22:09:49,765::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-204::DEBUG::2013-02-28 22:09:49,781::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-204::DEBUG::2013-02-28 22:09:49,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-204::DEBUG::2013-02-28 22:09:49,790::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000332015 s, 1.5 MB/s\n'; <rc> = 0 >Thread-204::DEBUG::2013-02-28 22:09:49,791::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000332015 s, 1.5 MB/s'], size: 512 >Thread-204::INFO::2013-02-28 22:09:49,791::image::345::Storage.Image::(getChain) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc imgUUID=d7d2fa5b-ce6f-4442-9564-d528b71ea448 chain=[<storage.blockVolume.BlockVolume object at 0x7fbe5c1f6910>] >Thread-204::INFO::2013-02-28 22:09:49,793::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448'}]} >Thread-204::DEBUG::2013-02-28 22:09:49,793::task::1151::TaskManager.Task::(prepare) Task=`a1da8475-6057-45ee-95f6-78a5ed7062d8`::finished: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6fa15b4b-eeda-4f99-af47-bf80af6bb280', 'imageID': 'd7d2fa5b-ce6f-4442-9564-d528b71ea448'}]} >Thread-204::DEBUG::2013-02-28 22:09:49,794::task::568::TaskManager.Task::(_updateState) Task=`a1da8475-6057-45ee-95f6-78a5ed7062d8`::moving from state preparing -> state finished >Thread-204::DEBUG::2013-02-28 22:09:49,794::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>} >Thread-204::DEBUG::2013-02-28 22:09:49,794::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2013-02-28 22:09:49,795::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-204::DEBUG::2013-02-28 22:09:49,795::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-204::DEBUG::2013-02-28 22:09:49,796::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-204::DEBUG::2013-02-28 22:09:49,796::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-204::DEBUG::2013-02-28 22:09:49,796::task::957::TaskManager.Task::(_decref) Task=`a1da8475-6057-45ee-95f6-78a5ed7062d8`::ref 0 aborting False >Thread-204::INFO::2013-02-28 22:09:49,797::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280 >Thread-204::DEBUG::2013-02-28 22:09:49,799::libvirtvm::1819::vm.Vm::(hotunplugDisk) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Hotunplug disk xml: <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x09" type="pci"/> > <source dev="/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/d7d2fa5b-ce6f-4442-9564-d528b71ea448/6fa15b4b-eeda-4f99-af47-bf80af6bb280"/> > <target bus="virtio" dev="vdc"/> > <shareable/> > <serial>d7d2fa5b-ce6f-4442-9564-d528b71ea448</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> ></disk> > >Thread-204::DEBUG::2013-02-28 22:09:49,913::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >Thread-204::DEBUG::2013-02-28 22:09:49,914::BindingXMLRPC::920::vds::(wrapper) return vmHotunplugDisk with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'pid': '18278', 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'alias': u'sound0', 'specParams': {}, 'deviceId': '684e73fe-4d50-4993-87d9-9b98d2ec07fa', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'ich6', 'type': 'sound'}, {'alias': u'video0', 'specParams': {'vram': '65536'}, 'deviceId': '0ee182f7-f7fe-420b-b579-76cff3203390', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:f9', 'linkActive': True, 'network': 'rhevm', 'alias': u'net0', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '637268c0-a8fb-45c2-bf1e-2b47d1094547', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'target': 524288, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '41ea81eb-56bc-43e4-86d4-fdd9a1ab84a9', 'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '94f976f6-73b3-4d25-898c-0faf68c8f4ef', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '0', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'cow', 'deviceId': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'specParams': {}, 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '1', 'vmType': 'kvm', 'memSize': 512, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm_test1', 'display': 'qxl', 'nice': '0'}} >VM Channels Listener::DEBUG::2013-02-28 22:09:50,003::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Thread-206::DEBUG::2013-02-28 22:09:52,170::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmHotplugDisk with ({'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'drive': {'iface': 'virtio', 'format': 'cow', 'optional': 'false', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d', 'readonly': 'false', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'deviceId': '327503e9-2748-4882-8710-26253129307d', 'address': {'bus': '0x00', ' slot': '0x07', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}},) {} >Thread-206::DEBUG::2013-02-28 22:09:52,172::task::568::TaskManager.Task::(_updateState) Task=`d161e82d-23e9-4865-9353-91daf926d201`::moving from state init -> state preparing >Thread-206::INFO::2013-02-28 22:09:52,172::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff') >Thread-206::DEBUG::2013-02-28 22:09:52,173::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`1a668191-1871-4015-900c-4b8e9448ad8a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-206::DEBUG::2013-02-28 22:09:52,173::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' for lock type 'shared' >Thread-206::DEBUG::2013-02-28 22:09:52,173::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free. Now locking as 'shared' (1 active user) >Thread-206::DEBUG::2013-02-28 22:09:52,173::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b7765268-5d28-443d-be93-8dd49837a9cc`ReqID=`1a668191-1871-4015-900c-4b8e9448ad8a`::Granted request >Thread-206::DEBUG::2013-02-28 22:09:52,174::task::794::TaskManager.Task::(resourceAcquired) Task=`d161e82d-23e9-4865-9353-91daf926d201`::_resourcesAcquired: Storage.b7765268-5d28-443d-be93-8dd49837a9cc (shared) >Thread-206::DEBUG::2013-02-28 22:09:52,174::task::957::TaskManager.Task::(_decref) Task=`d161e82d-23e9-4865-9353-91daf926d201`::ref 1 aborting False >Thread-206::DEBUG::2013-02-28 22:09:52,174::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-206::DEBUG::2013-02-28 22:09:52,181::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000775261 s, 660 kB/s\n'; <rc> = 0 >Thread-206::DEBUG::2013-02-28 22:09:52,182::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000775261 s, 660 kB/s'], size: 512 >Thread-206::INFO::2013-02-28 22:09:52,182::image::345::Storage.Image::(getChain) sdUUID=b7765268-5d28-443d-be93-8dd49837a9cc imgUUID=327503e9-2748-4882-8710-26253129307d chain=[<storage.blockVolume.BlockVolume object at 0x7fbe5c1f6950>] >Thread-206::INFO::2013-02-28 22:09:52,182::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]} >Thread-206::DEBUG::2013-02-28 22:09:52,187::task::1151::TaskManager.Task::(prepare) Task=`d161e82d-23e9-4865-9353-91daf926d201`::finished: {'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'chain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]} >Thread-206::DEBUG::2013-02-28 22:09:52,187::task::568::TaskManager.Task::(_updateState) Task=`d161e82d-23e9-4865-9353-91daf926d201`::moving from state preparing -> state finished >Thread-206::DEBUG::2013-02-28 22:09:52,188::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b7765268-5d28-443d-be93-8dd49837a9cc': < ResourceRef 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', isValid: 'True' obj: 'None'>} >Thread-206::DEBUG::2013-02-28 22:09:52,188::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-206::DEBUG::2013-02-28 22:09:52,188::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' >Thread-206::DEBUG::2013-02-28 22:09:52,189::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' (0 active users) >Thread-206::DEBUG::2013-02-28 22:09:52,189::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc' is free, finding out if anyone is waiting for it. >Thread-206::DEBUG::2013-02-28 22:09:52,189::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b7765268-5d28-443d-be93-8dd49837a9cc', Clearing records. >Thread-206::DEBUG::2013-02-28 22:09:52,190::task::957::TaskManager.Task::(_decref) Task=`d161e82d-23e9-4865-9353-91daf926d201`::ref 0 aborting False >Thread-206::INFO::2013-02-28 22:09:52,190::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff >Thread-206::DEBUG::2013-02-28 22:09:52,190::task::568::TaskManager.Task::(_updateState) Task=`633dfea9-2fa9-40cf-ad86-dbcb49530b5f`::moving from state init -> state preparing >Thread-206::INFO::2013-02-28 22:09:52,190::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', imgUUID='327503e9-2748-4882-8710-26253129307d', volUUID='21edebf6-8c88-41fd-aa21-825b8ebd47ff', options=None) >Thread-206::INFO::2013-02-28 22:09:52,191::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-206::DEBUG::2013-02-28 22:09:52,191::task::1151::TaskManager.Task::(prepare) Task=`633dfea9-2fa9-40cf-ad86-dbcb49530b5f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-206::DEBUG::2013-02-28 22:09:52,191::task::568::TaskManager.Task::(_updateState) Task=`633dfea9-2fa9-40cf-ad86-dbcb49530b5f`::moving from state preparing -> state finished >Thread-206::DEBUG::2013-02-28 22:09:52,191::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-206::DEBUG::2013-02-28 22:09:52,192::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-206::DEBUG::2013-02-28 22:09:52,192::task::957::TaskManager.Task::(_decref) Task=`633dfea9-2fa9-40cf-ad86-dbcb49530b5f`::ref 0 aborting False >Thread-206::DEBUG::2013-02-28 22:09:52,193::libvirtvm::1779::vm.Vm::(hotplugDisk) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Hotplug disk xml: <disk device="disk" snapshot="no" type="block"> > <address domain="0x0000" function="0x0" slot="0x07" type="pci" bus="0x00"/> > <source dev="/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff"/> > <target bus="virtio" dev="vdd"/> > <serial>327503e9-2748-4882-8710-26253129307d</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> ></disk> > >Thread-206::DEBUG::2013-02-28 22:09:52,507::BindingXMLRPC::920::vds::(wrapper) return vmHotplugDisk with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'vmId': '06f93b88-853f-4b80-88ee-834da856316d', 'pid': '18278', 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'alias': u'sound0', 'specParams': {}, 'deviceId': '684e73fe-4d50-4993-87d9-9b98d2ec07fa', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'ich6', 'type': 'sound'}, {'alias': u'video0', 'specParams': {'vram': '65536'}, 'deviceId': '0ee182f7-f7fe-420b-b579-76cff3203390', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:f9', 'linkActive': True, 'network': 'rhevm', 'alias': u'net0', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '637268c0-a8fb-45c2-bf1e-2b47d1094547', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'target': 524288, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '41ea81eb-56bc-43e4-86d4-fdd9a1ab84a9', 'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '94f976f6-73b3-4d25-898c-0faf68c8f4ef', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'index': '0', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'cow', 'deviceId': 'bed96b16-65fe-4281-9bdc-3661d6b826b9', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'specParams': {}, 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/bed96b16-65fe-4281-9bdc-3661d6b826b9/6ceb99ca-1a46-473b-be36-f9d526087781', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '6ceb99ca-1a46-473b-be36-f9d526087781', 'imageID': 'bed96b16-65fe-4281-9bdc-3661d6b826b9'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}, {'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'index': '3', 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': '327503e9-2748-4882-8710-26253129307d', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'reqsize': '0', 'format': 'cow', 'deviceId': '327503e9-2748-4882-8710-26253129307d', 'poolID': '8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'device': 'disk', 'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdd', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'alias': u'virtio-disk3', 'volumeChain': [{'path': '/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc/images/327503e9-2748-4882-8710-26253129307d/21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'domainID': 'b7765268-5d28-443d-be93-8dd49837a9cc', 'volumeID': '21edebf6-8c88-41fd-aa21-825b8ebd47ff', 'imageID': '327503e9-2748-4882-8710-26253129307d'}]}], 'smp': '1', 'vmType': 'kvm', 'memSize': 512, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm_test1', 'display': 'qxl', 'nice': '0'}} >Thread-208::DEBUG::2013-02-28 22:09:54,857::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call vmDestroy with ('06f93b88-853f-4b80-88ee-834da856316d',) {} >Thread-208::INFO::2013-02-28 22:09:54,857::API::309::vds::(destroy) vmContainerLock acquired by vm 06f93b88-853f-4b80-88ee-834da856316d >Thread-208::DEBUG::2013-02-28 22:09:54,857::libvirtvm::2599::vm.Vm::(destroy) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::destroy Called >Thread-208::INFO::2013-02-28 22:09:54,858::libvirtvm::2548::vm.Vm::(releaseVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Release VM resources >Thread-208::DEBUG::2013-02-28 22:09:54,871::utils::353::vm.Vm::(stop) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Stop statistics collection >Thread-208::DEBUG::2013-02-28 22:09:54,871::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >Thread-155::DEBUG::2013-02-28 22:09:54,871::utils::384::vm.Vm::(run) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Stats thread finished >VM Channels Listener::DEBUG::2013-02-28 22:09:55,009::vmChannels::82::vds::(_do_del_channels) [Errno 2] No such file or directory (unregister was called twice?) >VM Channels Listener::DEBUG::2013-02-28 22:09:55,010::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Thread-99::DEBUG::2013-02-28 22:09:56,721::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:10:12,279::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000301935 s, 13.6 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2013-02-28 22:10:13,824::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Shutdown detail 0 opaque None >Thread-208::WARNING::2013-02-28 22:10:13,832::libvirtvm::2565::vm.Vm::(releaseVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Failed to destroy VM '06f93b88-853f-4b80-88ee-834da856316d' gracefully >libvirtEventLoop::DEBUG::2013-02-28 22:10:14,394::libvirtvm::3014::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::event Stopped detail 0 opaque None >libvirtEventLoop::INFO::2013-02-28 22:10:14,394::vm::733::vm.Vm::(_onQemuDeath) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::underlying process disconnected >Thread-99::DEBUG::2013-02-28 22:10:22,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 22:10:32,027::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000423586 s, 9.7 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:10:42,032::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-208::WARNING::2013-02-28 22:10:46,022::libvirtvm::2570::vm.Vm::(releaseVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::libvirt domain not found >Traceback (most recent call last): > File "/usr/share/vdsm/libvirtvm.py", line 2567, in releaseVm > self._dom.destroy() > File "/usr/share/vdsm/libvirtvm.py", line 540, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 104, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 730, in destroy > if ret == -1: raise libvirtError ('virDomainDestroy() failed', dom=self) >libvirtError: Domain not found: no domain with matching uuid '06f93b88-853f-4b80-88ee-834da856316d' >Thread-208::DEBUG::2013-02-28 22:10:46,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >Thread-99::DEBUG::2013-02-28 22:10:46,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000334746 s, 12.2 MB/s\n'; <rc> = 0 >Thread-208::DEBUG::2013-02-28 22:10:46,090::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-208::DEBUG::2013-02-28 22:10:46,090::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >Thread-208::DEBUG::2013-02-28 22:10:46,091::task::568::TaskManager.Task::(_updateState) Task=`4e5527be-fe3e-436d-a7c1-5cbe4b1a19ed`::moving from state init -> state preparing >Thread-208::INFO::2013-02-28 22:10:46,092::logUtils::37::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='06f93b88-853f-4b80-88ee-834da856316d') >Thread-208::INFO::2013-02-28 22:10:46,095::logUtils::39::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-208::DEBUG::2013-02-28 22:10:46,095::task::1151::TaskManager.Task::(prepare) Task=`4e5527be-fe3e-436d-a7c1-5cbe4b1a19ed`::finished: None >Thread-208::DEBUG::2013-02-28 22:10:46,095::task::568::TaskManager.Task::(_updateState) Task=`4e5527be-fe3e-436d-a7c1-5cbe4b1a19ed`::moving from state preparing -> state finished >Thread-208::DEBUG::2013-02-28 22:10:46,096::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-208::DEBUG::2013-02-28 22:10:46,096::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-208::DEBUG::2013-02-28 22:10:46,096::task::957::TaskManager.Task::(_decref) Task=`4e5527be-fe3e-436d-a7c1-5cbe4b1a19ed`::ref 0 aborting False >Thread-208::DEBUG::2013-02-28 22:10:46,097::libvirtvm::2593::vm.Vm::(deleteVm) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Total desktops after destroy of 06f93b88-853f-4b80-88ee-834da856316d is 0 >Thread-208::DEBUG::2013-02-28 22:10:46,097::BindingXMLRPC::920::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2013-02-28 22:10:46,102::vm::1047::vm.Vm::(setDownStatus) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2013-02-28 22:10:46,102::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >libvirtEventLoop::DEBUG::2013-02-28 22:10:46,102::utils::353::vm.Vm::(stop) vmId=`06f93b88-853f-4b80-88ee-834da856316d`::Stop statistics collection >Thread-209::DEBUG::2013-02-28 22:10:46,215::task::568::TaskManager.Task::(_updateState) Task=`fa8e06f5-5708-4916-a7ba-8a43f9d5fc54`::moving from state init -> state preparing >Thread-209::INFO::2013-02-28 22:10:46,215::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-209::INFO::2013-02-28 22:10:46,215::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '4.02099990845', 'lastCheck': '0.2', 'code': 0, 'valid': True}} >Thread-209::DEBUG::2013-02-28 22:10:46,216::task::1151::TaskManager.Task::(prepare) Task=`fa8e06f5-5708-4916-a7ba-8a43f9d5fc54`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '4.02099990845', 'lastCheck': '0.2', 'code': 0, 'valid': True}} >Thread-209::DEBUG::2013-02-28 22:10:46,216::task::568::TaskManager.Task::(_updateState) Task=`fa8e06f5-5708-4916-a7ba-8a43f9d5fc54`::moving from state preparing -> state finished >Thread-209::DEBUG::2013-02-28 22:10:46,216::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-209::DEBUG::2013-02-28 22:10:46,217::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-209::DEBUG::2013-02-28 22:10:46,217::task::957::TaskManager.Task::(_decref) Task=`fa8e06f5-5708-4916-a7ba-8a43f9d5fc54`::ref 0 aborting False >VM Channels Listener::DEBUG::2013-02-28 22:10:47,075::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Thread-99::DEBUG::2013-02-28 22:10:56,055::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2013-02-28 22:11:02,576::vmChannels::82::vds::(_do_del_channels) [Errno 2] No such file or directory (unregister was called twice?) >VM Channels Listener::DEBUG::2013-02-28 22:11:02,583::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Thread-99::DEBUG::2013-02-28 22:11:02,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000408469 s, 10.0 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:11:12,591::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-213::DEBUG::2013-02-28 22:11:25,857::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-213::DEBUG::2013-02-28 22:11:27,934::task::568::TaskManager.Task::(_updateState) Task=`b36be15e-e45f-4f79-8d7c-9c42396913e1`::moving from state init -> state preparing >Thread-213::INFO::2013-02-28 22:11:27,937::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', hostID=1, scsiKey='8afb550a-e69f-41d1-bcbe-7813fdda3b72', remove=False, options=None) >Thread-213::DEBUG::2013-02-28 22:11:27,941::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`10bfaf5b-fc81-45ab-9245-7afefd6c9df8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-213::DEBUG::2013-02-28 22:11:27,942::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' for lock type 'exclusive' >Thread-213::DEBUG::2013-02-28 22:11:27,944::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free. Now locking as 'exclusive' (1 active user) >Thread-213::DEBUG::2013-02-28 22:11:27,946::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`10bfaf5b-fc81-45ab-9245-7afefd6c9df8`::Granted request >Thread-213::DEBUG::2013-02-28 22:11:27,949::task::794::TaskManager.Task::(resourceAcquired) Task=`b36be15e-e45f-4f79-8d7c-9c42396913e1`::_resourcesAcquired: Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72 (exclusive) >Thread-213::DEBUG::2013-02-28 22:11:27,950::task::957::TaskManager.Task::(_decref) Task=`b36be15e-e45f-4f79-8d7c-9c42396913e1`::ref 1 aborting False >Thread-213::INFO::2013-02-28 22:11:27,951::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 >Thread-99::DEBUG::2013-02-28 22:11:27,953::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000385738 s, 10.6 MB/s\n'; <rc> = 0 >Thread-128::INFO::2013-02-28 22:11:28,444::storage_mailbox::447::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-99::DEBUG::2013-02-28 22:11:37,957::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-128::INFO::2013-02-28 22:11:53,577::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-128::DEBUG::2013-02-28 22:11:53,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-99::DEBUG::2013-02-28 22:11:53,601::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000411394 s, 10.0 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 22:11:53,603::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for b7765268-5d28-443d-be93-8dd49837a9cc >Thread-99::INFO::2013-02-28 22:11:53,603::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 1) >Thread-99::DEBUG::2013-02-28 22:11:55,604::clusterlock::205::SANLock::(releaseHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc released successfully (id: 1) >Thread-213::INFO::2013-02-28 22:12:02,132::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-213::DEBUG::2013-02-28 22:12:02,133::task::1151::TaskManager.Task::(prepare) Task=`b36be15e-e45f-4f79-8d7c-9c42396913e1`::finished: True >Thread-213::DEBUG::2013-02-28 22:12:02,134::task::568::TaskManager.Task::(_updateState) Task=`b36be15e-e45f-4f79-8d7c-9c42396913e1`::moving from state preparing -> state finished >Thread-213::DEBUG::2013-02-28 22:12:02,134::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72': < ResourceRef 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', isValid: 'True' obj: 'None'>} >Thread-213::DEBUG::2013-02-28 22:12:02,135::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-213::DEBUG::2013-02-28 22:12:02,135::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' >Thread-213::DEBUG::2013-02-28 22:12:02,136::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' (0 active users) >Thread-213::DEBUG::2013-02-28 22:12:02,136::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free, finding out if anyone is waiting for it. >Thread-213::DEBUG::2013-02-28 22:12:02,136::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', Clearing records. >Thread-213::DEBUG::2013-02-28 22:12:02,137::task::957::TaskManager.Task::(_decref) Task=`b36be15e-e45f-4f79-8d7c-9c42396913e1`::ref 0 aborting False >Thread-216::DEBUG::2013-02-28 22:12:02,263::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-216::DEBUG::2013-02-28 22:12:02,263::task::568::TaskManager.Task::(_updateState) Task=`8365b1a3-ce37-47e1-a3e9-39254eefeb9a`::moving from state init -> state preparing >Thread-216::INFO::2013-02-28 22:12:02,264::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >MainProcess|Thread-216::ERROR::2013-02-28 22:12:02,265::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-216::DEBUG::2013-02-28 22:12:02,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 1 -u' (cwd None) >Thread-216::DEBUG::2013-02-28 22:12:02,873::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-216::DEBUG::2013-02-28 22:12:03,121::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-216::DEBUG::2013-02-28 22:12:03,122::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-216::DEBUG::2013-02-28 22:12:03,122::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-216::DEBUG::2013-02-28 22:12:03,122::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-216::DEBUG::2013-02-28 22:12:03,122::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-216::DEBUG::2013-02-28 22:12:03,142::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-216::DEBUG::2013-02-28 22:12:03,143::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:03,143::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:04,147::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-217::DEBUG::2013-02-28 22:12:05,196::task::568::TaskManager.Task::(_updateState) Task=`daee8241-3754-4dcc-bfd5-267ebd3ccc07`::moving from state init -> state preparing >Thread-217::INFO::2013-02-28 22:12:05,203::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-217::INFO::2013-02-28 22:12:05,203::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-217::DEBUG::2013-02-28 22:12:05,204::task::1151::TaskManager.Task::(prepare) Task=`daee8241-3754-4dcc-bfd5-267ebd3ccc07`::finished: {} >Thread-217::DEBUG::2013-02-28 22:12:05,204::task::568::TaskManager.Task::(_updateState) Task=`daee8241-3754-4dcc-bfd5-267ebd3ccc07`::moving from state preparing -> state finished >Thread-217::DEBUG::2013-02-28 22:12:05,204::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-217::DEBUG::2013-02-28 22:12:05,205::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-217::DEBUG::2013-02-28 22:12:05,205::task::957::TaskManager.Task::(_decref) Task=`daee8241-3754-4dcc-bfd5-267ebd3ccc07`::ref 0 aborting False >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:05,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:05,288::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:06,300::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:07,304::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-216::DEBUG::2013-02-28 22:12:08,312::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-216::DEBUG::2013-02-28 22:12:10,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-216::DEBUG::2013-02-28 22:12:29,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-216::DEBUG::2013-02-28 22:12:29,593::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-216::DEBUG::2013-02-28 22:12:29,593::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-216::DEBUG::2013-02-28 22:12:29,593::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-216::DEBUG::2013-02-28 22:12:29,594::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-216::DEBUG::2013-02-28 22:12:29,594::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-216::DEBUG::2013-02-28 22:12:29,595::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-216::DEBUG::2013-02-28 22:12:29,595::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-216::INFO::2013-02-28 22:12:29,595::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-216::DEBUG::2013-02-28 22:12:29,595::task::1151::TaskManager.Task::(prepare) Task=`8365b1a3-ce37-47e1-a3e9-39254eefeb9a`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-216::DEBUG::2013-02-28 22:12:29,596::task::568::TaskManager.Task::(_updateState) Task=`8365b1a3-ce37-47e1-a3e9-39254eefeb9a`::moving from state preparing -> state finished >Thread-216::DEBUG::2013-02-28 22:12:29,596::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-216::DEBUG::2013-02-28 22:12:29,596::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2013-02-28 22:12:29,597::task::957::TaskManager.Task::(_decref) Task=`8365b1a3-ce37-47e1-a3e9-39254eefeb9a`::ref 0 aborting False >Thread-223::DEBUG::2013-02-28 22:12:35,445::task::568::TaskManager.Task::(_updateState) Task=`ab2b24e8-3843-4b6a-82ad-96ede63dd0e0`::moving from state init -> state preparing >Thread-224::DEBUG::2013-02-28 22:12:45,788::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-223::INFO::2013-02-28 22:12:49,386::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-223::INFO::2013-02-28 22:12:49,386::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-223::DEBUG::2013-02-28 22:12:49,386::task::1151::TaskManager.Task::(prepare) Task=`ab2b24e8-3843-4b6a-82ad-96ede63dd0e0`::finished: {} >Thread-224::DEBUG::2013-02-28 22:12:49,387::task::568::TaskManager.Task::(_updateState) Task=`e18049b4-d465-4a2c-96c4-2fea73c07f09`::moving from state init -> state preparing >Thread-223::DEBUG::2013-02-28 22:12:49,387::task::568::TaskManager.Task::(_updateState) Task=`ab2b24e8-3843-4b6a-82ad-96ede63dd0e0`::moving from state preparing -> state finished >Thread-224::INFO::2013-02-28 22:12:49,387::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-223::DEBUG::2013-02-28 22:12:49,387::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-223::DEBUG::2013-02-28 22:12:49,388::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-224::DEBUG::2013-02-28 22:12:49,388::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-223::DEBUG::2013-02-28 22:12:49,388::task::957::TaskManager.Task::(_decref) Task=`ab2b24e8-3843-4b6a-82ad-96ede63dd0e0`::ref 0 aborting False >Thread-224::DEBUG::2013-02-28 22:12:49,413::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-224::DEBUG::2013-02-28 22:12:49,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-224::DEBUG::2013-02-28 22:12:49,997::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-224::DEBUG::2013-02-28 22:12:49,998::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-224::DEBUG::2013-02-28 22:12:50,028::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-224::INFO::2013-02-28 22:12:50,029::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-224::DEBUG::2013-02-28 22:12:50,029::task::1151::TaskManager.Task::(prepare) Task=`e18049b4-d465-4a2c-96c4-2fea73c07f09`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-224::DEBUG::2013-02-28 22:12:50,030::task::568::TaskManager.Task::(_updateState) Task=`e18049b4-d465-4a2c-96c4-2fea73c07f09`::moving from state preparing -> state finished >Thread-224::DEBUG::2013-02-28 22:12:50,030::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-224::DEBUG::2013-02-28 22:12:50,030::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-224::DEBUG::2013-02-28 22:12:50,031::task::957::TaskManager.Task::(_decref) Task=`e18049b4-d465-4a2c-96c4-2fea73c07f09`::ref 0 aborting False >Thread-226::DEBUG::2013-02-28 22:12:50,068::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-226::DEBUG::2013-02-28 22:12:50,069::task::568::TaskManager.Task::(_updateState) Task=`c19029f3-b7cc-4c51-beab-e556b0a8be39`::moving from state init -> state preparing >Thread-226::INFO::2013-02-28 22:12:50,069::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', hostID=1, scsiKey='8afb550a-e69f-41d1-bcbe-7813fdda3b72', msdUUID='b7765268-5d28-443d-be93-8dd49837a9cc', masterVersion=1, options=None) >Thread-226::DEBUG::2013-02-28 22:12:50,070::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`66a562c9-5061-4e99-b70b-9b9454b9a24b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-226::DEBUG::2013-02-28 22:12:50,070::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' for lock type 'exclusive' >Thread-226::DEBUG::2013-02-28 22:12:50,071::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free. Now locking as 'exclusive' (1 active user) >Thread-226::DEBUG::2013-02-28 22:12:50,071::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`66a562c9-5061-4e99-b70b-9b9454b9a24b`::Granted request >Thread-226::INFO::2013-02-28 22:12:50,072::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 with master domain: b7765268-5d28-443d-be93-8dd49837a9cc (ver = 1) >Thread-226::DEBUG::2013-02-28 22:12:50,073::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:12:50,074::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:12:50,074::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:12:50,074::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:12:50,075::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:12:50,075::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:12:50,076::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-226::DEBUG::2013-02-28 22:12:50,076::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-226::DEBUG::2013-02-28 22:12:50,076::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-226::DEBUG::2013-02-28 22:12:50,077::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-226::DEBUG::2013-02-28 22:12:50,077::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-226::DEBUG::2013-02-28 22:12:50,130::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:12:50,131::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:50,133::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:51,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:51,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:51,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:51,168::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:51,171::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:52,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host7/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:52,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host8/scan' (cwd None) >MainProcess|Thread-226::DEBUG::2013-02-28 22:12:53,192::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-226::DEBUG::2013-02-28 22:12:55,249::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:04,415::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:04,415::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,421::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,421::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,421::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,422::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,422::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,422::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-226::DEBUG::2013-02-28 22:13:04,423::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:04,426::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-231::DEBUG::2013-02-28 22:13:05,355::task::568::TaskManager.Task::(_updateState) Task=`87f348c9-9d48-4fa3-ab13-348d31ac347a`::moving from state init -> state preparing >Thread-231::INFO::2013-02-28 22:13:05,362::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-231::INFO::2013-02-28 22:13:05,362::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-231::DEBUG::2013-02-28 22:13:05,362::task::1151::TaskManager.Task::(prepare) Task=`87f348c9-9d48-4fa3-ab13-348d31ac347a`::finished: {} >Thread-231::DEBUG::2013-02-28 22:13:05,362::task::568::TaskManager.Task::(_updateState) Task=`87f348c9-9d48-4fa3-ab13-348d31ac347a`::moving from state preparing -> state finished >Thread-231::DEBUG::2013-02-28 22:13:05,362::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-231::DEBUG::2013-02-28 22:13:05,363::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-231::DEBUG::2013-02-28 22:13:05,363::task::957::TaskManager.Task::(_decref) Task=`87f348c9-9d48-4fa3-ab13-348d31ac347a`::ref 0 aborting False >Thread-226::DEBUG::2013-02-28 22:13:05,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:05,460::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,461::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-226::DEBUG::2013-02-28 22:13:05,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata count=1' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:05,468::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000290517 s, 7.0 MB/s\n'; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:05,469::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000290517 s, 7.0 MB/s'], size: 2048 >Thread-226::DEBUG::2013-02-28 22:13:05,469::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-226::WARNING::2013-02-28 22:13:05,469::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-226::DEBUG::2013-02-28 22:13:05,474::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-226::DEBUG::2013-02-28 22:13:05,475::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,475::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,475::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,475::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,476::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,476::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:05,702::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:05,705::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,711::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=a2ff5e487432f55d682fea8e4d1e71cce14e2b76'] >Thread-226::DEBUG::2013-02-28 22:13:05,712::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,712::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:05,927::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:05,927::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-226::WARNING::2013-02-28 22:13:05,928::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_imageNS already registered >Thread-226::WARNING::2013-02-28 22:13:05,928::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_volumeNS already registered >Thread-226::WARNING::2013-02-28 22:13:05,928::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b7765268-5d28-443d-be93-8dd49837a9cc_lvmActivationNS already registered >Thread-226::DEBUG::2013-02-28 22:13:05,929::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain b7765268-5d28-443d-be93-8dd49837a9cc verified, version 1 >Thread-226::DEBUG::2013-02-28 22:13:05,929::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-226::DEBUG::2013-02-28 22:13:05,929::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-226::DEBUG::2013-02-28 22:13:05,929::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,930::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,930::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,930::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,930::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:05,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:06,129::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:06,131::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:06,132::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=b7765268-5d28-443d-be93-8dd49837a9cc', 'LOGBLKSIZE=512', 'VGUUID=STTE0M-w327-m7sA-cRw0-rqoh-uoQK-MuQMlT', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', u'PV0=pv:3514f0c542a000482,uuid:3JhT2V-7FwD-TKIB-6rRA-07A0-dYd0-nQCpez,pestart:0,pecount:237,mapoffset:0', 'CLASS=Data', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=8afb550a-e69f-41d1-bcbe-7813fdda3b72', 'POOL_DOMAINS=b7765268-5d28-443d-be93-8dd49837a9cc:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=a2ff5e487432f55d682fea8e4d1e71cce14e2b76'] >Thread-226::DEBUG::2013-02-28 22:13:06,133::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8afb550a-e69f-41d1-bcbe-7813fdda3b72` started monitoring domain `b7765268-5d28-443d-be93-8dd49837a9cc` >Thread-233::DEBUG::2013-02-28 22:13:06,133::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for b7765268-5d28-443d-be93-8dd49837a9cc >Thread-226::DEBUG::2013-02-28 22:13:06,134::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-233::DEBUG::2013-02-28 22:13:06,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:06,143::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-226::DEBUG::2013-02-28 22:13:06,144::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-233::DEBUG::2013-02-28 22:13:06,335::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-233::DEBUG::2013-02-28 22:13:06,336::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-233::DEBUG::2013-02-28 22:13:06,345::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210948 s, 19.4 MB/s\n'; <rc> = 0 >Thread-233::INFO::2013-02-28 22:13:06,351::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 1) >Thread-233::DEBUG::2013-02-28 22:13:06,351::clusterlock::190::SANLock::(acquireHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc successfully acquired (id: 1) >Thread-226::DEBUG::2013-02-28 22:13:06,365::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:06,366::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-226::WARNING::2013-02-28 22:13:06,409::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc/images already exists >Thread-226::WARNING::2013-02-28 22:13:06,409::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc/dom_md already exists >Thread-226::INFO::2013-02-28 22:13:06,410::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc to /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/b7765268-5d28-443d-be93-8dd49837a9cc >Thread-226::INFO::2013-02-28 22:13:06,410::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b7765268-5d28-443d-be93-8dd49837a9cc to /rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd >Thread-226::DEBUG::2013-02-28 22:13:06,411::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-226::DEBUG::2013-02-28 22:13:06,413::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:06,422::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00178049 s, 2.3 MB/s\n'; <rc> = 0 >Thread-226::INFO::2013-02-28 22:13:06,422::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-226::DEBUG::2013-02-28 22:13:06,422::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-226::DEBUG::2013-02-28 22:13:07,431::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00161 s, 4.1 kB/s\n'; <rc> = 0 >Thread-226::DEBUG::2013-02-28 22:13:07,433::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 >Thread-226::DEBUG::2013-02-28 22:13:07,433::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 on master domain b7765268-5d28-443d-be93-8dd49837a9cc >Thread-226::DEBUG::2013-02-28 22:13:07,434::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' >Thread-226::DEBUG::2013-02-28 22:13:07,434::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' (0 active users) >Thread-226::DEBUG::2013-02-28 22:13:07,434::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free, finding out if anyone is waiting for it. >Thread-226::DEBUG::2013-02-28 22:13:07,435::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', Clearing records. >Thread-226::INFO::2013-02-28 22:13:07,435::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-226::DEBUG::2013-02-28 22:13:07,435::task::1151::TaskManager.Task::(prepare) Task=`c19029f3-b7cc-4c51-beab-e556b0a8be39`::finished: True >Thread-226::DEBUG::2013-02-28 22:13:07,436::task::568::TaskManager.Task::(_updateState) Task=`c19029f3-b7cc-4c51-beab-e556b0a8be39`::moving from state preparing -> state finished >Thread-226::DEBUG::2013-02-28 22:13:07,436::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-226::DEBUG::2013-02-28 22:13:07,436::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2013-02-28 22:13:07,436::task::957::TaskManager.Task::(_decref) Task=`c19029f3-b7cc-4c51-beab-e556b0a8be39`::ref 0 aborting False >Thread-233::DEBUG::2013-02-28 22:13:16,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-265::DEBUG::2013-02-28 22:13:25,579::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-265::DEBUG::2013-02-28 22:13:26,271::task::568::TaskManager.Task::(_updateState) Task=`db5b62da-65d9-4813-a1a3-14a50f568a82`::moving from state init -> state preparing >Thread-265::INFO::2013-02-28 22:13:26,274::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-233::DEBUG::2013-02-28 22:13:26,280::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000341632 s, 12.0 MB/s\n'; <rc> = 0 >MainProcess|Thread-265::ERROR::2013-02-28 22:13:26,279::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-265::DEBUG::2013-02-28 22:13:26,285::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 2 -u' (cwd None) >Thread-265::DEBUG::2013-02-28 22:13:26,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-233::DEBUG::2013-02-28 22:13:36,284::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-265::DEBUG::2013-02-28 22:13:44,286::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-265::DEBUG::2013-02-28 22:13:44,294::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-265::DEBUG::2013-02-28 22:13:44,296::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-265::DEBUG::2013-02-28 22:13:44,297::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-265::DEBUG::2013-02-28 22:13:44,299::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-233::DEBUG::2013-02-28 22:13:44,307::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000316679 s, 12.9 MB/s\n'; <rc> = 0 >Thread-265::DEBUG::2013-02-28 22:13:44,331::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-265::DEBUG::2013-02-28 22:13:44,332::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:44,333::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:45,336::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:45,339::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:46,342::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:46,345::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:46,347::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:46,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host8/scan' (cwd None) >MainProcess|Thread-265::DEBUG::2013-02-28 22:13:46,352::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-265::DEBUG::2013-02-28 22:13:48,361::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-268::DEBUG::2013-02-28 22:13:50,351::task::568::TaskManager.Task::(_updateState) Task=`3ad78239-9539-4013-8642-0526b0eb5596`::moving from state init -> state preparing >Thread-268::INFO::2013-02-28 22:13:51,917::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-268::INFO::2013-02-28 22:13:51,918::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '8.02372598648', 'lastCheck': '7.6', 'code': 0, 'valid': True}} >Thread-268::DEBUG::2013-02-28 22:13:51,918::task::1151::TaskManager.Task::(prepare) Task=`3ad78239-9539-4013-8642-0526b0eb5596`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '8.02372598648', 'lastCheck': '7.6', 'code': 0, 'valid': True}} >Thread-268::DEBUG::2013-02-28 22:13:51,918::task::568::TaskManager.Task::(_updateState) Task=`3ad78239-9539-4013-8642-0526b0eb5596`::moving from state preparing -> state finished >Thread-268::DEBUG::2013-02-28 22:13:51,918::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-268::DEBUG::2013-02-28 22:13:51,919::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-268::DEBUG::2013-02-28 22:13:51,919::task::957::TaskManager.Task::(_decref) Task=`3ad78239-9539-4013-8642-0526b0eb5596`::ref 0 aborting False >Thread-233::DEBUG::2013-02-28 22:13:54,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-233::DEBUG::2013-02-28 22:14:04,982::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000563287 s, 7.3 MB/s\n'; <rc> = 0 >Thread-233::DEBUG::2013-02-28 22:14:14,988::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-233::DEBUG::2013-02-28 22:14:24,659::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000335491 s, 12.2 MB/s\n'; <rc> = 0 >Thread-265::DEBUG::2013-02-28 22:14:26,355::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-265::DEBUG::2013-02-28 22:14:26,355::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-265::DEBUG::2013-02-28 22:14:26,361::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-265::DEBUG::2013-02-28 22:14:26,361::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-265::DEBUG::2013-02-28 22:14:26,361::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-265::DEBUG::2013-02-28 22:14:26,362::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-265::DEBUG::2013-02-28 22:14:26,362::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-265::DEBUG::2013-02-28 22:14:26,362::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-265::INFO::2013-02-28 22:14:26,363::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-265::DEBUG::2013-02-28 22:14:26,363::task::1151::TaskManager.Task::(prepare) Task=`db5b62da-65d9-4813-a1a3-14a50f568a82`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-265::DEBUG::2013-02-28 22:14:26,363::task::568::TaskManager.Task::(_updateState) Task=`db5b62da-65d9-4813-a1a3-14a50f568a82`::moving from state preparing -> state finished >Thread-265::DEBUG::2013-02-28 22:14:26,363::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-265::DEBUG::2013-02-28 22:14:26,364::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-265::DEBUG::2013-02-28 22:14:26,364::task::957::TaskManager.Task::(_decref) Task=`db5b62da-65d9-4813-a1a3-14a50f568a82`::ref 0 aborting False >Thread-233::DEBUG::2013-02-28 22:14:34,664::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-233::DEBUG::2013-02-28 22:14:36,139::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b7765268-5d28-443d-be93-8dd49837a9cc' (cwd None) >Thread-233::DEBUG::2013-02-28 22:14:36,482::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-233::DEBUG::2013-02-28 22:14:36,483::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-233::DEBUG::2013-02-28 22:14:36,484::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/b7765268-5d28-443d-be93-8dd49837a9cc/metadata bs=4096 count=1' (cwd None) >Thread-233::DEBUG::2013-02-28 22:14:36,495::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000349893 s, 11.7 MB/s\n'; <rc> = 0 >Thread-274::DEBUG::2013-02-28 22:14:36,506::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-274::DEBUG::2013-02-28 22:14:36,508::task::568::TaskManager.Task::(_updateState) Task=`3639fd63-b51f-423e-aa0f-6878ee1ecbef`::moving from state init -> state preparing >Thread-274::INFO::2013-02-28 22:14:36,508::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='8afb550a-e69f-41d1-bcbe-7813fdda3b72', hostID=1, scsiKey='8afb550a-e69f-41d1-bcbe-7813fdda3b72', remove=False, options=None) >Thread-274::DEBUG::2013-02-28 22:14:36,509::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`acd6f58c-f337-49a3-8d71-9e24f30422ae`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-274::DEBUG::2013-02-28 22:14:36,509::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' for lock type 'exclusive' >Thread-274::DEBUG::2013-02-28 22:14:36,509::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free. Now locking as 'exclusive' (1 active user) >Thread-274::DEBUG::2013-02-28 22:14:36,510::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72`ReqID=`acd6f58c-f337-49a3-8d71-9e24f30422ae`::Granted request >Thread-274::DEBUG::2013-02-28 22:14:36,510::task::794::TaskManager.Task::(resourceAcquired) Task=`3639fd63-b51f-423e-aa0f-6878ee1ecbef`::_resourcesAcquired: Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72 (exclusive) >Thread-274::DEBUG::2013-02-28 22:14:36,510::task::957::TaskManager.Task::(_decref) Task=`3639fd63-b51f-423e-aa0f-6878ee1ecbef`::ref 1 aborting False >Thread-274::INFO::2013-02-28 22:14:36,510::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 8afb550a-e69f-41d1-bcbe-7813fdda3b72 >Thread-262::INFO::2013-02-28 22:14:37,445::storage_mailbox::447::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-262::INFO::2013-02-28 22:14:37,445::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-262::DEBUG::2013-02-28 22:14:37,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8afb550a-e69f-41d1-bcbe-7813fdda3b72/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-262::DEBUG::2013-02-28 22:14:37,457::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00273173 s, 1.5 MB/s\n'; <rc> = 0 >Thread-275::DEBUG::2013-02-28 22:14:39,166::task::568::TaskManager.Task::(_updateState) Task=`54f944d2-c50f-4b5e-959b-45da2ca24b10`::moving from state init -> state preparing >Thread-275::INFO::2013-02-28 22:14:39,166::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-275::INFO::2013-02-28 22:14:39,167::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.0114970207214', 'lastCheck': '2.7', 'code': 0, 'valid': True}} >Thread-275::DEBUG::2013-02-28 22:14:39,167::task::1151::TaskManager.Task::(prepare) Task=`54f944d2-c50f-4b5e-959b-45da2ca24b10`::finished: {'b7765268-5d28-443d-be93-8dd49837a9cc': {'delay': '0.0114970207214', 'lastCheck': '2.7', 'code': 0, 'valid': True}} >Thread-275::DEBUG::2013-02-28 22:14:39,167::task::568::TaskManager.Task::(_updateState) Task=`54f944d2-c50f-4b5e-959b-45da2ca24b10`::moving from state preparing -> state finished >Thread-275::DEBUG::2013-02-28 22:14:39,168::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-275::DEBUG::2013-02-28 22:14:39,168::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-275::DEBUG::2013-02-28 22:14:39,168::task::957::TaskManager.Task::(_decref) Task=`54f944d2-c50f-4b5e-959b-45da2ca24b10`::ref 0 aborting False >Thread-233::DEBUG::2013-02-28 22:14:39,431::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for b7765268-5d28-443d-be93-8dd49837a9cc >Thread-233::INFO::2013-02-28 22:14:39,431::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain b7765268-5d28-443d-be93-8dd49837a9cc (id: 1) >Thread-233::DEBUG::2013-02-28 22:14:41,432::clusterlock::205::SANLock::(releaseHostId) Host id for domain b7765268-5d28-443d-be93-8dd49837a9cc released successfully (id: 1) >Thread-274::INFO::2013-02-28 22:14:41,432::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-274::DEBUG::2013-02-28 22:14:41,433::task::1151::TaskManager.Task::(prepare) Task=`3639fd63-b51f-423e-aa0f-6878ee1ecbef`::finished: True >Thread-274::DEBUG::2013-02-28 22:14:41,433::task::568::TaskManager.Task::(_updateState) Task=`3639fd63-b51f-423e-aa0f-6878ee1ecbef`::moving from state preparing -> state finished >Thread-274::DEBUG::2013-02-28 22:14:41,433::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72': < ResourceRef 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', isValid: 'True' obj: 'None'>} >Thread-274::DEBUG::2013-02-28 22:14:41,433::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-274::DEBUG::2013-02-28 22:14:41,434::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' >Thread-274::DEBUG::2013-02-28 22:14:41,434::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' (0 active users) >Thread-274::DEBUG::2013-02-28 22:14:41,434::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72' is free, finding out if anyone is waiting for it. >Thread-274::DEBUG::2013-02-28 22:14:41,434::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8afb550a-e69f-41d1-bcbe-7813fdda3b72', Clearing records. >Thread-274::DEBUG::2013-02-28 22:14:41,435::task::957::TaskManager.Task::(_decref) Task=`3639fd63-b51f-423e-aa0f-6878ee1ecbef`::ref 0 aborting False >Thread-281::DEBUG::2013-02-28 22:14:54,385::task::568::TaskManager.Task::(_updateState) Task=`15697702-144b-4951-84cd-3c81a48ad298`::moving from state init -> state preparing >Thread-281::INFO::2013-02-28 22:14:54,385::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-281::INFO::2013-02-28 22:14:54,385::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-281::DEBUG::2013-02-28 22:14:54,386::task::1151::TaskManager.Task::(prepare) Task=`15697702-144b-4951-84cd-3c81a48ad298`::finished: {} >Thread-281::DEBUG::2013-02-28 22:14:54,386::task::568::TaskManager.Task::(_updateState) Task=`15697702-144b-4951-84cd-3c81a48ad298`::moving from state preparing -> state finished >Thread-281::DEBUG::2013-02-28 22:14:54,386::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-281::DEBUG::2013-02-28 22:14:54,386::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-281::DEBUG::2013-02-28 22:14:54,387::task::957::TaskManager.Task::(_decref) Task=`15697702-144b-4951-84cd-3c81a48ad298`::ref 0 aborting False >Thread-287::DEBUG::2013-02-28 22:15:09,604::task::568::TaskManager.Task::(_updateState) Task=`596e42c4-90e6-436f-b340-b8969cbf0587`::moving from state init -> state preparing >Thread-287::INFO::2013-02-28 22:15:09,604::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287::INFO::2013-02-28 22:15:09,605::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-287::DEBUG::2013-02-28 22:15:09,605::task::1151::TaskManager.Task::(prepare) Task=`596e42c4-90e6-436f-b340-b8969cbf0587`::finished: {} >Thread-287::DEBUG::2013-02-28 22:15:09,605::task::568::TaskManager.Task::(_updateState) Task=`596e42c4-90e6-436f-b340-b8969cbf0587`::moving from state preparing -> state finished >Thread-287::DEBUG::2013-02-28 22:15:09,605::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287::DEBUG::2013-02-28 22:15:09,605::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287::DEBUG::2013-02-28 22:15:09,605::task::957::TaskManager.Task::(_decref) Task=`596e42c4-90e6-436f-b340-b8969cbf0587`::ref 0 aborting False >Thread-290::DEBUG::2013-02-28 22:15:25,301::task::568::TaskManager.Task::(_updateState) Task=`cbb5aaf6-fcc2-4fd1-b14c-a95bbd7a24f0`::moving from state init -> state preparing >Thread-290::INFO::2013-02-28 22:15:28,541::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-290::INFO::2013-02-28 22:15:28,541::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-290::DEBUG::2013-02-28 22:15:28,541::task::1151::TaskManager.Task::(prepare) Task=`cbb5aaf6-fcc2-4fd1-b14c-a95bbd7a24f0`::finished: {} >Thread-290::DEBUG::2013-02-28 22:15:28,542::task::568::TaskManager.Task::(_updateState) Task=`cbb5aaf6-fcc2-4fd1-b14c-a95bbd7a24f0`::moving from state preparing -> state finished >Thread-290::DEBUG::2013-02-28 22:15:28,542::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-290::DEBUG::2013-02-28 22:15:28,542::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-290::DEBUG::2013-02-28 22:15:28,542::task::957::TaskManager.Task::(_decref) Task=`cbb5aaf6-fcc2-4fd1-b14c-a95bbd7a24f0`::ref 0 aborting False >MainThread::INFO::2013-02-28 22:55:12,204::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-28 22:55:12,211::task::568::TaskManager.Task::(_updateState) Task=`e2ed4d33-ac10-40e6-b1df-7b026d686252`::moving from state init -> state preparing >MainThread::INFO::2013-02-28 22:55:12,211::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-28 22:55:12,212::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-28 22:55:12,217::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,219::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,221::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,223::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,225::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,226::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,227::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,229::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,230::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,232::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,233::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,234::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,236::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,238::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,240::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,242::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,244::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,246::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,248::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,250::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,252::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,254::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,256::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,257::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,259::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,261::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,263::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,265::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,267::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,269::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,271::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,273::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,275::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,277::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,279::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 22:55:12,409::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-28 22:55:12,409::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-28 22:55:12,409::task::1151::TaskManager.Task::(prepare) Task=`e2ed4d33-ac10-40e6-b1df-7b026d686252`::finished: None >MainThread::DEBUG::2013-02-28 22:55:12,410::task::568::TaskManager.Task::(_updateState) Task=`e2ed4d33-ac10-40e6-b1df-7b026d686252`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-28 22:55:12,410::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-28 22:55:12,410::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-28 22:55:12,410::task::957::TaskManager.Task::(_decref) Task=`e2ed4d33-ac10-40e6-b1df-7b026d686252`::ref 0 aborting False >MainThread::INFO::2013-02-28 22:55:12,410::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-02-28 22:55:12,410::vdsm::99::vds::(run) <_MainThread(MainThread, started 140457610684160)> >MainThread::INFO::2013-02-28 22:55:12,411::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140457518122752)> >MainThread::INFO::2013-02-28 22:55:12,411::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 140457344485120)> >MainThread::INFO::2013-02-28 22:55:12,411::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 140456941831936)> >MainThread::INFO::2013-02-28 22:55:12,411::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 140457375954688)> >MainThread::INFO::2013-02-28 22:55:12,411::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 140457323505408)> >MainThread::INFO::2013-02-28 22:55:12,411::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-02-28 22:55:12,411::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 140456472069888)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 140457354974976)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140456493049600)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 140457333995264)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 140456973301504)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 140456962811648)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 140456952321792)> >MainThread::INFO::2013-02-28 22:55:12,412::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 140457365464832)> >MainThread::INFO::2013-02-28 23:00:58,932::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-28 23:00:59,220::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-28 23:00:59,221::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-28 23:00:59,233::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-28 23:00:59,544::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,546::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,547::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,549::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,552::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,553::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,554::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,557::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,559::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,560::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,561::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,563::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,564::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,566::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,568::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,570::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,572::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,574::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,576::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,578::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,580::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,582::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,584::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,586::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,588::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,590::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,592::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,594::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,596::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,598::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,600::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,602::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,604::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,606::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,608::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:00:59,728::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-28 23:00:59,729::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py d16ea152-2943-432d-a96a-ad6b469bcd12 4151 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-28 23:01:00,017::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-28 23:01:00,017::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-28 23:01:00,092::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-28 23:01:00,093::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-28 23:01:00,093::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-28 23:01:00,094::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-28 23:01:00,096::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-28 23:01:01,735::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-28 23:01:01,743::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-28 23:01:01,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-28 23:01:01,977::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-28 23:01:01,978::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-28 23:01:01,981::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-28 23:01:01,981::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-28 23:01:01,982::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-28 23:01:01,995::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-28 23:01:01,997::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-28 23:01:01,997::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:01,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-28 23:01:02,024::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-28 23:01:02,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-28 23:01:02,086::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-28 23:01:02,087::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-28 23:01:02,088::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-28 23:01:02,093::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-28 23:01:02,094::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-28 23:01:02,098::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-28 23:01:02,098::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-28 23:01:02,118::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-28 23:01:02,118::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-28 23:01:02,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:01:02,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:01:02,195::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:02,196::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:02,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:01:02,356::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:01:02,357::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:02,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:01:02,515::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:01:02,515::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-28 23:01:02,516::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:01:02,516::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-28 23:01:02,516::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:01:02,517::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:01:02,531::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-02-28 23:01:02,532::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:02,535::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:03,539::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-13::DEBUG::2013-02-28 23:01:04,070::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-28 23:01:04,291::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-28 23:01:04,324::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-28 23:01:04,416::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-02-28 23:01:04,472::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getCapabilities with () {} >Thread-15::DEBUG::2013-02-28 23:01:04,504::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.50'}} >Thread-16::DEBUG::2013-02-28 23:01:04,540::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-02-28 23:01:04,542::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:04,542::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:05,547::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:06,550::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:06,553::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:01:06,555::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-18::DEBUG::2013-02-28 23:01:07,669::task::568::TaskManager.Task::(_updateState) Task=`6085f93f-72f6-4578-b0df-2c8db8124e22`::moving from state init -> state preparing >Thread-18::INFO::2013-02-28 23:01:07,669::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::INFO::2013-02-28 23:01:07,669::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-18::DEBUG::2013-02-28 23:01:07,669::task::1151::TaskManager.Task::(prepare) Task=`6085f93f-72f6-4578-b0df-2c8db8124e22`::finished: {} >Thread-18::DEBUG::2013-02-28 23:01:07,670::task::568::TaskManager.Task::(_updateState) Task=`6085f93f-72f6-4578-b0df-2c8db8124e22`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-02-28 23:01:07,670::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-02-28 23:01:07,670::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-02-28 23:01:07,670::task::957::TaskManager.Task::(_decref) Task=`6085f93f-72f6-4578-b0df-2c8db8124e22`::ref 0 aborting False >storageRefresh::DEBUG::2013-02-28 23:01:08,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:01:09,702::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:01:09,703::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:09,703::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:09,704::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:09,704::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:09,704::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:09,705::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:01:09,705::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-28 23:01:09,705::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-24::DEBUG::2013-02-28 23:01:22,886::task::568::TaskManager.Task::(_updateState) Task=`cb2e4b4a-51a7-4b09-8af0-384632496d3e`::moving from state init -> state preparing >Thread-24::INFO::2013-02-28 23:01:22,887::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2013-02-28 23:01:22,887::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2013-02-28 23:01:22,887::task::1151::TaskManager.Task::(prepare) Task=`cb2e4b4a-51a7-4b09-8af0-384632496d3e`::finished: {} >Thread-24::DEBUG::2013-02-28 23:01:22,887::task::568::TaskManager.Task::(_updateState) Task=`cb2e4b4a-51a7-4b09-8af0-384632496d3e`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-02-28 23:01:22,887::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-02-28 23:01:22,888::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-02-28 23:01:22,888::task::957::TaskManager.Task::(_decref) Task=`cb2e4b4a-51a7-4b09-8af0-384632496d3e`::ref 0 aborting False >Thread-30::DEBUG::2013-02-28 23:01:38,099::task::568::TaskManager.Task::(_updateState) Task=`6ef68e10-041e-483d-9b5f-22e96c8de983`::moving from state init -> state preparing >Thread-30::INFO::2013-02-28 23:01:38,099::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2013-02-28 23:01:38,099::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-30::DEBUG::2013-02-28 23:01:38,100::task::1151::TaskManager.Task::(prepare) Task=`6ef68e10-041e-483d-9b5f-22e96c8de983`::finished: {} >Thread-30::DEBUG::2013-02-28 23:01:38,100::task::568::TaskManager.Task::(_updateState) Task=`6ef68e10-041e-483d-9b5f-22e96c8de983`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-02-28 23:01:38,100::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-02-28 23:01:38,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-02-28 23:01:38,101::task::957::TaskManager.Task::(_decref) Task=`6ef68e10-041e-483d-9b5f-22e96c8de983`::ref 0 aborting False >Thread-36::DEBUG::2013-02-28 23:01:53,374::task::568::TaskManager.Task::(_updateState) Task=`3110fcf7-1afd-4894-9b36-9276231560d2`::moving from state init -> state preparing >Thread-36::INFO::2013-02-28 23:01:53,374::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-36::INFO::2013-02-28 23:01:53,374::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-36::DEBUG::2013-02-28 23:01:53,374::task::1151::TaskManager.Task::(prepare) Task=`3110fcf7-1afd-4894-9b36-9276231560d2`::finished: {} >Thread-36::DEBUG::2013-02-28 23:01:53,375::task::568::TaskManager.Task::(_updateState) Task=`3110fcf7-1afd-4894-9b36-9276231560d2`::moving from state preparing -> state finished >Thread-36::DEBUG::2013-02-28 23:01:53,375::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2013-02-28 23:01:53,375::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2013-02-28 23:01:53,375::task::957::TaskManager.Task::(_decref) Task=`3110fcf7-1afd-4894-9b36-9276231560d2`::ref 0 aborting False >Thread-40::DEBUG::2013-02-28 23:02:01,961::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-40::DEBUG::2013-02-28 23:02:01,962::task::568::TaskManager.Task::(_updateState) Task=`8adf012c-08a2-4abd-b5e5-6924031d9ed8`::moving from state init -> state preparing >Thread-40::INFO::2013-02-28 23:02:01,962::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-40::DEBUG::2013-02-28 23:02:01,963::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-40::DEBUG::2013-02-28 23:02:02,009::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-40::DEBUG::2013-02-28 23:02:02,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-40::DEBUG::2013-02-28 23:02:02,590::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-40::DEBUG::2013-02-28 23:02:02,592::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-40::DEBUG::2013-02-28 23:02:02,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-40::INFO::2013-02-28 23:02:02,623::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-40::DEBUG::2013-02-28 23:02:02,623::task::1151::TaskManager.Task::(prepare) Task=`8adf012c-08a2-4abd-b5e5-6924031d9ed8`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-40::DEBUG::2013-02-28 23:02:02,624::task::568::TaskManager.Task::(_updateState) Task=`8adf012c-08a2-4abd-b5e5-6924031d9ed8`::moving from state preparing -> state finished >Thread-40::DEBUG::2013-02-28 23:02:02,624::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2013-02-28 23:02:02,624::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2013-02-28 23:02:02,624::task::957::TaskManager.Task::(_decref) Task=`8adf012c-08a2-4abd-b5e5-6924031d9ed8`::ref 0 aborting False >Thread-42::DEBUG::2013-02-28 23:02:02,674::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-42::DEBUG::2013-02-28 23:02:02,675::task::568::TaskManager.Task::(_updateState) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::moving from state init -> state preparing >Thread-42::INFO::2013-02-28 23:02:02,676::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', options=None) >Thread-42::ERROR::2013-02-28 23:02:02,676::task::833::TaskManager.Task::(_setError) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 603, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 313, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f',) >Thread-42::DEBUG::2013-02-28 23:02:02,680::task::852::TaskManager.Task::(_run) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::Task._run: a5b2ae70-168e-48da-853d-a6936fc8899e ('362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f',) {} failed - stopping task >Thread-42::DEBUG::2013-02-28 23:02:02,680::task::1177::TaskManager.Task::(stop) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::stopping in state preparing (force False) >Thread-42::DEBUG::2013-02-28 23:02:02,680::task::957::TaskManager.Task::(_decref) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::ref 1 aborting True >Thread-42::INFO::2013-02-28 23:02:02,680::task::1134::TaskManager.Task::(prepare) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-42::DEBUG::2013-02-28 23:02:02,681::task::1139::TaskManager.Task::(prepare) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::Prepare: aborted: Unknown pool id, pool not connected >Thread-42::DEBUG::2013-02-28 23:02:02,681::task::957::TaskManager.Task::(_decref) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::ref 0 aborting True >Thread-42::DEBUG::2013-02-28 23:02:02,681::task::892::TaskManager.Task::(_doAbort) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::Task._doAbort: force False >Thread-42::DEBUG::2013-02-28 23:02:02,682::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::DEBUG::2013-02-28 23:02:02,682::task::568::TaskManager.Task::(_updateState) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::moving from state preparing -> state aborting >Thread-42::DEBUG::2013-02-28 23:02:02,682::task::523::TaskManager.Task::(__state_aborting) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::_aborting: recover policy none >Thread-42::DEBUG::2013-02-28 23:02:02,682::task::568::TaskManager.Task::(_updateState) Task=`a5b2ae70-168e-48da-853d-a6936fc8899e`::moving from state aborting -> state failed >Thread-42::DEBUG::2013-02-28 23:02:02,683::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-42::DEBUG::2013-02-28 23:02:02,683::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::ERROR::2013-02-28 23:02:02,683::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f',)", 'code': 309}} >Thread-43::DEBUG::2013-02-28 23:02:02,729::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-43::DEBUG::2013-02-28 23:02:02,730::task::568::TaskManager.Task::(_updateState) Task=`bfbd3739-6cd0-4ae9-9148-2644d0ed40de`::moving from state init -> state preparing >Thread-43::INFO::2013-02-28 23:02:02,731::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', hostID=2, scsiKey='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', msdUUID='2df5ac6e-fa65-418c-9f9c-575c05769c3b', masterVersion=1, options=None) >Thread-43::DEBUG::2013-02-28 23:02:02,732::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`f3b09220-3738-43bd-8be1-273e1b656ff2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-43::DEBUG::2013-02-28 23:02:02,732::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' for lock type 'exclusive' >Thread-43::DEBUG::2013-02-28 23:02:02,733::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free. Now locking as 'exclusive' (1 active user) >Thread-43::DEBUG::2013-02-28 23:02:02,734::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`f3b09220-3738-43bd-8be1-273e1b656ff2`::Granted request >Thread-43::INFO::2013-02-28 23:02:02,735::sp::627::Storage.StoragePool::(connect) Connect host #2 to the storage pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f with master domain: 2df5ac6e-fa65-418c-9f9c-575c05769c3b (ver = 1) >Thread-43::DEBUG::2013-02-28 23:02:02,736::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-43::DEBUG::2013-02-28 23:02:02,736::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-43::DEBUG::2013-02-28 23:02:02,737::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-43::DEBUG::2013-02-28 23:02:02,737::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-43::DEBUG::2013-02-28 23:02:02,738::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-43::DEBUG::2013-02-28 23:02:02,738::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-43::DEBUG::2013-02-28 23:02:02,739::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-43::DEBUG::2013-02-28 23:02:02,739::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-43::DEBUG::2013-02-28 23:02:02,740::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-43::DEBUG::2013-02-28 23:02:02,740::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-43::DEBUG::2013-02-28 23:02:02,740::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-43::DEBUG::2013-02-28 23:02:02,841::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-43::DEBUG::2013-02-28 23:02:02,842::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-43::DEBUG::2013-02-28 23:02:02,849::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-43::DEBUG::2013-02-28 23:02:03,855::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-43::DEBUG::2013-02-28 23:02:03,868::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-43::DEBUG::2013-02-28 23:02:03,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainThread::INFO::2013-02-28 23:06:38,334::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-28 23:06:39,688::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-28 23:06:39,689::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-28 23:06:39,718::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-28 23:06:40,141::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,143::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,144::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,146::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,148::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,149::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,151::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,153::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,154::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,156::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,158::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,160::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,161::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,163::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,164::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,165::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,167::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,169::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,170::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,172::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,174::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,175::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,177::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,179::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,181::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,183::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,185::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,186::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,188::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,190::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,192::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,194::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,195::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,197::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,199::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:06:40,321::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-28 23:06:40,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 9236cf4a-edc4-4543-8c0a-214967eb2043 4321 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-28 23:06:41,115::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-28 23:06:41,115::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-28 23:06:41,115::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-28 23:06:41,116::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-28 23:06:41,116::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-28 23:06:41,116::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-28 23:06:41,119::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-28 23:06:42,388::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-28 23:06:42,414::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-28 23:06:42,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-28 23:06:42,654::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-28 23:06:42,655::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-28 23:06:42,658::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-28 23:06:42,658::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-28 23:06:42,658::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-28 23:06:42,718::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-28 23:06:42,720::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-28 23:06:42,720::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:06:42,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-28 23:06:42,745::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-28 23:06:42,778::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-28 23:06:42,854::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-28 23:06:42,854::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-28 23:06:42,855::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-28 23:06:42,855::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-28 23:06:42,859::vmChannels::127::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-02-28 23:06:43,119::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:06:43,119::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >KsmMonitor::DEBUG::2013-02-28 23:06:43,120::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:06:43,120::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >KsmMonitor::DEBUG::2013-02-28 23:06:43,121::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:06:43,121::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >MainThread::WARNING::2013-02-28 23:06:43,132::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-28 23:06:43,132::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-28 23:06:43,150::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:06:43,313::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:06:43,313::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:06:43,314::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:06:43,473::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:06:43,474::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-28 23:06:43,474::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:06:43,474::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-28 23:06:43,475::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:06:43,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:06:43,537::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-02-28 23:06:43,538::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,540::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,543::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,546::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,550::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:06:43,554::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2013-02-28 23:06:45,326::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getCapabilities with () {} >storageRefresh::DEBUG::2013-02-28 23:06:45,586::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >MainThread::INFO::2013-02-28 23:11:09,582::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-28 23:11:10,114::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-28 23:11:10,114::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-28 23:11:10,135::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-28 23:11:10,323::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,325::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,327::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,329::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,330::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,332::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,334::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,336::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,338::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,340::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,341::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,343::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,344::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,345::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,347::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,348::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,350::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,352::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,353::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,355::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,357::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,359::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,361::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,363::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,365::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,367::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,369::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,371::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,373::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,375::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,377::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,379::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,381::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,383::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,385::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:11:10,524::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-28 23:11:10,524::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 5217ec49-9ebb-426b-bfba-71d094a2b0aa 5431 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-28 23:11:10,947::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-28 23:11:10,947::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-28 23:11:10,947::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-28 23:11:10,948::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-28 23:11:10,948::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-28 23:11:10,948::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-28 23:11:10,951::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-28 23:11:12,542::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-28 23:11:12,561::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-28 23:11:12,561::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-28 23:11:12,799::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-28 23:11:12,799::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-28 23:11:12,804::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-28 23:11:12,804::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-28 23:11:12,805::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-28 23:11:12,807::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2013-02-28 23:11:12,808::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >MainThread::INFO::2013-02-28 23:11:12,810::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-28 23:11:12,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-28 23:11:12,836::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-28 23:11:12,849::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-28 23:11:12,904::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-28 23:11:12,905::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-28 23:11:12,905::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-28 23:11:12,906::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-28 23:11:12,922::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-28 23:11:12,923::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-28 23:11:12,923::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-28 23:11:12,934::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-28 23:11:12,934::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-28 23:11:12,959::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:11:12,990::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:11:12,991::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:12,991::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:12,992::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:11:13,165::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:11:13,166::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:13,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:11:13,373::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:11:13,374::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-28 23:11:13,374::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:11:13,375::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-28 23:11:13,375::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:11:13,375::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:11:13,404::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-02-28 23:11:13,405::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:13,407::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:14,411::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:14,413::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:14,416::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:14,418::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:14,420::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:11:14,423::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2013-02-28 23:11:15,168::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-28 23:11:15,383::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-28 23:11:15,417::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.50]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-28 23:11:15,519::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-16::DEBUG::2013-02-28 23:11:15,618::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-16::DEBUG::2013-02-28 23:11:15,618::task::568::TaskManager.Task::(_updateState) Task=`5b162dc7-3dd6-4122-af0f-c9505053746f`::moving from state init -> state preparing >Thread-16::INFO::2013-02-28 23:11:15,619::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-16::INFO::2013-02-28 23:11:15,619::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-16::DEBUG::2013-02-28 23:11:15,619::task::1151::TaskManager.Task::(prepare) Task=`5b162dc7-3dd6-4122-af0f-c9505053746f`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-16::DEBUG::2013-02-28 23:11:15,619::task::568::TaskManager.Task::(_updateState) Task=`5b162dc7-3dd6-4122-af0f-c9505053746f`::moving from state preparing -> state finished >Thread-16::DEBUG::2013-02-28 23:11:15,620::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16::DEBUG::2013-02-28 23:11:15,620::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16::DEBUG::2013-02-28 23:11:15,620::task::957::TaskManager.Task::(_decref) Task=`5b162dc7-3dd6-4122-af0f-c9505053746f`::ref 0 aborting False >Thread-17::DEBUG::2013-02-28 23:11:15,651::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-17::DEBUG::2013-02-28 23:11:15,652::task::568::TaskManager.Task::(_updateState) Task=`729ce709-79bb-486f-a0ad-50e6ea284ded`::moving from state init -> state preparing >Thread-17::INFO::2013-02-28 23:11:15,652::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-17::DEBUG::2013-02-28 23:11:15,653::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-17::DEBUG::2013-02-28 23:11:15,688::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2013-02-28 23:11:15,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-17::DEBUG::2013-02-28 23:11:16,273::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2013-02-28 23:11:16,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-17::DEBUG::2013-02-28 23:11:16,296::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::INFO::2013-02-28 23:11:16,297::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-17::DEBUG::2013-02-28 23:11:16,298::task::1151::TaskManager.Task::(prepare) Task=`729ce709-79bb-486f-a0ad-50e6ea284ded`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-17::DEBUG::2013-02-28 23:11:16,298::task::568::TaskManager.Task::(_updateState) Task=`729ce709-79bb-486f-a0ad-50e6ea284ded`::moving from state preparing -> state finished >Thread-17::DEBUG::2013-02-28 23:11:16,298::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2013-02-28 23:11:16,298::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2013-02-28 23:11:16,299::task::957::TaskManager.Task::(_decref) Task=`729ce709-79bb-486f-a0ad-50e6ea284ded`::ref 0 aborting False >Thread-18::DEBUG::2013-02-28 23:11:16,345::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-18::DEBUG::2013-02-28 23:11:16,346::task::568::TaskManager.Task::(_updateState) Task=`99468606-6555-4e96-99fc-7f88cf2ed8de`::moving from state init -> state preparing >Thread-18::INFO::2013-02-28 23:11:16,346::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', hostID=2, scsiKey='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', msdUUID='2df5ac6e-fa65-418c-9f9c-575c05769c3b', masterVersion=1, options=None) >Thread-18::DEBUG::2013-02-28 23:11:16,347::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`344bc8f0-f8e1-4927-92ec-7319ccc95ad4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-18::DEBUG::2013-02-28 23:11:16,348::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' for lock type 'exclusive' >Thread-18::DEBUG::2013-02-28 23:11:16,348::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free. Now locking as 'exclusive' (1 active user) >Thread-18::DEBUG::2013-02-28 23:11:16,348::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`344bc8f0-f8e1-4927-92ec-7319ccc95ad4`::Granted request >Thread-18::INFO::2013-02-28 23:11:16,349::sp::627::Storage.StoragePool::(connect) Connect host #2 to the storage pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f with master domain: 2df5ac6e-fa65-418c-9f9c-575c05769c3b (ver = 1) >Thread-18::DEBUG::2013-02-28 23:11:16,350::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:16,350::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:16,351::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:16,351::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:16,351::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:16,352::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:16,352::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-28 23:11:16,434::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:11:20,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:11:20,850::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:20,862::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:20,862::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:20,863::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:20,863::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:20,864::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:11:20,865::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-18::DEBUG::2013-02-28 23:11:20,865::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2013-02-28 23:11:20,866::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-18::DEBUG::2013-02-28 23:11:20,867::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2013-02-28 23:11:20,867::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::WARNING::2013-02-28 23:11:20,868::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-18::DEBUG::2013-02-28 23:11:20,970::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:20,971::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:20,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:21,979::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:21,981::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:21,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:21,987::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:22,990::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:23,994::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:23,996::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host7/scan' (cwd None) >MainProcess|Thread-18::DEBUG::2013-02-28 23:11:23,998::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-18::DEBUG::2013-02-28 23:11:26,001::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:31,447::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:31,448::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,448::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,448::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,449::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,449::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,449::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,450::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-18::DEBUG::2013-02-28 23:11:31,450::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:31,453::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:32,083::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:32,085::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:32,086::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2013-02-28 23:11:32,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:33,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:33,895::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,895::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,895::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata count=1' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:33,901::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000370273 s, 5.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:33,901::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000370273 s, 5.5 MB/s'], size: 2048 >Thread-18::DEBUG::2013-02-28 23:11:33,902::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2013-02-28 23:11:33,902::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2013-02-28 23:11:33,902::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2013-02-28 23:11:33,902::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,903::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,903::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,903::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,903::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:33,904::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:34,148::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:34,149::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:34,149::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'VGUUID=3ih2tx-fDGO-jZdE-ZlvB-Pfzt-eLJW-oMfgEL', u'PV0=pv:3514f0c542a000482,uuid:GYP6rF-8Z8D-Qkpu-R1BH-scEc-geV1-RURoQw,pestart:0,pecount:237,mapoffset:0', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=2df5ac6e-fa65-418c-9f9c-575c05769c3b', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', 'POOL_DOMAINS=2df5ac6e-fa65-418c-9f9c-575c05769c3b:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=14368384b11099e66d094abe541eefe85ed68de6', 'POOL_SPM_LVER=0'] >Thread-18::DEBUG::2013-02-28 23:11:34,150::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 2df5ac6e-fa65-418c-9f9c-575c05769c3b/ids' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:36,024::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:36,024::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:36,025::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:36,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 2df5ac6e-fa65-418c-9f9c-575c05769c3b/leases' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:37,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:37,880::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:37,880::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:37,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 2df5ac6e-fa65-418c-9f9c-575c05769c3b/inbox 2df5ac6e-fa65-418c-9f9c-575c05769c3b/outbox 2df5ac6e-fa65-418c-9f9c-575c05769c3b/master' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:39,673::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:39,673::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,673::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,674::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,675::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:39,883::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:39,884::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,884::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '2df5ac6e-fa65-418c-9f9c-575c05769c3b_imageNS' >Thread-18::DEBUG::2013-02-28 23:11:39,884::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '2df5ac6e-fa65-418c-9f9c-575c05769c3b_volumeNS' >Thread-18::DEBUG::2013-02-28 23:11:39,885::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '2df5ac6e-fa65-418c-9f9c-575c05769c3b_lvmActivationNS' >Thread-18::DEBUG::2013-02-28 23:11:39,885::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b verified, version 1 >Thread-18::DEBUG::2013-02-28 23:11:39,885::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-18::DEBUG::2013-02-28 23:11:39,886::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2013-02-28 23:11:39,886::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,886::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,886::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,887::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,887::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:39,888::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:40,492::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:40,495::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:40,495::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'VGUUID=3ih2tx-fDGO-jZdE-ZlvB-Pfzt-eLJW-oMfgEL', u'PV0=pv:3514f0c542a000482,uuid:GYP6rF-8Z8D-Qkpu-R1BH-scEc-geV1-RURoQw,pestart:0,pecount:237,mapoffset:0', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=2df5ac6e-fa65-418c-9f9c-575c05769c3b', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', 'POOL_DOMAINS=2df5ac6e-fa65-418c-9f9c-575c05769c3b:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=14368384b11099e66d094abe541eefe85ed68de6', 'POOL_SPM_LVER=0'] >Thread-18::DEBUG::2013-02-28 23:11:40,496::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f` started monitoring domain `2df5ac6e-fa65-418c-9f9c-575c05769c3b` >Thread-19::DEBUG::2013-02-28 23:11:40,496::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-18::DEBUG::2013-02-28 23:11:40,497::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2013-02-28 23:11:40,498::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:40,542::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2013-02-28 23:11:40,543::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-19::DEBUG::2013-02-28 23:11:40,722::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:11:40,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:11:40,728::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267347 s, 15.3 MB/s\n'; <rc> = 0 >Thread-19::INFO::2013-02-28 23:11:40,732::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b (id: 2) >Thread-19::DEBUG::2013-02-28 23:11:40,733::clusterlock::190::SANLock::(acquireHostId) Host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b successfully acquired (id: 2) >Thread-18::DEBUG::2013-02-28 23:11:40,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:40,756::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::INFO::2013-02-28 23:11:41,160::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2df5ac6e-fa65-418c-9f9c-575c05769c3b to /rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-18::INFO::2013-02-28 23:11:41,160::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2df5ac6e-fa65-418c-9f9c-575c05769c3b to /rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd >Thread-18::DEBUG::2013-02-28 23:11:41,161::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-18::DEBUG::2013-02-28 23:11:41,163::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=16' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:41,170::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00161544 s, 2.5 MB/s\n'; <rc> = 0 >Thread-18::INFO::2013-02-28 23:11:41,170::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-18::DEBUG::2013-02-28 23:11:41,171::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16' (cwd None) >Thread-18::DEBUG::2013-02-28 23:11:42,177::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00153 s, 4.1 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2013-02-28 23:11:42,178::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f >Thread-18::DEBUG::2013-02-28 23:11:42,178::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f on master domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-18::DEBUG::2013-02-28 23:11:42,179::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' >Thread-18::DEBUG::2013-02-28 23:11:42,179::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' (0 active users) >Thread-18::DEBUG::2013-02-28 23:11:42,180::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2013-02-28 23:11:42,180::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', Clearing records. >Thread-18::INFO::2013-02-28 23:11:42,180::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-18::DEBUG::2013-02-28 23:11:42,181::task::1151::TaskManager.Task::(prepare) Task=`99468606-6555-4e96-99fc-7f88cf2ed8de`::finished: True >Thread-18::DEBUG::2013-02-28 23:11:42,181::task::568::TaskManager.Task::(_updateState) Task=`99468606-6555-4e96-99fc-7f88cf2ed8de`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-02-28 23:11:42,181::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-02-28 23:11:42,181::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-02-28 23:11:42,182::task::957::TaskManager.Task::(_decref) Task=`99468606-6555-4e96-99fc-7f88cf2ed8de`::ref 0 aborting False >Thread-49::DEBUG::2013-02-28 23:11:42,208::task::568::TaskManager.Task::(_updateState) Task=`fb7a8f5d-9ef8-4a13-8146-92ef7ff92a5d`::moving from state init -> state preparing >Thread-49::INFO::2013-02-28 23:11:42,208::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-49::INFO::2013-02-28 23:11:42,209::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.006098985672', 'lastCheck': '1.5', 'code': 0, 'valid': True}} >Thread-49::DEBUG::2013-02-28 23:11:42,209::task::1151::TaskManager.Task::(prepare) Task=`fb7a8f5d-9ef8-4a13-8146-92ef7ff92a5d`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.006098985672', 'lastCheck': '1.5', 'code': 0, 'valid': True}} >Thread-49::DEBUG::2013-02-28 23:11:42,209::task::568::TaskManager.Task::(_updateState) Task=`fb7a8f5d-9ef8-4a13-8146-92ef7ff92a5d`::moving from state preparing -> state finished >Thread-49::DEBUG::2013-02-28 23:11:42,209::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49::DEBUG::2013-02-28 23:11:42,210::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2013-02-28 23:11:42,210::task::957::TaskManager.Task::(_decref) Task=`fb7a8f5d-9ef8-4a13-8146-92ef7ff92a5d`::ref 0 aborting False >Thread-51::DEBUG::2013-02-28 23:11:48,425::task::568::TaskManager.Task::(_updateState) Task=`74d0d9c9-39d4-4099-953c-d8816ff32cc0`::moving from state init -> state preparing >Thread-51::INFO::2013-02-28 23:11:48,425::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-51::INFO::2013-02-28 23:11:48,425::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.006098985672', 'lastCheck': '7.7', 'code': 0, 'valid': True}} >Thread-51::DEBUG::2013-02-28 23:11:48,425::task::1151::TaskManager.Task::(prepare) Task=`74d0d9c9-39d4-4099-953c-d8816ff32cc0`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.006098985672', 'lastCheck': '7.7', 'code': 0, 'valid': True}} >Thread-51::DEBUG::2013-02-28 23:11:48,426::task::568::TaskManager.Task::(_updateState) Task=`74d0d9c9-39d4-4099-953c-d8816ff32cc0`::moving from state preparing -> state finished >Thread-51::DEBUG::2013-02-28 23:11:48,594::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2013-02-28 23:11:48,594::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2013-02-28 23:11:48,594::task::957::TaskManager.Task::(_decref) Task=`74d0d9c9-39d4-4099-953c-d8816ff32cc0`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:11:50,734::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:11:50,742::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000399643 s, 10.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:12:00,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:12:00,756::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107702 s, 3.8 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2013-02-28 23:12:03,998::task::568::TaskManager.Task::(_updateState) Task=`34f56bd7-9ee1-4a18-a501-632a0b9ad234`::moving from state init -> state preparing >Thread-57::INFO::2013-02-28 23:12:03,999::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-57::INFO::2013-02-28 23:12:03,999::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.0114889144897', 'lastCheck': '3.2', 'code': 0, 'valid': True}} >Thread-57::DEBUG::2013-02-28 23:12:04,000::task::1151::TaskManager.Task::(prepare) Task=`34f56bd7-9ee1-4a18-a501-632a0b9ad234`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.0114889144897', 'lastCheck': '3.2', 'code': 0, 'valid': True}} >Thread-57::DEBUG::2013-02-28 23:12:04,000::task::568::TaskManager.Task::(_updateState) Task=`34f56bd7-9ee1-4a18-a501-632a0b9ad234`::moving from state preparing -> state finished >Thread-57::DEBUG::2013-02-28 23:12:04,000::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2013-02-28 23:12:04,000::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2013-02-28 23:12:04,001::task::957::TaskManager.Task::(_decref) Task=`34f56bd7-9ee1-4a18-a501-632a0b9ad234`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:12:10,762::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:12:10,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000437748 s, 9.4 MB/s\n'; <rc> = 0 >Thread-63::DEBUG::2013-02-28 23:12:19,209::task::568::TaskManager.Task::(_updateState) Task=`bc9ccc8c-8853-4065-8df3-6f620aa49b3a`::moving from state init -> state preparing >Thread-63::INFO::2013-02-28 23:12:19,216::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-63::INFO::2013-02-28 23:12:19,216::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00863695144653', 'lastCheck': '8.4', 'code': 0, 'valid': True}} >Thread-63::DEBUG::2013-02-28 23:12:19,216::task::1151::TaskManager.Task::(prepare) Task=`bc9ccc8c-8853-4065-8df3-6f620aa49b3a`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00863695144653', 'lastCheck': '8.4', 'code': 0, 'valid': True}} >Thread-63::DEBUG::2013-02-28 23:12:19,217::task::568::TaskManager.Task::(_updateState) Task=`bc9ccc8c-8853-4065-8df3-6f620aa49b3a`::moving from state preparing -> state finished >Thread-63::DEBUG::2013-02-28 23:12:19,217::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-63::DEBUG::2013-02-28 23:12:19,217::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2013-02-28 23:12:19,217::task::957::TaskManager.Task::(_decref) Task=`bc9ccc8c-8853-4065-8df3-6f620aa49b3a`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:12:20,774::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:12:20,782::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000346032 s, 11.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:12:30,785::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:12:30,794::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622043 s, 6.6 MB/s\n'; <rc> = 0 >Thread-69::DEBUG::2013-02-28 23:12:34,849::task::568::TaskManager.Task::(_updateState) Task=`f6b46408-ba77-4a47-9c9e-ed78791d2d9f`::moving from state init -> state preparing >Thread-69::INFO::2013-02-28 23:12:34,849::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-69::INFO::2013-02-28 23:12:34,850::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00905704498291', 'lastCheck': '4.1', 'code': 0, 'valid': True}} >Thread-69::DEBUG::2013-02-28 23:12:34,850::task::1151::TaskManager.Task::(prepare) Task=`f6b46408-ba77-4a47-9c9e-ed78791d2d9f`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00905704498291', 'lastCheck': '4.1', 'code': 0, 'valid': True}} >Thread-69::DEBUG::2013-02-28 23:12:34,850::task::568::TaskManager.Task::(_updateState) Task=`f6b46408-ba77-4a47-9c9e-ed78791d2d9f`::moving from state preparing -> state finished >Thread-69::DEBUG::2013-02-28 23:12:34,850::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69::DEBUG::2013-02-28 23:12:34,850::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2013-02-28 23:12:34,851::task::957::TaskManager.Task::(_decref) Task=`f6b46408-ba77-4a47-9c9e-ed78791d2d9f`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:12:40,798::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:12:40,806::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00043314 s, 9.5 MB/s\n'; <rc> = 0 >Thread-75::DEBUG::2013-02-28 23:12:50,101::task::568::TaskManager.Task::(_updateState) Task=`a10ac9da-401a-49b5-aada-5539a1796677`::moving from state init -> state preparing >Thread-75::INFO::2013-02-28 23:12:50,102::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-75::INFO::2013-02-28 23:12:50,102::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.0086829662323', 'lastCheck': '9.3', 'code': 0, 'valid': True}} >Thread-75::DEBUG::2013-02-28 23:12:50,102::task::1151::TaskManager.Task::(prepare) Task=`a10ac9da-401a-49b5-aada-5539a1796677`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.0086829662323', 'lastCheck': '9.3', 'code': 0, 'valid': True}} >Thread-75::DEBUG::2013-02-28 23:12:50,102::task::568::TaskManager.Task::(_updateState) Task=`a10ac9da-401a-49b5-aada-5539a1796677`::moving from state preparing -> state finished >Thread-75::DEBUG::2013-02-28 23:12:50,103::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-75::DEBUG::2013-02-28 23:12:50,103::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-75::DEBUG::2013-02-28 23:12:50,103::task::957::TaskManager.Task::(_decref) Task=`a10ac9da-401a-49b5-aada-5539a1796677`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:12:50,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:12:50,818::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000350001 s, 11.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:13:00,822::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:13:00,830::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00030817 s, 13.3 MB/s\n'; <rc> = 0 >Thread-81::DEBUG::2013-02-28 23:13:05,309::task::568::TaskManager.Task::(_updateState) Task=`1e763e94-b818-4f12-9fac-4526b04d06a4`::moving from state init -> state preparing >Thread-81::INFO::2013-02-28 23:13:05,309::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2013-02-28 23:13:05,310::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00867891311646', 'lastCheck': '4.5', 'code': 0, 'valid': True}} >Thread-81::DEBUG::2013-02-28 23:13:05,310::task::1151::TaskManager.Task::(prepare) Task=`1e763e94-b818-4f12-9fac-4526b04d06a4`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00867891311646', 'lastCheck': '4.5', 'code': 0, 'valid': True}} >Thread-81::DEBUG::2013-02-28 23:13:05,310::task::568::TaskManager.Task::(_updateState) Task=`1e763e94-b818-4f12-9fac-4526b04d06a4`::moving from state preparing -> state finished >Thread-81::DEBUG::2013-02-28 23:13:05,310::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2013-02-28 23:13:05,311::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2013-02-28 23:13:05,311::task::957::TaskManager.Task::(_decref) Task=`1e763e94-b818-4f12-9fac-4526b04d06a4`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:13:10,834::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:13:10,843::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000362168 s, 11.3 MB/s\n'; <rc> = 0 >Thread-87::DEBUG::2013-02-28 23:13:20,519::task::568::TaskManager.Task::(_updateState) Task=`2a0702ba-1255-483b-a30e-1e930240d25e`::moving from state init -> state preparing >Thread-87::INFO::2013-02-28 23:13:20,519::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-87::INFO::2013-02-28 23:13:20,519::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00876307487488', 'lastCheck': '9.7', 'code': 0, 'valid': True}} >Thread-87::DEBUG::2013-02-28 23:13:20,520::task::1151::TaskManager.Task::(prepare) Task=`2a0702ba-1255-483b-a30e-1e930240d25e`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00876307487488', 'lastCheck': '9.7', 'code': 0, 'valid': True}} >Thread-87::DEBUG::2013-02-28 23:13:20,520::task::568::TaskManager.Task::(_updateState) Task=`2a0702ba-1255-483b-a30e-1e930240d25e`::moving from state preparing -> state finished >Thread-87::DEBUG::2013-02-28 23:13:20,520::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-87::DEBUG::2013-02-28 23:13:20,520::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-87::DEBUG::2013-02-28 23:13:20,520::task::957::TaskManager.Task::(_decref) Task=`2a0702ba-1255-483b-a30e-1e930240d25e`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:13:20,846::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:13:20,854::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000345024 s, 11.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:13:30,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:13:30,866::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00037708 s, 10.9 MB/s\n'; <rc> = 0 >Thread-93::DEBUG::2013-02-28 23:13:35,835::task::568::TaskManager.Task::(_updateState) Task=`af8d45fa-2283-415d-8895-9eebd50c8d23`::moving from state init -> state preparing >Thread-93::INFO::2013-02-28 23:13:35,835::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-93::INFO::2013-02-28 23:13:35,835::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00851702690125', 'lastCheck': '5.0', 'code': 0, 'valid': True}} >Thread-93::DEBUG::2013-02-28 23:13:35,836::task::1151::TaskManager.Task::(prepare) Task=`af8d45fa-2283-415d-8895-9eebd50c8d23`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00851702690125', 'lastCheck': '5.0', 'code': 0, 'valid': True}} >Thread-93::DEBUG::2013-02-28 23:13:35,836::task::568::TaskManager.Task::(_updateState) Task=`af8d45fa-2283-415d-8895-9eebd50c8d23`::moving from state preparing -> state finished >Thread-93::DEBUG::2013-02-28 23:13:35,836::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-93::DEBUG::2013-02-28 23:13:35,836::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-93::DEBUG::2013-02-28 23:13:35,836::task::957::TaskManager.Task::(_decref) Task=`af8d45fa-2283-415d-8895-9eebd50c8d23`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:13:40,869::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:13:40,877::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000463577 s, 8.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:13:50,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-99::DEBUG::2013-02-28 23:13:51,047::task::568::TaskManager.Task::(_updateState) Task=`b4a0be2f-8490-47ab-a759-ff2b448e0ddd`::moving from state init -> state preparing >Thread-99::INFO::2013-02-28 23:14:11,705::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-99::INFO::2013-02-28 23:14:11,706::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00862193107605', 'lastCheck': '30.8', 'code': 0, 'valid': True}} >Thread-99::DEBUG::2013-02-28 23:14:11,706::task::1151::TaskManager.Task::(prepare) Task=`b4a0be2f-8490-47ab-a759-ff2b448e0ddd`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00862193107605', 'lastCheck': '30.8', 'code': 0, 'valid': True}} >Thread-99::DEBUG::2013-02-28 23:14:11,707::task::568::TaskManager.Task::(_updateState) Task=`b4a0be2f-8490-47ab-a759-ff2b448e0ddd`::moving from state preparing -> state finished >Thread-99::DEBUG::2013-02-28 23:14:11,708::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-99::DEBUG::2013-02-28 23:14:11,709::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2013-02-28 23:14:11,711::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000339372 s, 12.1 MB/s\n'; <rc> = 0 >Thread-99::DEBUG::2013-02-28 23:14:11,794::task::957::TaskManager.Task::(_decref) Task=`b4a0be2f-8490-47ab-a759-ff2b448e0ddd`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:14:21,808::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:14:38,013::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000297816 s, 13.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:14:48,018::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:15:04,560::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292665 s, 14.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:15:14,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:15:28,549::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000420869 s, 9.7 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-02-28 23:15:31,572::task::568::TaskManager.Task::(_updateState) Task=`c97c03be-a8b2-4589-aaaf-adfd600afc86`::moving from state init -> state preparing >Thread-105::INFO::2013-02-28 23:15:31,578::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-105::INFO::2013-02-28 23:15:31,578::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '13.9863660336', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-105::DEBUG::2013-02-28 23:15:31,578::task::1151::TaskManager.Task::(prepare) Task=`c97c03be-a8b2-4589-aaaf-adfd600afc86`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '13.9863660336', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-105::DEBUG::2013-02-28 23:15:31,578::task::568::TaskManager.Task::(_updateState) Task=`c97c03be-a8b2-4589-aaaf-adfd600afc86`::moving from state preparing -> state finished >Thread-105::DEBUG::2013-02-28 23:15:31,578::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-105::DEBUG::2013-02-28 23:15:31,579::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2013-02-28 23:15:31,579::task::957::TaskManager.Task::(_decref) Task=`c97c03be-a8b2-4589-aaaf-adfd600afc86`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:15:38,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:15:38,577::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645879 s, 6.3 MB/s\n'; <rc> = 0 >Thread-111::DEBUG::2013-02-28 23:15:46,806::task::568::TaskManager.Task::(_updateState) Task=`0ab08f17-bbbb-4051-8905-80aacba1145c`::moving from state init -> state preparing >Thread-19::DEBUG::2013-02-28 23:15:48,581::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-111::INFO::2013-02-28 23:15:59,476::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-111::INFO::2013-02-28 23:15:59,479::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.018208026886', 'lastCheck': '20.9', 'code': 0, 'valid': True}} >Thread-111::DEBUG::2013-02-28 23:15:59,482::task::1151::TaskManager.Task::(prepare) Task=`0ab08f17-bbbb-4051-8905-80aacba1145c`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.018208026886', 'lastCheck': '20.9', 'code': 0, 'valid': True}} >Thread-111::DEBUG::2013-02-28 23:15:59,485::task::568::TaskManager.Task::(_updateState) Task=`0ab08f17-bbbb-4051-8905-80aacba1145c`::moving from state preparing -> state finished >Thread-111::DEBUG::2013-02-28 23:15:59,487::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-111::DEBUG::2013-02-28 23:15:59,489::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-111::DEBUG::2013-02-28 23:15:59,490::task::957::TaskManager.Task::(_decref) Task=`0ab08f17-bbbb-4051-8905-80aacba1145c`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:15:59,498::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000360582 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:16:09,509::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:16:22,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000330637 s, 12.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:16:32,671::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-117::DEBUG::2013-02-28 23:16:35,284::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-19::DEBUG::2013-02-28 23:16:51,379::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000337203 s, 12.1 MB/s\n'; <rc> = 0 >Thread-117::DEBUG::2013-02-28 23:16:51,382::task::568::TaskManager.Task::(_updateState) Task=`f5557090-a62f-47e1-be6d-e4975702a080`::moving from state init -> state preparing >Thread-117::INFO::2013-02-28 23:16:51,383::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', hostID=2, scsiKey='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', remove=False, options=None) >Thread-117::DEBUG::2013-02-28 23:16:51,383::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`1d237bcb-30c8-457f-8a08-952605493e40`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-117::DEBUG::2013-02-28 23:16:51,384::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' for lock type 'exclusive' >Thread-117::DEBUG::2013-02-28 23:16:51,384::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free. Now locking as 'exclusive' (1 active user) >Thread-117::DEBUG::2013-02-28 23:16:51,384::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`1d237bcb-30c8-457f-8a08-952605493e40`::Granted request >Thread-117::DEBUG::2013-02-28 23:16:51,385::task::794::TaskManager.Task::(resourceAcquired) Task=`f5557090-a62f-47e1-be6d-e4975702a080`::_resourcesAcquired: Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f (exclusive) >Thread-117::DEBUG::2013-02-28 23:16:51,385::task::957::TaskManager.Task::(_decref) Task=`f5557090-a62f-47e1-be6d-e4975702a080`::ref 1 aborting False >Thread-117::INFO::2013-02-28 23:16:51,385::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f >Thread-48::INFO::2013-02-28 23:16:52,211::storage_mailbox::447::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-118::DEBUG::2013-02-28 23:16:54,569::task::568::TaskManager.Task::(_updateState) Task=`1af4c489-c15e-4a90-a437-acf0171ae8ba`::moving from state init -> state preparing >Thread-19::DEBUG::2013-02-28 23:17:01,383::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-48::INFO::2013-02-28 23:17:14,193::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-118::INFO::2013-02-28 23:17:14,194::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2013-02-28 23:17:14,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-48::DEBUG::2013-02-28 23:17:14,195::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16' (cwd None) >Thread-118::INFO::2013-02-28 23:17:14,195::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '18.7081389427', 'lastCheck': '22.8', 'code': 0, 'valid': True}} >Thread-19::DEBUG::2013-02-28 23:17:14,196::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata count=1' (cwd None) >Thread-118::DEBUG::2013-02-28 23:17:14,203::task::1151::TaskManager.Task::(prepare) Task=`1af4c489-c15e-4a90-a437-acf0171ae8ba`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '18.7081389427', 'lastCheck': '22.8', 'code': 0, 'valid': True}} >Thread-118::DEBUG::2013-02-28 23:17:14,210::task::568::TaskManager.Task::(_updateState) Task=`1af4c489-c15e-4a90-a437-acf0171ae8ba`::moving from state preparing -> state finished >Thread-118::DEBUG::2013-02-28 23:17:14,211::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-118::DEBUG::2013-02-28 23:17:14,212::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-118::DEBUG::2013-02-28 23:17:14,214::task::957::TaskManager.Task::(_decref) Task=`1af4c489-c15e-4a90-a437-acf0171ae8ba`::ref 0 aborting False >Thread-19::DEBUG::2013-02-28 23:17:14,214::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000294356 s, 7.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:17:14,215::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000294356 s, 7.0 MB/s'], size: 2048 >Thread-19::DEBUG::2013-02-28 23:17:14,216::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-19::WARNING::2013-02-28 23:17:14,217::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-19::DEBUG::2013-02-28 23:17:14,223::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-19::DEBUG::2013-02-28 23:17:14,223::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-19::DEBUG::2013-02-28 23:17:14,223::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-19::DEBUG::2013-02-28 23:17:14,223::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-19::DEBUG::2013-02-28 23:17:14,224::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-19::DEBUG::2013-02-28 23:17:14,224::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-19::DEBUG::2013-02-28 23:17:14,225::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-19::DEBUG::2013-02-28 23:17:17,677::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:17:17,679::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2013-02-28 23:17:17,680::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'VGUUID=3ih2tx-fDGO-jZdE-ZlvB-Pfzt-eLJW-oMfgEL', u'PV0=pv:3514f0c542a000482,uuid:GYP6rF-8Z8D-Qkpu-R1BH-scEc-geV1-RURoQw,pestart:0,pecount:237,mapoffset:0', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=2df5ac6e-fa65-418c-9f9c-575c05769c3b', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', 'POOL_DOMAINS=2df5ac6e-fa65-418c-9f9c-575c05769c3b:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=14368384b11099e66d094abe541eefe85ed68de6', 'POOL_SPM_LVER=0'] >Thread-19::WARNING::2013-02-28 23:17:17,682::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2df5ac6e-fa65-418c-9f9c-575c05769c3b_imageNS already registered >Thread-19::WARNING::2013-02-28 23:17:17,682::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2df5ac6e-fa65-418c-9f9c-575c05769c3b_volumeNS already registered >Thread-19::WARNING::2013-02-28 23:17:17,682::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2df5ac6e-fa65-418c-9f9c-575c05769c3b_lvmActivationNS already registered >Thread-19::DEBUG::2013-02-28 23:17:17,683::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-19::DEBUG::2013-02-28 23:17:17,880::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:17:17,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-19::DEBUG::2013-02-28 23:17:17,888::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000316349 s, 12.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2013-02-28 23:17:17,892::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-19::INFO::2013-02-28 23:17:17,893::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b (id: 2) >Thread-19::DEBUG::2013-02-28 23:17:19,893::clusterlock::205::SANLock::(releaseHostId) Host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b released successfully (id: 2) >Thread-117::INFO::2013-02-28 23:17:19,894::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-117::DEBUG::2013-02-28 23:17:19,894::task::1151::TaskManager.Task::(prepare) Task=`f5557090-a62f-47e1-be6d-e4975702a080`::finished: True >Thread-117::DEBUG::2013-02-28 23:17:19,894::task::568::TaskManager.Task::(_updateState) Task=`f5557090-a62f-47e1-be6d-e4975702a080`::moving from state preparing -> state finished >Thread-117::DEBUG::2013-02-28 23:17:19,894::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f': < ResourceRef 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', isValid: 'True' obj: 'None'>} >Thread-117::DEBUG::2013-02-28 23:17:19,894::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-117::DEBUG::2013-02-28 23:17:19,895::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' >Thread-117::DEBUG::2013-02-28 23:17:19,895::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' (0 active users) >Thread-117::DEBUG::2013-02-28 23:17:19,895::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free, finding out if anyone is waiting for it. >Thread-117::DEBUG::2013-02-28 23:17:19,895::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', Clearing records. >Thread-117::DEBUG::2013-02-28 23:17:19,896::task::957::TaskManager.Task::(_decref) Task=`f5557090-a62f-47e1-be6d-e4975702a080`::ref 0 aborting False >Thread-121::DEBUG::2013-02-28 23:17:19,981::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-121::DEBUG::2013-02-28 23:17:19,982::task::568::TaskManager.Task::(_updateState) Task=`3476a4ea-84e2-4237-b8ba-236f9d8a0d08`::moving from state init -> state preparing >Thread-121::INFO::2013-02-28 23:17:19,982::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >MainProcess|Thread-121::ERROR::2013-02-28 23:17:19,986::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-121::DEBUG::2013-02-28 23:17:20,001::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 1 -u' (cwd None) >Thread-121::DEBUG::2013-02-28 23:17:21,156::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-121::DEBUG::2013-02-28 23:17:21,175::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-121::DEBUG::2013-02-28 23:17:21,186::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-121::DEBUG::2013-02-28 23:17:21,195::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-121::DEBUG::2013-02-28 23:17:21,204::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-121::DEBUG::2013-02-28 23:17:21,216::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-121::DEBUG::2013-02-28 23:17:21,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-121::DEBUG::2013-02-28 23:17:21,776::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:21,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:21,905::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:22,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:22,977::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:22,980::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:22,982::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:22,985::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host7/scan' (cwd None) >MainProcess|Thread-121::DEBUG::2013-02-28 23:17:22,987::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-121::DEBUG::2013-02-28 23:17:24,990::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-121::DEBUG::2013-02-28 23:17:27,942::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-121::DEBUG::2013-02-28 23:17:27,943::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-121::DEBUG::2013-02-28 23:17:27,943::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-121::DEBUG::2013-02-28 23:17:27,944::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-121::DEBUG::2013-02-28 23:17:27,944::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-121::DEBUG::2013-02-28 23:17:27,945::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-121::DEBUG::2013-02-28 23:17:27,945::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-121::DEBUG::2013-02-28 23:17:27,945::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-121::INFO::2013-02-28 23:17:27,946::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-121::DEBUG::2013-02-28 23:17:27,946::task::1151::TaskManager.Task::(prepare) Task=`3476a4ea-84e2-4237-b8ba-236f9d8a0d08`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-121::DEBUG::2013-02-28 23:17:27,946::task::568::TaskManager.Task::(_updateState) Task=`3476a4ea-84e2-4237-b8ba-236f9d8a0d08`::moving from state preparing -> state finished >Thread-121::DEBUG::2013-02-28 23:17:27,946::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-121::DEBUG::2013-02-28 23:17:27,947::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-121::DEBUG::2013-02-28 23:17:27,947::task::957::TaskManager.Task::(_decref) Task=`3476a4ea-84e2-4237-b8ba-236f9d8a0d08`::ref 0 aborting False >Thread-125::DEBUG::2013-02-28 23:17:29,996::task::568::TaskManager.Task::(_updateState) Task=`0b9b0664-2904-41c5-8477-7c902d81dad2`::moving from state init -> state preparing >Thread-125::INFO::2013-02-28 23:17:29,996::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-125::INFO::2013-02-28 23:17:29,996::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-125::DEBUG::2013-02-28 23:17:29,997::task::1151::TaskManager.Task::(prepare) Task=`0b9b0664-2904-41c5-8477-7c902d81dad2`::finished: {} >Thread-125::DEBUG::2013-02-28 23:17:29,997::task::568::TaskManager.Task::(_updateState) Task=`0b9b0664-2904-41c5-8477-7c902d81dad2`::moving from state preparing -> state finished >Thread-125::DEBUG::2013-02-28 23:17:29,997::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-125::DEBUG::2013-02-28 23:17:29,997::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-125::DEBUG::2013-02-28 23:17:29,997::task::957::TaskManager.Task::(_decref) Task=`0b9b0664-2904-41c5-8477-7c902d81dad2`::ref 0 aborting False >Thread-131::DEBUG::2013-02-28 23:17:42,330::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-131::DEBUG::2013-02-28 23:17:42,340::task::568::TaskManager.Task::(_updateState) Task=`1d41a1b0-50dd-4748-932e-9700dc2811b0`::moving from state init -> state preparing >Thread-131::INFO::2013-02-28 23:17:42,345::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >Thread-131::DEBUG::2013-02-28 23:17:42,354::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-131::DEBUG::2013-02-28 23:17:42,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-131::DEBUG::2013-02-28 23:17:42,667::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-131::DEBUG::2013-02-28 23:17:42,897::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-131::DEBUG::2013-02-28 23:17:42,909::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-131::DEBUG::2013-02-28 23:17:43,121::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-131::INFO::2013-02-28 23:17:43,131::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-131::DEBUG::2013-02-28 23:17:43,135::task::1151::TaskManager.Task::(prepare) Task=`1d41a1b0-50dd-4748-932e-9700dc2811b0`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-131::DEBUG::2013-02-28 23:17:43,139::task::568::TaskManager.Task::(_updateState) Task=`1d41a1b0-50dd-4748-932e-9700dc2811b0`::moving from state preparing -> state finished >Thread-131::DEBUG::2013-02-28 23:17:43,142::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131::DEBUG::2013-02-28 23:17:43,145::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131::DEBUG::2013-02-28 23:17:43,148::task::957::TaskManager.Task::(_decref) Task=`1d41a1b0-50dd-4748-932e-9700dc2811b0`::ref 0 aborting False >Thread-132::DEBUG::2013-02-28 23:17:43,275::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-132::DEBUG::2013-02-28 23:17:43,283::task::568::TaskManager.Task::(_updateState) Task=`7e86a9ff-cc76-4efc-8e4e-740d04cf09dc`::moving from state init -> state preparing >Thread-132::INFO::2013-02-28 23:17:43,288::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', hostID=2, scsiKey='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', msdUUID='2df5ac6e-fa65-418c-9f9c-575c05769c3b', masterVersion=1, options=None) >Thread-132::DEBUG::2013-02-28 23:17:43,296::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`a738a0ee-8487-4d42-933e-82d40a976849`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-132::DEBUG::2013-02-28 23:17:43,298::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' for lock type 'exclusive' >Thread-132::DEBUG::2013-02-28 23:17:43,303::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free. Now locking as 'exclusive' (1 active user) >Thread-132::DEBUG::2013-02-28 23:17:43,306::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`a738a0ee-8487-4d42-933e-82d40a976849`::Granted request >Thread-132::INFO::2013-02-28 23:17:43,314::sp::627::Storage.StoragePool::(connect) Connect host #2 to the storage pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f with master domain: 2df5ac6e-fa65-418c-9f9c-575c05769c3b (ver = 1) >Thread-132::DEBUG::2013-02-28 23:17:43,322::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:43,325::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:43,328::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:43,331::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:43,334::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:43,338::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:43,342::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-132::DEBUG::2013-02-28 23:17:43,344::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-132::DEBUG::2013-02-28 23:17:43,347::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-132::DEBUG::2013-02-28 23:17:43,349::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-132::DEBUG::2013-02-28 23:17:43,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:43,623::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:43,663::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:43,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:44,746::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:44,788::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-133::DEBUG::2013-02-28 23:17:45,206::task::568::TaskManager.Task::(_updateState) Task=`a584d4e5-80fd-4561-9300-c807ccc731a7`::moving from state init -> state preparing >Thread-133::INFO::2013-02-28 23:17:45,206::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-133::INFO::2013-02-28 23:17:45,207::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-133::DEBUG::2013-02-28 23:17:45,207::task::1151::TaskManager.Task::(prepare) Task=`a584d4e5-80fd-4561-9300-c807ccc731a7`::finished: {} >Thread-133::DEBUG::2013-02-28 23:17:45,207::task::568::TaskManager.Task::(_updateState) Task=`a584d4e5-80fd-4561-9300-c807ccc731a7`::moving from state preparing -> state finished >Thread-133::DEBUG::2013-02-28 23:17:45,207::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-133::DEBUG::2013-02-28 23:17:45,208::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-133::DEBUG::2013-02-28 23:17:45,208::task::957::TaskManager.Task::(_decref) Task=`a584d4e5-80fd-4561-9300-c807ccc731a7`::ref 0 aborting False >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:45,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:45,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:46,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:46,822::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host7/scan' (cwd None) >MainProcess|Thread-132::DEBUG::2013-02-28 23:17:47,825::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-132::DEBUG::2013-02-28 23:17:49,829::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:52,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:52,668::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,673::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,673::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,673::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,674::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,674::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,674::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-132::DEBUG::2013-02-28 23:17:52,674::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:52,677::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:56,519::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:56,521::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,521::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-132::DEBUG::2013-02-28 23:17:56,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata count=1' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:56,528::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000384102 s, 5.3 MB/s\n'; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:56,528::misc::316::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000384102 s, 5.3 MB/s'], size: 2048 >Thread-132::DEBUG::2013-02-28 23:17:56,529::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-132::WARNING::2013-02-28 23:17:56,529::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-132::DEBUG::2013-02-28 23:17:56,531::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-132::DEBUG::2013-02-28 23:17:56,531::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,531::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,532::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,532::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,533::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,534::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:56,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:56,736::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,737::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'VGUUID=3ih2tx-fDGO-jZdE-ZlvB-Pfzt-eLJW-oMfgEL', u'PV0=pv:3514f0c542a000482,uuid:GYP6rF-8Z8D-Qkpu-R1BH-scEc-geV1-RURoQw,pestart:0,pecount:237,mapoffset:0', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=2df5ac6e-fa65-418c-9f9c-575c05769c3b', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', 'POOL_DOMAINS=2df5ac6e-fa65-418c-9f9c-575c05769c3b:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=e9ace1dcf9fd4e9496973d91bd1d52dfafdec1a1'] >Thread-132::DEBUG::2013-02-28 23:17:56,737::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,738::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:56,942::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:56,943::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-132::WARNING::2013-02-28 23:17:56,943::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2df5ac6e-fa65-418c-9f9c-575c05769c3b_imageNS already registered >Thread-132::WARNING::2013-02-28 23:17:56,944::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2df5ac6e-fa65-418c-9f9c-575c05769c3b_volumeNS already registered >Thread-132::WARNING::2013-02-28 23:17:56,944::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2df5ac6e-fa65-418c-9f9c-575c05769c3b_lvmActivationNS already registered >Thread-132::DEBUG::2013-02-28 23:17:56,944::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b verified, version 1 >Thread-132::DEBUG::2013-02-28 23:17:56,944::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-132::DEBUG::2013-02-28 23:17:56,945::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-132::DEBUG::2013-02-28 23:17:56,945::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,945::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,945::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,946::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,946::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:56,947::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:57,132::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:57,134::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:57,134::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['DESCRIPTION=master_sd', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'VGUUID=3ih2tx-fDGO-jZdE-ZlvB-Pfzt-eLJW-oMfgEL', u'PV0=pv:3514f0c542a000482,uuid:GYP6rF-8Z8D-Qkpu-R1BH-scEc-geV1-RURoQw,pestart:0,pecount:237,mapoffset:0', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=2df5ac6e-fa65-418c-9f9c-575c05769c3b', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=storage_sanity_31_dc', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', 'POOL_DOMAINS=2df5ac6e-fa65-418c-9f9c-575c05769c3b:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=e9ace1dcf9fd4e9496973d91bd1d52dfafdec1a1'] >Thread-132::DEBUG::2013-02-28 23:17:57,135::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f` started monitoring domain `2df5ac6e-fa65-418c-9f9c-575c05769c3b` >Thread-138::DEBUG::2013-02-28 23:17:57,135::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-132::DEBUG::2013-02-28 23:17:57,136::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-138::DEBUG::2013-02-28 23:17:57,138::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 2df5ac6e-fa65-418c-9f9c-575c05769c3b' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:57,144::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-132::DEBUG::2013-02-28 23:17:57,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a0002c2|3514f0c542a0002c4|3514f0c542a0003ea|3514f0c542a000425|3514f0c542a000427|3514f0c542a00042c|3514f0c542a000482|3514f0c542a000483|3514f0c542a000484%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-138::DEBUG::2013-02-28 23:17:57,321::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-138::DEBUG::2013-02-28 23:17:57,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:17:57,329::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287057 s, 14.3 MB/s\n'; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:57,334::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:57,336::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-138::INFO::2013-02-28 23:17:57,338::clusterlock::172::SANLock::(acquireHostId) Acquiring host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b (id: 2) >Thread-138::DEBUG::2013-02-28 23:17:57,342::clusterlock::190::SANLock::(acquireHostId) Host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b successfully acquired (id: 2) >Thread-132::WARNING::2013-02-28 23:17:57,380::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2df5ac6e-fa65-418c-9f9c-575c05769c3b/images already exists >Thread-132::WARNING::2013-02-28 23:17:57,380::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2df5ac6e-fa65-418c-9f9c-575c05769c3b/dom_md already exists >Thread-132::INFO::2013-02-28 23:17:57,381::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2df5ac6e-fa65-418c-9f9c-575c05769c3b to /rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-132::INFO::2013-02-28 23:17:57,382::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2df5ac6e-fa65-418c-9f9c-575c05769c3b to /rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd >Thread-132::DEBUG::2013-02-28 23:17:57,384::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-132::DEBUG::2013-02-28 23:17:57,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=16' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:57,396::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00157212 s, 2.6 MB/s\n'; <rc> = 0 >Thread-132::INFO::2013-02-28 23:17:57,397::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-132::DEBUG::2013-02-28 23:17:57,398::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16' (cwd None) >Thread-132::DEBUG::2013-02-28 23:17:58,406::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00181 s, 4.1 kB/s\n'; <rc> = 0 >Thread-132::DEBUG::2013-02-28 23:17:58,407::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f >Thread-132::DEBUG::2013-02-28 23:17:58,408::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f on master domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-132::DEBUG::2013-02-28 23:17:58,409::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' >Thread-132::DEBUG::2013-02-28 23:17:58,409::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' (0 active users) >Thread-132::DEBUG::2013-02-28 23:17:58,410::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free, finding out if anyone is waiting for it. >Thread-132::DEBUG::2013-02-28 23:17:58,410::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', Clearing records. >Thread-132::INFO::2013-02-28 23:17:58,411::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-132::DEBUG::2013-02-28 23:17:58,411::task::1151::TaskManager.Task::(prepare) Task=`7e86a9ff-cc76-4efc-8e4e-740d04cf09dc`::finished: True >Thread-132::DEBUG::2013-02-28 23:17:58,411::task::568::TaskManager.Task::(_updateState) Task=`7e86a9ff-cc76-4efc-8e4e-740d04cf09dc`::moving from state preparing -> state finished >Thread-132::DEBUG::2013-02-28 23:17:58,412::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-132::DEBUG::2013-02-28 23:17:58,412::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2013-02-28 23:17:58,412::task::957::TaskManager.Task::(_decref) Task=`7e86a9ff-cc76-4efc-8e4e-740d04cf09dc`::ref 0 aborting False >Thread-169::DEBUG::2013-02-28 23:18:00,417::task::568::TaskManager.Task::(_updateState) Task=`f5c9ac6d-0f32-424a-a039-bfbcb2aa8707`::moving from state init -> state preparing >Thread-169::INFO::2013-02-28 23:18:00,417::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-169::INFO::2013-02-28 23:18:00,417::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00774502754211', 'lastCheck': '3.1', 'code': 0, 'valid': True}} >Thread-169::DEBUG::2013-02-28 23:18:00,418::task::1151::TaskManager.Task::(prepare) Task=`f5c9ac6d-0f32-424a-a039-bfbcb2aa8707`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00774502754211', 'lastCheck': '3.1', 'code': 0, 'valid': True}} >Thread-169::DEBUG::2013-02-28 23:18:00,418::task::568::TaskManager.Task::(_updateState) Task=`f5c9ac6d-0f32-424a-a039-bfbcb2aa8707`::moving from state preparing -> state finished >Thread-169::DEBUG::2013-02-28 23:18:00,418::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-169::DEBUG::2013-02-28 23:18:00,418::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2013-02-28 23:18:00,418::task::957::TaskManager.Task::(_decref) Task=`f5c9ac6d-0f32-424a-a039-bfbcb2aa8707`::ref 0 aborting False >Thread-138::DEBUG::2013-02-28 23:18:07,346::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:18:07,358::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000362476 s, 11.3 MB/s\n'; <rc> = 0 >Thread-175::DEBUG::2013-02-28 23:18:15,711::task::568::TaskManager.Task::(_updateState) Task=`a6e37f99-d49a-4b3c-9b9c-e919feb5b2db`::moving from state init -> state preparing >Thread-175::INFO::2013-02-28 23:18:15,712::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-175::INFO::2013-02-28 23:18:15,712::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.0120480060577', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-175::DEBUG::2013-02-28 23:18:15,712::task::1151::TaskManager.Task::(prepare) Task=`a6e37f99-d49a-4b3c-9b9c-e919feb5b2db`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.0120480060577', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-175::DEBUG::2013-02-28 23:18:15,712::task::568::TaskManager.Task::(_updateState) Task=`a6e37f99-d49a-4b3c-9b9c-e919feb5b2db`::moving from state preparing -> state finished >Thread-175::DEBUG::2013-02-28 23:18:15,713::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-175::DEBUG::2013-02-28 23:18:15,713::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-175::DEBUG::2013-02-28 23:18:15,713::task::957::TaskManager.Task::(_decref) Task=`a6e37f99-d49a-4b3c-9b9c-e919feb5b2db`::ref 0 aborting False >Thread-138::DEBUG::2013-02-28 23:18:17,364::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:18:17,379::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00507527 s, 807 kB/s\n'; <rc> = 0 >Thread-138::DEBUG::2013-02-28 23:18:27,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:18:27,392::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000314766 s, 13.0 MB/s\n'; <rc> = 0 >Thread-181::DEBUG::2013-02-28 23:18:30,613::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-181::DEBUG::2013-02-28 23:18:30,614::task::568::TaskManager.Task::(_updateState) Task=`f6e5600d-df5f-4897-9c50-6869bccc7f20`::moving from state init -> state preparing >Thread-181::INFO::2013-02-28 23:18:30,614::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c', 'port': '3260'}], options=None) >MainProcess|Thread-181::ERROR::2013-02-28 23:18:30,617::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-181::DEBUG::2013-02-28 23:18:30,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 2 -u' (cwd None) >Thread-182::DEBUG::2013-02-28 23:18:30,916::task::568::TaskManager.Task::(_updateState) Task=`99fd4dbf-a688-4868-a4ba-110ba89ff326`::moving from state init -> state preparing >Thread-182::INFO::2013-02-28 23:18:30,917::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-182::INFO::2013-02-28 23:18:30,918::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00983595848083', 'lastCheck': '3.5', 'code': 0, 'valid': True}} >Thread-182::DEBUG::2013-02-28 23:18:30,918::task::1151::TaskManager.Task::(prepare) Task=`99fd4dbf-a688-4868-a4ba-110ba89ff326`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0.00983595848083', 'lastCheck': '3.5', 'code': 0, 'valid': True}} >Thread-182::DEBUG::2013-02-28 23:18:30,918::task::568::TaskManager.Task::(_updateState) Task=`99fd4dbf-a688-4868-a4ba-110ba89ff326`::moving from state preparing -> state finished >Thread-182::DEBUG::2013-02-28 23:18:30,919::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-182::DEBUG::2013-02-28 23:18:30,919::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-182::DEBUG::2013-02-28 23:18:30,920::task::957::TaskManager.Task::(_decref) Task=`99fd4dbf-a688-4868-a4ba-110ba89ff326`::ref 0 aborting False >Thread-181::DEBUG::2013-02-28 23:18:31,213::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-138::DEBUG::2013-02-28 23:18:37,397::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-181::DEBUG::2013-02-28 23:18:53,906::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-138::DEBUG::2013-02-28 23:18:53,910::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = "/bin/dd: reading `/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata': Input/output error\n0+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.00497704 s, 0.0 kB/s\n"; <rc> = 1 >Thread-181::DEBUG::2013-02-28 23:18:53,913::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-181::DEBUG::2013-02-28 23:18:53,913::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-181::DEBUG::2013-02-28 23:18:53,914::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-181::DEBUG::2013-02-28 23:18:53,914::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-181::DEBUG::2013-02-28 23:18:53,941::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-181::DEBUG::2013-02-28 23:18:53,941::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:53,942::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-138::ERROR::2013-02-28 23:18:53,911::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 188, in _monitorDomain > self.nextStatus.readDelay = self.domain.getReadDelay() > File "/usr/share/vdsm/storage/blockSD.py", line 568, in getReadDelay > misc.readfile(lvm.lvPath(self.sdUUID, sd.METADATA), 4096) > File "/usr/share/vdsm/storage/misc.py", line 280, in readfile > raise se.MiscFileReadException(name) >MiscFileReadException: Internal file read failure: ('/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata',) >Thread-138::DEBUG::2013-02-28 23:18:54,234::domainMonitor::216::Storage.DomainMonitorThread::(_monitorDomain) Domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b changed its status to Invalid >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:54,946::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:54,950::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:54,952::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:54,954::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:54,956::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-181::DEBUG::2013-02-28 23:18:54,958::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-181::DEBUG::2013-02-28 23:18:56,961::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-138::DEBUG::2013-02-28 23:19:04,235::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:19:05,490::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = "/bin/dd: reading `/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata': Input/output error\n0+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000122605 s, 0.0 kB/s\n"; <rc> = 1 >Thread-138::ERROR::2013-02-28 23:19:05,490::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 188, in _monitorDomain > self.nextStatus.readDelay = self.domain.getReadDelay() > File "/usr/share/vdsm/storage/blockSD.py", line 568, in getReadDelay > misc.readfile(lvm.lvPath(self.sdUUID, sd.METADATA), 4096) > File "/usr/share/vdsm/storage/misc.py", line 280, in readfile > raise se.MiscFileReadException(name) >MiscFileReadException: Internal file read failure: ('/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata',) >Thread-138::DEBUG::2013-02-28 23:19:15,492::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:19:32,561::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = "/bin/dd: reading `/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata': Input/output error\n0+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.00506463 s, 0.0 kB/s\n"; <rc> = 1 >Thread-138::ERROR::2013-02-28 23:19:32,561::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 188, in _monitorDomain > self.nextStatus.readDelay = self.domain.getReadDelay() > File "/usr/share/vdsm/storage/blockSD.py", line 568, in getReadDelay > misc.readfile(lvm.lvPath(self.sdUUID, sd.METADATA), 4096) > File "/usr/share/vdsm/storage/misc.py", line 280, in readfile > raise se.MiscFileReadException(name) >MiscFileReadException: Internal file read failure: ('/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata',) >Thread-138::DEBUG::2013-02-28 23:19:42,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata bs=4096 count=1' (cwd None) >Thread-138::DEBUG::2013-02-28 23:20:00,314::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = "/bin/dd: reading `/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata': Input/output error\n0+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000113508 s, 0.0 kB/s\n"; <rc> = 1 >Thread-138::ERROR::2013-02-28 23:20:00,314::domainMonitor::208::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 188, in _monitorDomain > self.nextStatus.readDelay = self.domain.getReadDelay() > File "/usr/share/vdsm/storage/blockSD.py", line 568, in getReadDelay > misc.readfile(lvm.lvPath(self.sdUUID, sd.METADATA), 4096) > File "/usr/share/vdsm/storage/misc.py", line 280, in readfile > raise se.MiscFileReadException(name) >MiscFileReadException: Internal file read failure: ('/dev/2df5ac6e-fa65-418c-9f9c-575c05769c3b/metadata',) >Thread-181::DEBUG::2013-02-28 23:20:01,348::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-181::DEBUG::2013-02-28 23:20:01,349::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-181::DEBUG::2013-02-28 23:20:01,349::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-181::DEBUG::2013-02-28 23:20:01,349::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-181::DEBUG::2013-02-28 23:20:01,350::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-181::DEBUG::2013-02-28 23:20:01,350::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-181::DEBUG::2013-02-28 23:20:01,350::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-181::DEBUG::2013-02-28 23:20:01,350::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-181::INFO::2013-02-28 23:20:01,351::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-181::DEBUG::2013-02-28 23:20:01,351::task::1151::TaskManager.Task::(prepare) Task=`f6e5600d-df5f-4897-9c50-6869bccc7f20`::finished: {'statuslist': [{'status': 0, 'id': '057e2aca-305a-4e21-a2c5-f6c9a3afb42c'}]} >Thread-181::DEBUG::2013-02-28 23:20:01,351::task::568::TaskManager.Task::(_updateState) Task=`f6e5600d-df5f-4897-9c50-6869bccc7f20`::moving from state preparing -> state finished >Thread-181::DEBUG::2013-02-28 23:20:01,351::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-181::DEBUG::2013-02-28 23:20:01,351::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-181::DEBUG::2013-02-28 23:20:01,352::task::957::TaskManager.Task::(_decref) Task=`f6e5600d-df5f-4897-9c50-6869bccc7f20`::ref 0 aborting False >Thread-188::DEBUG::2013-02-28 23:20:01,442::BindingXMLRPC::161::vds::(wrapper) [10.35.161.50] >Thread-188::DEBUG::2013-02-28 23:20:01,443::task::568::TaskManager.Task::(_updateState) Task=`6e1c4da5-c9ca-4c8e-965a-8e03e34ae6ab`::moving from state init -> state preparing >Thread-188::INFO::2013-02-28 23:20:01,443::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', hostID=2, scsiKey='362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', remove=False, options=None) >Thread-188::DEBUG::2013-02-28 23:20:01,444::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`5ab00f78-b8fd-4b6b-b6d3-5d92f9b6ccbb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-188::DEBUG::2013-02-28 23:20:01,444::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' for lock type 'exclusive' >Thread-188::DEBUG::2013-02-28 23:20:01,444::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free. Now locking as 'exclusive' (1 active user) >Thread-188::DEBUG::2013-02-28 23:20:01,444::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f`ReqID=`5ab00f78-b8fd-4b6b-b6d3-5d92f9b6ccbb`::Granted request >Thread-188::DEBUG::2013-02-28 23:20:01,445::task::794::TaskManager.Task::(resourceAcquired) Task=`6e1c4da5-c9ca-4c8e-965a-8e03e34ae6ab`::_resourcesAcquired: Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f (exclusive) >Thread-188::DEBUG::2013-02-28 23:20:01,445::task::957::TaskManager.Task::(_decref) Task=`6e1c4da5-c9ca-4c8e-965a-8e03e34ae6ab`::ref 1 aborting False >Thread-188::INFO::2013-02-28 23:20:01,445::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f >Thread-168::INFO::2013-02-28 23:20:02,422::storage_mailbox::447::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-168::INFO::2013-02-28 23:20:02,881::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-168::DEBUG::2013-02-28 23:20:02,882::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16' (cwd None) >Thread-168::DEBUG::2013-02-28 23:20:02,947::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = "/bin/dd: writing `/rhev/data-center/362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f/mastersd/dom_md/inbox': Input/output error\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.0552315 s, 0.0 kB/s\n"; <rc> = 1 >Thread-189::DEBUG::2013-02-28 23:20:03,351::task::568::TaskManager.Task::(_updateState) Task=`a1aa8bbd-528f-4bf6-9cbc-995255934b74`::moving from state init -> state preparing >Thread-189::INFO::2013-02-28 23:20:03,352::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-189::INFO::2013-02-28 23:20:03,352::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0', 'lastCheck': '3.0', 'code': 2001, 'valid': False}} >Thread-189::DEBUG::2013-02-28 23:20:03,352::task::1151::TaskManager.Task::(prepare) Task=`a1aa8bbd-528f-4bf6-9cbc-995255934b74`::finished: {'2df5ac6e-fa65-418c-9f9c-575c05769c3b': {'delay': '0', 'lastCheck': '3.0', 'code': 2001, 'valid': False}} >Thread-189::DEBUG::2013-02-28 23:20:03,352::task::568::TaskManager.Task::(_updateState) Task=`a1aa8bbd-528f-4bf6-9cbc-995255934b74`::moving from state preparing -> state finished >Thread-189::DEBUG::2013-02-28 23:20:03,352::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2013-02-28 23:20:03,353::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2013-02-28 23:20:03,353::task::957::TaskManager.Task::(_decref) Task=`a1aa8bbd-528f-4bf6-9cbc-995255934b74`::ref 0 aborting False >Thread-138::DEBUG::2013-02-28 23:20:03,408::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 2df5ac6e-fa65-418c-9f9c-575c05769c3b >Thread-138::INFO::2013-02-28 23:20:03,408::clusterlock::195::SANLock::(releaseHostId) Releasing host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b (id: 2) >Thread-138::DEBUG::2013-02-28 23:20:03,415::clusterlock::205::SANLock::(releaseHostId) Host id for domain 2df5ac6e-fa65-418c-9f9c-575c05769c3b released successfully (id: 2) >Thread-188::INFO::2013-02-28 23:20:03,416::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-188::DEBUG::2013-02-28 23:20:03,416::task::1151::TaskManager.Task::(prepare) Task=`6e1c4da5-c9ca-4c8e-965a-8e03e34ae6ab`::finished: True >Thread-188::DEBUG::2013-02-28 23:20:03,417::task::568::TaskManager.Task::(_updateState) Task=`6e1c4da5-c9ca-4c8e-965a-8e03e34ae6ab`::moving from state preparing -> state finished >Thread-188::DEBUG::2013-02-28 23:20:03,417::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f': < ResourceRef 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', isValid: 'True' obj: 'None'>} >Thread-188::DEBUG::2013-02-28 23:20:03,417::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-188::DEBUG::2013-02-28 23:20:03,418::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' >Thread-188::DEBUG::2013-02-28 23:20:03,418::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' (0 active users) >Thread-188::DEBUG::2013-02-28 23:20:03,418::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f' is free, finding out if anyone is waiting for it. >Thread-188::DEBUG::2013-02-28 23:20:03,419::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.362c5a0c-97a5-4fe6-94ea-5b98c0f3bb6f', Clearing records. >Thread-188::DEBUG::2013-02-28 23:20:03,419::task::957::TaskManager.Task::(_decref) Task=`6e1c4da5-c9ca-4c8e-965a-8e03e34ae6ab`::ref 0 aborting False >Thread-195::DEBUG::2013-02-28 23:20:18,588::task::568::TaskManager.Task::(_updateState) Task=`0eaccc6f-480c-4659-b111-771bbeed755e`::moving from state init -> state preparing >Thread-195::INFO::2013-02-28 23:20:18,589::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-195::INFO::2013-02-28 23:20:18,589::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-195::DEBUG::2013-02-28 23:20:18,589::task::1151::TaskManager.Task::(prepare) Task=`0eaccc6f-480c-4659-b111-771bbeed755e`::finished: {} >Thread-195::DEBUG::2013-02-28 23:20:18,590::task::568::TaskManager.Task::(_updateState) Task=`0eaccc6f-480c-4659-b111-771bbeed755e`::moving from state preparing -> state finished >Thread-195::DEBUG::2013-02-28 23:20:18,590::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-195::DEBUG::2013-02-28 23:20:18,590::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-195::DEBUG::2013-02-28 23:20:18,590::task::957::TaskManager.Task::(_decref) Task=`0eaccc6f-480c-4659-b111-771bbeed755e`::ref 0 aborting False >Thread-201::DEBUG::2013-02-28 23:20:33,809::task::568::TaskManager.Task::(_updateState) Task=`f4db17dd-681e-4b3d-b879-60dbfc61684f`::moving from state init -> state preparing >Thread-201::INFO::2013-02-28 23:20:37,478::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-201::INFO::2013-02-28 23:20:37,478::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-201::DEBUG::2013-02-28 23:20:37,478::task::1151::TaskManager.Task::(prepare) Task=`f4db17dd-681e-4b3d-b879-60dbfc61684f`::finished: {} >Thread-201::DEBUG::2013-02-28 23:20:37,478::task::568::TaskManager.Task::(_updateState) Task=`f4db17dd-681e-4b3d-b879-60dbfc61684f`::moving from state preparing -> state finished >Thread-201::DEBUG::2013-02-28 23:20:37,478::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-201::DEBUG::2013-02-28 23:20:37,479::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-201::DEBUG::2013-02-28 23:20:37,479::task::957::TaskManager.Task::(_decref) Task=`f4db17dd-681e-4b3d-b879-60dbfc61684f`::ref 0 aborting False >Thread-203::DEBUG::2013-02-28 23:20:40,666::task::568::TaskManager.Task::(_updateState) Task=`164ec525-3898-42b5-9b79-436d392f987e`::moving from state init -> state preparing >Thread-203::INFO::2013-02-28 23:20:49,869::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-203::INFO::2013-02-28 23:20:49,871::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-203::DEBUG::2013-02-28 23:20:49,871::task::1151::TaskManager.Task::(prepare) Task=`164ec525-3898-42b5-9b79-436d392f987e`::finished: {} >Thread-203::DEBUG::2013-02-28 23:20:49,871::task::568::TaskManager.Task::(_updateState) Task=`164ec525-3898-42b5-9b79-436d392f987e`::moving from state preparing -> state finished >Thread-203::DEBUG::2013-02-28 23:20:49,871::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-203::DEBUG::2013-02-28 23:20:49,871::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2013-02-28 23:20:49,871::task::957::TaskManager.Task::(_decref) Task=`164ec525-3898-42b5-9b79-436d392f987e`::ref 0 aborting False >MainThread::INFO::2013-02-28 23:26:13,256::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-02-28 23:26:13,264::task::568::TaskManager.Task::(_updateState) Task=`d51a2e48-3f8b-4324-b26d-d09fc3b65b37`::moving from state init -> state preparing >MainThread::INFO::2013-02-28 23:26:13,264::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-02-28 23:26:13,265::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-02-28 23:26:13,271::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,273::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,275::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,277::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,279::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,280::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,282::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,284::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,286::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,288::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,290::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,292::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,294::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,296::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,298::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,300::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,302::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,304::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,306::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,308::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,310::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,312::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,314::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,316::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,318::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,319::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,321::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,323::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,325::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,327::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,329::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,331::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,333::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,335::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:13,337::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:26:14,260::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-02-28 23:26:14,267::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-02-28 23:26:14,270::task::1151::TaskManager.Task::(prepare) Task=`d51a2e48-3f8b-4324-b26d-d09fc3b65b37`::finished: None >MainThread::DEBUG::2013-02-28 23:26:14,272::task::568::TaskManager.Task::(_updateState) Task=`d51a2e48-3f8b-4324-b26d-d09fc3b65b37`::moving from state preparing -> state finished >MainThread::DEBUG::2013-02-28 23:26:14,276::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-02-28 23:26:14,278::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-02-28 23:26:14,281::task::957::TaskManager.Task::(_decref) Task=`d51a2e48-3f8b-4324-b26d-d09fc3b65b37`::ref 0 aborting False >MainThread::INFO::2013-02-28 23:26:14,284::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 12 other threads... >MainThread::INFO::2013-02-28 23:26:14,287::vdsm::99::vds::(run) <_MainThread(MainThread, started 140310478550784)> >MainThread::INFO::2013-02-28 23:26:14,289::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140310385989376)> >MainThread::INFO::2013-02-28 23:26:14,291::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 140310004889344)> >MainThread::INFO::2013-02-28 23:26:14,294::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 140309952440064)> >MainThread::INFO::2013-02-28 23:26:14,296::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 140309962929920)> >MainThread::INFO::2013-02-28 23:26:14,298::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 140309973419776)> >MainThread::INFO::2013-02-28 23:26:14,300::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 140309983909632)> >MainThread::INFO::2013-02-28 23:26:14,302::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140309503657728)> >MainThread::INFO::2013-02-28 23:26:14,304::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 140310222612224)> >MainThread::INFO::2013-02-28 23:26:14,307::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 140310233102080)> >MainThread::INFO::2013-02-28 23:26:14,309::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 140310243591936)> >MainThread::INFO::2013-02-28 23:26:14,311::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 140310254081792)> >MainThread::INFO::2013-02-28 23:26:14,313::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 140309994399488)> >MainThread::INFO::2013-02-28 23:31:43,631::vdsm::89::vds::(run) I am the actual vdsm 4.10-9.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-02-28 23:31:43,885::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-02-28 23:31:43,891::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-02-28 23:31:43,896::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-02-28 23:31:44,081::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,082::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,084::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,085::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,086::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,087::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,089::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,090::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,092::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,093::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,095::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,096::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,097::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,099::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,100::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,103::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,105::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,107::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,109::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,111::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,113::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,115::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,117::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,119::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,121::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,123::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,125::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,127::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,129::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,131::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,133::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,134::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,136::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,138::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,140::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-02-28 23:31:44,270::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-02-28 23:31:44,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py fed54ceb-98d9-4257-9a21-5a98eef1f02b 4129 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-02-28 23:31:44,533::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-02-28 23:31:44,534::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-02-28 23:31:44,534::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-02-28 23:31:44,534::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-02-28 23:31:44,535::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-02-28 23:31:44,535::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-02-28 23:31:44,537::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-02-28 23:31:46,278::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-02-28 23:31:46,286::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-02-28 23:31:46,286::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-02-28 23:31:46,526::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-02-28 23:31:46,526::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-02-28 23:31:46,532::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-02-28 23:31:46,533::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-02-28 23:31:46,533::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-02-28 23:31:46,547::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-02-28 23:31:46,549::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-02-28 23:31:46,549::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:46,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-02-28 23:31:46,577::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2013-02-28 23:31:46,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-02-28 23:31:46,624::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-02-28 23:31:46,625::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-02-28 23:31:46,625::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-02-28 23:31:46,626::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-02-28 23:31:46,635::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2013-02-28 23:31:46,637::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2013-02-28 23:31:46,637::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2013-02-28 23:31:46,662::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-02-28 23:31:46,663::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-02-28 23:31:46,690::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:31:46,756::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:31:46,757::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:46,757::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:46,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:31:46,960::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:31:46,961::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:46,962::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:31:47,167::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:31:47,168::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-02-28 23:31:47,168::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:31:47,168::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-02-28 23:31:47,169::misc::1027::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-02-28 23:31:47,169::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:31:47,183::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-02-28 23:31:47,184::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:47,187::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:48,191::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:48,194::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:48,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:48,200::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:48,203::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-02-28 23:31:48,205::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-02-28 23:31:50,209::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-02-28 23:31:51,336::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-02-28 23:31:51,336::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:51,337::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:51,337::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:51,338::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:51,338::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:51,338::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-02-28 23:31:51,339::misc::1035::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-02-28 23:31:51,339::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-02-28 23:32:00,379::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-13::DEBUG::2013-02-28 23:32:00,589::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-02-28 23:32:00,689::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-02-28 23:32:00,788::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-02-28 23:32:00,851::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-15::DEBUG::2013-02-28 23:32:00,878::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >Thread-16::DEBUG::2013-02-28 23:32:00,924::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-02-28 23:32:00,926::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-18::DEBUG::2013-02-28 23:32:04,160::task::568::TaskManager.Task::(_updateState) Task=`246cc011-9d16-41e4-a934-0a45cfe4b87f`::moving from state init -> state preparing >Thread-18::INFO::2013-02-28 23:32:04,166::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::INFO::2013-02-28 23:32:04,169::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-18::DEBUG::2013-02-28 23:32:04,171::task::1151::TaskManager.Task::(prepare) Task=`246cc011-9d16-41e4-a934-0a45cfe4b87f`::finished: {} >Thread-18::DEBUG::2013-02-28 23:32:04,174::task::568::TaskManager.Task::(_updateState) Task=`246cc011-9d16-41e4-a934-0a45cfe4b87f`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-02-28 23:32:04,176::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-02-28 23:32:04,179::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-02-28 23:32:04,182::task::957::TaskManager.Task::(_decref) Task=`246cc011-9d16-41e4-a934-0a45cfe4b87f`::ref 0 aborting False >Thread-24::DEBUG::2013-02-28 23:32:19,582::task::568::TaskManager.Task::(_updateState) Task=`292955be-7bc0-4d2e-ba17-2007083b1634`::moving from state init -> state preparing >Thread-24::INFO::2013-02-28 23:32:19,588::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2013-02-28 23:32:19,588::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2013-02-28 23:32:19,589::task::1151::TaskManager.Task::(prepare) Task=`292955be-7bc0-4d2e-ba17-2007083b1634`::finished: {} >Thread-24::DEBUG::2013-02-28 23:32:19,589::task::568::TaskManager.Task::(_updateState) Task=`292955be-7bc0-4d2e-ba17-2007083b1634`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-02-28 23:32:19,589::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-02-28 23:32:19,589::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-02-28 23:32:19,590::task::957::TaskManager.Task::(_decref) Task=`292955be-7bc0-4d2e-ba17-2007083b1634`::ref 0 aborting False >Thread-30::DEBUG::2013-02-28 23:32:35,005::task::568::TaskManager.Task::(_updateState) Task=`2070e79e-c720-45a4-bc11-00f6d1bcef36`::moving from state init -> state preparing >Thread-30::INFO::2013-02-28 23:32:35,011::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2013-02-28 23:32:35,014::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-30::DEBUG::2013-02-28 23:32:35,016::task::1151::TaskManager.Task::(prepare) Task=`2070e79e-c720-45a4-bc11-00f6d1bcef36`::finished: {} >Thread-30::DEBUG::2013-02-28 23:32:35,019::task::568::TaskManager.Task::(_updateState) Task=`2070e79e-c720-45a4-bc11-00f6d1bcef36`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-02-28 23:32:35,021::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-02-28 23:32:35,024::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-02-28 23:32:35,026::task::957::TaskManager.Task::(_decref) Task=`2070e79e-c720-45a4-bc11-00f6d1bcef36`::ref 0 aborting False >Thread-36::DEBUG::2013-02-28 23:32:50,368::task::568::TaskManager.Task::(_updateState) Task=`fba1f543-4d6d-4dea-93a6-bf59407e7c42`::moving from state init -> state preparing >Thread-36::INFO::2013-02-28 23:32:50,369::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-36::INFO::2013-02-28 23:32:50,369::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-36::DEBUG::2013-02-28 23:32:50,369::task::1151::TaskManager.Task::(prepare) Task=`fba1f543-4d6d-4dea-93a6-bf59407e7c42`::finished: {} >Thread-36::DEBUG::2013-02-28 23:32:50,369::task::568::TaskManager.Task::(_updateState) Task=`fba1f543-4d6d-4dea-93a6-bf59407e7c42`::moving from state preparing -> state finished >Thread-36::DEBUG::2013-02-28 23:32:50,370::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2013-02-28 23:32:50,370::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2013-02-28 23:32:50,370::task::957::TaskManager.Task::(_decref) Task=`fba1f543-4d6d-4dea-93a6-bf59407e7c42`::ref 0 aborting False >Thread-42::DEBUG::2013-02-28 23:33:05,620::task::568::TaskManager.Task::(_updateState) Task=`2e079c1e-b9ab-431d-911d-707c3f04a8d5`::moving from state init -> state preparing >Thread-42::INFO::2013-02-28 23:33:05,620::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-42::INFO::2013-02-28 23:33:05,620::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-42::DEBUG::2013-02-28 23:33:05,620::task::1151::TaskManager.Task::(prepare) Task=`2e079c1e-b9ab-431d-911d-707c3f04a8d5`::finished: {} >Thread-42::DEBUG::2013-02-28 23:33:05,621::task::568::TaskManager.Task::(_updateState) Task=`2e079c1e-b9ab-431d-911d-707c3f04a8d5`::moving from state preparing -> state finished >Thread-42::DEBUG::2013-02-28 23:33:05,621::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-42::DEBUG::2013-02-28 23:33:05,621::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::DEBUG::2013-02-28 23:33:05,621::task::957::TaskManager.Task::(_decref) Task=`2e079c1e-b9ab-431d-911d-707c3f04a8d5`::ref 0 aborting False >Thread-48::DEBUG::2013-02-28 23:33:20,948::task::568::TaskManager.Task::(_updateState) Task=`9873b747-129c-4ff2-96b1-51d42c5c402d`::moving from state init -> state preparing >Thread-48::INFO::2013-02-28 23:33:20,948::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-48::INFO::2013-02-28 23:33:20,948::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-48::DEBUG::2013-02-28 23:33:20,948::task::1151::TaskManager.Task::(prepare) Task=`9873b747-129c-4ff2-96b1-51d42c5c402d`::finished: {} >Thread-48::DEBUG::2013-02-28 23:33:20,949::task::568::TaskManager.Task::(_updateState) Task=`9873b747-129c-4ff2-96b1-51d42c5c402d`::moving from state preparing -> state finished >Thread-48::DEBUG::2013-02-28 23:33:20,949::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2013-02-28 23:33:20,949::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2013-02-28 23:33:20,949::task::957::TaskManager.Task::(_decref) Task=`9873b747-129c-4ff2-96b1-51d42c5c402d`::ref 0 aborting False >Thread-54::DEBUG::2013-02-28 23:33:36,195::task::568::TaskManager.Task::(_updateState) Task=`757064ee-f6d3-4a90-a37c-6d1797d03014`::moving from state init -> state preparing >Thread-54::INFO::2013-02-28 23:33:36,196::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54::INFO::2013-02-28 23:33:36,196::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-54::DEBUG::2013-02-28 23:33:36,196::task::1151::TaskManager.Task::(prepare) Task=`757064ee-f6d3-4a90-a37c-6d1797d03014`::finished: {} >Thread-54::DEBUG::2013-02-28 23:33:36,196::task::568::TaskManager.Task::(_updateState) Task=`757064ee-f6d3-4a90-a37c-6d1797d03014`::moving from state preparing -> state finished >Thread-54::DEBUG::2013-02-28 23:33:36,197::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2013-02-28 23:33:36,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2013-02-28 23:33:36,197::task::957::TaskManager.Task::(_decref) Task=`757064ee-f6d3-4a90-a37c-6d1797d03014`::ref 0 aborting False >Thread-60::DEBUG::2013-02-28 23:33:51,503::task::568::TaskManager.Task::(_updateState) Task=`ab9af7c5-d46e-4d34-a6a3-92df3133f006`::moving from state init -> state preparing >Thread-60::INFO::2013-02-28 23:33:51,503::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-60::INFO::2013-02-28 23:33:51,503::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-60::DEBUG::2013-02-28 23:33:51,503::task::1151::TaskManager.Task::(prepare) Task=`ab9af7c5-d46e-4d34-a6a3-92df3133f006`::finished: {} >Thread-60::DEBUG::2013-02-28 23:33:51,504::task::568::TaskManager.Task::(_updateState) Task=`ab9af7c5-d46e-4d34-a6a3-92df3133f006`::moving from state preparing -> state finished >Thread-60::DEBUG::2013-02-28 23:33:51,504::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2013-02-28 23:33:51,504::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2013-02-28 23:33:51,504::task::957::TaskManager.Task::(_decref) Task=`ab9af7c5-d46e-4d34-a6a3-92df3133f006`::ref 0 aborting False >Thread-66::DEBUG::2013-02-28 23:34:06,847::task::568::TaskManager.Task::(_updateState) Task=`0f1e1798-1593-488d-b449-68d4628d60ba`::moving from state init -> state preparing >Thread-66::INFO::2013-02-28 23:34:06,847::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-66::INFO::2013-02-28 23:34:06,847::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-66::DEBUG::2013-02-28 23:34:06,848::task::1151::TaskManager.Task::(prepare) Task=`0f1e1798-1593-488d-b449-68d4628d60ba`::finished: {} >Thread-66::DEBUG::2013-02-28 23:34:06,848::task::568::TaskManager.Task::(_updateState) Task=`0f1e1798-1593-488d-b449-68d4628d60ba`::moving from state preparing -> state finished >Thread-66::DEBUG::2013-02-28 23:34:06,848::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-66::DEBUG::2013-02-28 23:34:06,848::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-66::DEBUG::2013-02-28 23:34:06,848::task::957::TaskManager.Task::(_decref) Task=`0f1e1798-1593-488d-b449-68d4628d60ba`::ref 0 aborting False >Thread-72::DEBUG::2013-02-28 23:34:22,079::task::568::TaskManager.Task::(_updateState) Task=`31d068cb-8e41-4ab1-9f24-527cd72d8013`::moving from state init -> state preparing >Thread-72::INFO::2013-02-28 23:34:22,079::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-72::INFO::2013-02-28 23:34:22,079::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-72::DEBUG::2013-02-28 23:34:22,079::task::1151::TaskManager.Task::(prepare) Task=`31d068cb-8e41-4ab1-9f24-527cd72d8013`::finished: {} >Thread-72::DEBUG::2013-02-28 23:34:22,079::task::568::TaskManager.Task::(_updateState) Task=`31d068cb-8e41-4ab1-9f24-527cd72d8013`::moving from state preparing -> state finished >Thread-72::DEBUG::2013-02-28 23:34:22,080::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-72::DEBUG::2013-02-28 23:34:22,080::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-72::DEBUG::2013-02-28 23:34:22,080::task::957::TaskManager.Task::(_decref) Task=`31d068cb-8e41-4ab1-9f24-527cd72d8013`::ref 0 aborting False >Thread-78::DEBUG::2013-02-28 23:34:37,300::task::568::TaskManager.Task::(_updateState) Task=`f39dfd8a-b315-4fa4-bd14-aebcc6dc6abc`::moving from state init -> state preparing >Thread-78::INFO::2013-02-28 23:34:37,300::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-78::INFO::2013-02-28 23:34:37,300::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-78::DEBUG::2013-02-28 23:34:37,300::task::1151::TaskManager.Task::(prepare) Task=`f39dfd8a-b315-4fa4-bd14-aebcc6dc6abc`::finished: {} >Thread-78::DEBUG::2013-02-28 23:34:37,301::task::568::TaskManager.Task::(_updateState) Task=`f39dfd8a-b315-4fa4-bd14-aebcc6dc6abc`::moving from state preparing -> state finished >Thread-78::DEBUG::2013-02-28 23:34:37,301::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2013-02-28 23:34:37,301::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2013-02-28 23:34:37,301::task::957::TaskManager.Task::(_decref) Task=`f39dfd8a-b315-4fa4-bd14-aebcc6dc6abc`::ref 0 aborting False >Thread-84::DEBUG::2013-02-28 23:34:52,582::task::568::TaskManager.Task::(_updateState) Task=`c0c9b36a-39b9-4c1a-9383-f511b7d84bb2`::moving from state init -> state preparing >Thread-84::INFO::2013-02-28 23:34:52,582::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-84::INFO::2013-02-28 23:34:52,582::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-84::DEBUG::2013-02-28 23:34:52,582::task::1151::TaskManager.Task::(prepare) Task=`c0c9b36a-39b9-4c1a-9383-f511b7d84bb2`::finished: {} >Thread-84::DEBUG::2013-02-28 23:34:52,583::task::568::TaskManager.Task::(_updateState) Task=`c0c9b36a-39b9-4c1a-9383-f511b7d84bb2`::moving from state preparing -> state finished >Thread-84::DEBUG::2013-02-28 23:34:52,583::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84::DEBUG::2013-02-28 23:34:52,583::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2013-02-28 23:34:52,583::task::957::TaskManager.Task::(_decref) Task=`c0c9b36a-39b9-4c1a-9383-f511b7d84bb2`::ref 0 aborting False >Thread-90::DEBUG::2013-02-28 23:35:07,882::task::568::TaskManager.Task::(_updateState) Task=`ad53f668-32d9-49e7-8500-31da481cf5ad`::moving from state init -> state preparing >Thread-90::INFO::2013-02-28 23:35:07,883::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-90::INFO::2013-02-28 23:35:07,883::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-90::DEBUG::2013-02-28 23:35:07,883::task::1151::TaskManager.Task::(prepare) Task=`ad53f668-32d9-49e7-8500-31da481cf5ad`::finished: {} >Thread-90::DEBUG::2013-02-28 23:35:07,883::task::568::TaskManager.Task::(_updateState) Task=`ad53f668-32d9-49e7-8500-31da481cf5ad`::moving from state preparing -> state finished >Thread-90::DEBUG::2013-02-28 23:35:07,884::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-90::DEBUG::2013-02-28 23:35:07,884::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-90::DEBUG::2013-02-28 23:35:07,884::task::957::TaskManager.Task::(_decref) Task=`ad53f668-32d9-49e7-8500-31da481cf5ad`::ref 0 aborting False >Thread-96::DEBUG::2013-02-28 23:35:23,167::task::568::TaskManager.Task::(_updateState) Task=`66c7d876-b46f-4e9b-8b6e-e5060872c776`::moving from state init -> state preparing >Thread-96::INFO::2013-02-28 23:35:23,167::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-96::INFO::2013-02-28 23:35:23,167::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-96::DEBUG::2013-02-28 23:35:23,167::task::1151::TaskManager.Task::(prepare) Task=`66c7d876-b46f-4e9b-8b6e-e5060872c776`::finished: {} >Thread-96::DEBUG::2013-02-28 23:35:23,167::task::568::TaskManager.Task::(_updateState) Task=`66c7d876-b46f-4e9b-8b6e-e5060872c776`::moving from state preparing -> state finished >Thread-96::DEBUG::2013-02-28 23:35:23,168::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-96::DEBUG::2013-02-28 23:35:23,168::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-96::DEBUG::2013-02-28 23:35:23,168::task::957::TaskManager.Task::(_decref) Task=`66c7d876-b46f-4e9b-8b6e-e5060872c776`::ref 0 aborting False >Thread-102::DEBUG::2013-02-28 23:35:38,476::task::568::TaskManager.Task::(_updateState) Task=`06a21b5a-7295-474c-a07d-8a0a7e53b6bb`::moving from state init -> state preparing >Thread-102::INFO::2013-02-28 23:35:38,481::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-102::INFO::2013-02-28 23:35:38,484::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-102::DEBUG::2013-02-28 23:35:38,486::task::1151::TaskManager.Task::(prepare) Task=`06a21b5a-7295-474c-a07d-8a0a7e53b6bb`::finished: {} >Thread-102::DEBUG::2013-02-28 23:35:38,488::task::568::TaskManager.Task::(_updateState) Task=`06a21b5a-7295-474c-a07d-8a0a7e53b6bb`::moving from state preparing -> state finished >Thread-102::DEBUG::2013-02-28 23:35:38,491::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2013-02-28 23:35:38,494::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2013-02-28 23:35:38,497::task::957::TaskManager.Task::(_decref) Task=`06a21b5a-7295-474c-a07d-8a0a7e53b6bb`::ref 0 aborting False >Thread-108::DEBUG::2013-02-28 23:35:53,835::task::568::TaskManager.Task::(_updateState) Task=`5bf15d42-c74a-4f06-9a4a-60d7cf86254d`::moving from state init -> state preparing >Thread-108::INFO::2013-02-28 23:35:53,835::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-108::INFO::2013-02-28 23:35:53,835::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-108::DEBUG::2013-02-28 23:35:53,835::task::1151::TaskManager.Task::(prepare) Task=`5bf15d42-c74a-4f06-9a4a-60d7cf86254d`::finished: {} >Thread-108::DEBUG::2013-02-28 23:35:53,836::task::568::TaskManager.Task::(_updateState) Task=`5bf15d42-c74a-4f06-9a4a-60d7cf86254d`::moving from state preparing -> state finished >Thread-108::DEBUG::2013-02-28 23:35:53,836::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-108::DEBUG::2013-02-28 23:35:53,836::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-108::DEBUG::2013-02-28 23:35:53,836::task::957::TaskManager.Task::(_decref) Task=`5bf15d42-c74a-4f06-9a4a-60d7cf86254d`::ref 0 aborting False >Thread-114::DEBUG::2013-02-28 23:36:09,054::task::568::TaskManager.Task::(_updateState) Task=`81fe183c-b8e4-4b8e-8aaf-d4cd63e2b3f5`::moving from state init -> state preparing >Thread-114::INFO::2013-02-28 23:36:09,055::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-114::INFO::2013-02-28 23:36:09,105::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-114::DEBUG::2013-02-28 23:36:09,105::task::1151::TaskManager.Task::(prepare) Task=`81fe183c-b8e4-4b8e-8aaf-d4cd63e2b3f5`::finished: {} >Thread-114::DEBUG::2013-02-28 23:36:09,105::task::568::TaskManager.Task::(_updateState) Task=`81fe183c-b8e4-4b8e-8aaf-d4cd63e2b3f5`::moving from state preparing -> state finished >Thread-114::DEBUG::2013-02-28 23:36:09,105::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-114::DEBUG::2013-02-28 23:36:09,105::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-114::DEBUG::2013-02-28 23:36:09,106::task::957::TaskManager.Task::(_decref) Task=`81fe183c-b8e4-4b8e-8aaf-d4cd63e2b3f5`::ref 0 aborting False >Thread-120::DEBUG::2013-02-28 23:36:24,367::task::568::TaskManager.Task::(_updateState) Task=`184f9418-6cea-47c1-a810-63c147430440`::moving from state init -> state preparing >Thread-120::INFO::2013-02-28 23:36:24,367::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-120::INFO::2013-02-28 23:36:24,367::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-120::DEBUG::2013-02-28 23:36:24,368::task::1151::TaskManager.Task::(prepare) Task=`184f9418-6cea-47c1-a810-63c147430440`::finished: {} >Thread-120::DEBUG::2013-02-28 23:36:24,368::task::568::TaskManager.Task::(_updateState) Task=`184f9418-6cea-47c1-a810-63c147430440`::moving from state preparing -> state finished >Thread-120::DEBUG::2013-02-28 23:36:24,368::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-120::DEBUG::2013-02-28 23:36:24,368::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-120::DEBUG::2013-02-28 23:36:24,369::task::957::TaskManager.Task::(_decref) Task=`184f9418-6cea-47c1-a810-63c147430440`::ref 0 aborting False >Thread-126::DEBUG::2013-02-28 23:36:39,716::task::568::TaskManager.Task::(_updateState) Task=`0f6d8fa0-8ff4-4eb4-8e79-2ca10f89d1ce`::moving from state init -> state preparing >Thread-126::INFO::2013-02-28 23:36:39,716::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-126::INFO::2013-02-28 23:36:39,716::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-126::DEBUG::2013-02-28 23:36:39,716::task::1151::TaskManager.Task::(prepare) Task=`0f6d8fa0-8ff4-4eb4-8e79-2ca10f89d1ce`::finished: {} >Thread-126::DEBUG::2013-02-28 23:36:39,717::task::568::TaskManager.Task::(_updateState) Task=`0f6d8fa0-8ff4-4eb4-8e79-2ca10f89d1ce`::moving from state preparing -> state finished >Thread-126::DEBUG::2013-02-28 23:36:39,717::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-126::DEBUG::2013-02-28 23:36:39,717::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-126::DEBUG::2013-02-28 23:36:39,717::task::957::TaskManager.Task::(_decref) Task=`0f6d8fa0-8ff4-4eb4-8e79-2ca10f89d1ce`::ref 0 aborting False >Thread-132::DEBUG::2013-02-28 23:36:55,020::task::568::TaskManager.Task::(_updateState) Task=`38a829e2-64b0-46b2-abc8-dfb85c4ec567`::moving from state init -> state preparing >Thread-132::INFO::2013-02-28 23:36:55,020::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-132::INFO::2013-02-28 23:36:55,020::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-132::DEBUG::2013-02-28 23:36:55,020::task::1151::TaskManager.Task::(prepare) Task=`38a829e2-64b0-46b2-abc8-dfb85c4ec567`::finished: {} >Thread-132::DEBUG::2013-02-28 23:36:55,021::task::568::TaskManager.Task::(_updateState) Task=`38a829e2-64b0-46b2-abc8-dfb85c4ec567`::moving from state preparing -> state finished >Thread-132::DEBUG::2013-02-28 23:36:55,021::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-132::DEBUG::2013-02-28 23:36:55,021::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2013-02-28 23:36:55,021::task::957::TaskManager.Task::(_decref) Task=`38a829e2-64b0-46b2-abc8-dfb85c4ec567`::ref 0 aborting False >Thread-138::DEBUG::2013-02-28 23:37:10,274::task::568::TaskManager.Task::(_updateState) Task=`9a8eae87-f461-46a2-b9da-7a6b5f612348`::moving from state init -> state preparing >Thread-138::INFO::2013-02-28 23:37:10,274::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-138::INFO::2013-02-28 23:37:10,275::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-138::DEBUG::2013-02-28 23:37:10,275::task::1151::TaskManager.Task::(prepare) Task=`9a8eae87-f461-46a2-b9da-7a6b5f612348`::finished: {} >Thread-138::DEBUG::2013-02-28 23:37:10,275::task::568::TaskManager.Task::(_updateState) Task=`9a8eae87-f461-46a2-b9da-7a6b5f612348`::moving from state preparing -> state finished >Thread-138::DEBUG::2013-02-28 23:37:10,275::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138::DEBUG::2013-02-28 23:37:10,276::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2013-02-28 23:37:10,276::task::957::TaskManager.Task::(_decref) Task=`9a8eae87-f461-46a2-b9da-7a6b5f612348`::ref 0 aborting False >Thread-144::DEBUG::2013-02-28 23:37:25,563::task::568::TaskManager.Task::(_updateState) Task=`2b6cb5e5-1565-4927-8e10-f9d23fb200ed`::moving from state init -> state preparing >Thread-144::INFO::2013-02-28 23:37:25,566::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-144::INFO::2013-02-28 23:37:25,568::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-144::DEBUG::2013-02-28 23:37:25,571::task::1151::TaskManager.Task::(prepare) Task=`2b6cb5e5-1565-4927-8e10-f9d23fb200ed`::finished: {} >Thread-144::DEBUG::2013-02-28 23:37:25,573::task::568::TaskManager.Task::(_updateState) Task=`2b6cb5e5-1565-4927-8e10-f9d23fb200ed`::moving from state preparing -> state finished >Thread-144::DEBUG::2013-02-28 23:37:25,576::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-144::DEBUG::2013-02-28 23:37:25,578::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2013-02-28 23:37:25,580::task::957::TaskManager.Task::(_decref) Task=`2b6cb5e5-1565-4927-8e10-f9d23fb200ed`::ref 0 aborting False >Thread-150::DEBUG::2013-02-28 23:37:40,917::task::568::TaskManager.Task::(_updateState) Task=`bae8cfaa-56f1-4729-b969-936897311e40`::moving from state init -> state preparing >Thread-150::INFO::2013-02-28 23:37:40,917::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-150::INFO::2013-02-28 23:37:40,917::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-150::DEBUG::2013-02-28 23:37:40,917::task::1151::TaskManager.Task::(prepare) Task=`bae8cfaa-56f1-4729-b969-936897311e40`::finished: {} >Thread-150::DEBUG::2013-02-28 23:37:40,918::task::568::TaskManager.Task::(_updateState) Task=`bae8cfaa-56f1-4729-b969-936897311e40`::moving from state preparing -> state finished >Thread-150::DEBUG::2013-02-28 23:37:40,918::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-150::DEBUG::2013-02-28 23:37:40,918::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2013-02-28 23:37:40,918::task::957::TaskManager.Task::(_decref) Task=`bae8cfaa-56f1-4729-b969-936897311e40`::ref 0 aborting False >Thread-156::DEBUG::2013-02-28 23:37:56,170::task::568::TaskManager.Task::(_updateState) Task=`96cb2d52-85bb-4047-9d42-b3f1907a5ec6`::moving from state init -> state preparing >Thread-156::INFO::2013-02-28 23:37:56,170::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-156::INFO::2013-02-28 23:37:56,171::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-156::DEBUG::2013-02-28 23:37:56,171::task::1151::TaskManager.Task::(prepare) Task=`96cb2d52-85bb-4047-9d42-b3f1907a5ec6`::finished: {} >Thread-156::DEBUG::2013-02-28 23:37:56,171::task::568::TaskManager.Task::(_updateState) Task=`96cb2d52-85bb-4047-9d42-b3f1907a5ec6`::moving from state preparing -> state finished >Thread-156::DEBUG::2013-02-28 23:37:56,171::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-156::DEBUG::2013-02-28 23:37:56,172::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-156::DEBUG::2013-02-28 23:37:56,172::task::957::TaskManager.Task::(_decref) Task=`96cb2d52-85bb-4047-9d42-b3f1907a5ec6`::ref 0 aborting False >Thread-162::DEBUG::2013-02-28 23:38:11,416::task::568::TaskManager.Task::(_updateState) Task=`82407fb1-0022-4451-bcbf-4b7e1f924c4e`::moving from state init -> state preparing >Thread-162::INFO::2013-02-28 23:38:11,417::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-162::INFO::2013-02-28 23:38:11,417::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-162::DEBUG::2013-02-28 23:38:11,417::task::1151::TaskManager.Task::(prepare) Task=`82407fb1-0022-4451-bcbf-4b7e1f924c4e`::finished: {} >Thread-162::DEBUG::2013-02-28 23:38:11,417::task::568::TaskManager.Task::(_updateState) Task=`82407fb1-0022-4451-bcbf-4b7e1f924c4e`::moving from state preparing -> state finished >Thread-162::DEBUG::2013-02-28 23:38:11,418::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-162::DEBUG::2013-02-28 23:38:11,418::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-162::DEBUG::2013-02-28 23:38:11,418::task::957::TaskManager.Task::(_decref) Task=`82407fb1-0022-4451-bcbf-4b7e1f924c4e`::ref 0 aborting False >Thread-168::DEBUG::2013-02-28 23:38:26,643::task::568::TaskManager.Task::(_updateState) Task=`d7e03015-db19-4ff9-a270-b96dbf55f7ae`::moving from state init -> state preparing >Thread-168::INFO::2013-02-28 23:38:26,644::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-168::INFO::2013-02-28 23:38:26,644::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-168::DEBUG::2013-02-28 23:38:26,644::task::1151::TaskManager.Task::(prepare) Task=`d7e03015-db19-4ff9-a270-b96dbf55f7ae`::finished: {} >Thread-168::DEBUG::2013-02-28 23:38:26,644::task::568::TaskManager.Task::(_updateState) Task=`d7e03015-db19-4ff9-a270-b96dbf55f7ae`::moving from state preparing -> state finished >Thread-168::DEBUG::2013-02-28 23:38:26,644::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-168::DEBUG::2013-02-28 23:38:26,645::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-168::DEBUG::2013-02-28 23:38:26,645::task::957::TaskManager.Task::(_decref) Task=`d7e03015-db19-4ff9-a270-b96dbf55f7ae`::ref 0 aborting False >Thread-174::DEBUG::2013-02-28 23:38:41,867::task::568::TaskManager.Task::(_updateState) Task=`08439c5f-8008-43ea-ab9b-b7b5cc33d36c`::moving from state init -> state preparing >Thread-174::INFO::2013-02-28 23:38:41,867::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-174::INFO::2013-02-28 23:38:41,867::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-174::DEBUG::2013-02-28 23:38:41,867::task::1151::TaskManager.Task::(prepare) Task=`08439c5f-8008-43ea-ab9b-b7b5cc33d36c`::finished: {} >Thread-174::DEBUG::2013-02-28 23:38:41,868::task::568::TaskManager.Task::(_updateState) Task=`08439c5f-8008-43ea-ab9b-b7b5cc33d36c`::moving from state preparing -> state finished >Thread-174::DEBUG::2013-02-28 23:38:41,868::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-174::DEBUG::2013-02-28 23:38:41,868::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-174::DEBUG::2013-02-28 23:38:41,868::task::957::TaskManager.Task::(_decref) Task=`08439c5f-8008-43ea-ab9b-b7b5cc33d36c`::ref 0 aborting False >Thread-180::DEBUG::2013-02-28 23:38:57,103::task::568::TaskManager.Task::(_updateState) Task=`bb285df8-0d5e-450b-bd91-d2fba46c1fc4`::moving from state init -> state preparing >Thread-180::INFO::2013-02-28 23:38:57,104::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-180::INFO::2013-02-28 23:38:57,104::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-180::DEBUG::2013-02-28 23:38:57,104::task::1151::TaskManager.Task::(prepare) Task=`bb285df8-0d5e-450b-bd91-d2fba46c1fc4`::finished: {} >Thread-180::DEBUG::2013-02-28 23:38:57,104::task::568::TaskManager.Task::(_updateState) Task=`bb285df8-0d5e-450b-bd91-d2fba46c1fc4`::moving from state preparing -> state finished >Thread-180::DEBUG::2013-02-28 23:38:57,105::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-180::DEBUG::2013-02-28 23:38:57,105::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-180::DEBUG::2013-02-28 23:38:57,105::task::957::TaskManager.Task::(_decref) Task=`bb285df8-0d5e-450b-bd91-d2fba46c1fc4`::ref 0 aborting False >Thread-186::DEBUG::2013-02-28 23:39:12,444::task::568::TaskManager.Task::(_updateState) Task=`fd82ee9c-3aee-4233-80a7-0b02efc1e317`::moving from state init -> state preparing >Thread-186::INFO::2013-02-28 23:39:12,444::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-186::INFO::2013-02-28 23:39:12,445::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-186::DEBUG::2013-02-28 23:39:12,445::task::1151::TaskManager.Task::(prepare) Task=`fd82ee9c-3aee-4233-80a7-0b02efc1e317`::finished: {} >Thread-186::DEBUG::2013-02-28 23:39:12,445::task::568::TaskManager.Task::(_updateState) Task=`fd82ee9c-3aee-4233-80a7-0b02efc1e317`::moving from state preparing -> state finished >Thread-186::DEBUG::2013-02-28 23:39:12,445::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-186::DEBUG::2013-02-28 23:39:12,446::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-186::DEBUG::2013-02-28 23:39:12,446::task::957::TaskManager.Task::(_decref) Task=`fd82ee9c-3aee-4233-80a7-0b02efc1e317`::ref 0 aborting False >Thread-192::DEBUG::2013-02-28 23:39:27,819::task::568::TaskManager.Task::(_updateState) Task=`9453d5cf-7420-4343-aef1-575aa6b50cef`::moving from state init -> state preparing >Thread-192::INFO::2013-02-28 23:39:27,822::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-192::INFO::2013-02-28 23:39:27,825::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-192::DEBUG::2013-02-28 23:39:27,827::task::1151::TaskManager.Task::(prepare) Task=`9453d5cf-7420-4343-aef1-575aa6b50cef`::finished: {} >Thread-192::DEBUG::2013-02-28 23:39:27,830::task::568::TaskManager.Task::(_updateState) Task=`9453d5cf-7420-4343-aef1-575aa6b50cef`::moving from state preparing -> state finished >Thread-192::DEBUG::2013-02-28 23:39:27,832::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-192::DEBUG::2013-02-28 23:39:27,835::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2013-02-28 23:39:27,837::task::957::TaskManager.Task::(_decref) Task=`9453d5cf-7420-4343-aef1-575aa6b50cef`::ref 0 aborting False >Thread-198::DEBUG::2013-02-28 23:39:43,177::task::568::TaskManager.Task::(_updateState) Task=`a0a04a38-e2b7-41b0-92d3-85f118dd9111`::moving from state init -> state preparing >Thread-198::INFO::2013-02-28 23:39:43,177::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-198::INFO::2013-02-28 23:39:43,177::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-198::DEBUG::2013-02-28 23:39:43,177::task::1151::TaskManager.Task::(prepare) Task=`a0a04a38-e2b7-41b0-92d3-85f118dd9111`::finished: {} >Thread-198::DEBUG::2013-02-28 23:39:43,178::task::568::TaskManager.Task::(_updateState) Task=`a0a04a38-e2b7-41b0-92d3-85f118dd9111`::moving from state preparing -> state finished >Thread-198::DEBUG::2013-02-28 23:39:43,178::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-198::DEBUG::2013-02-28 23:39:43,178::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-198::DEBUG::2013-02-28 23:39:43,178::task::957::TaskManager.Task::(_decref) Task=`a0a04a38-e2b7-41b0-92d3-85f118dd9111`::ref 0 aborting False >Thread-204::DEBUG::2013-02-28 23:39:58,474::task::568::TaskManager.Task::(_updateState) Task=`44071566-91b7-494a-bebe-478ee1902c0b`::moving from state init -> state preparing >Thread-204::INFO::2013-02-28 23:39:58,475::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-204::INFO::2013-02-28 23:39:58,475::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-204::DEBUG::2013-02-28 23:39:58,475::task::1151::TaskManager.Task::(prepare) Task=`44071566-91b7-494a-bebe-478ee1902c0b`::finished: {} >Thread-204::DEBUG::2013-02-28 23:39:58,475::task::568::TaskManager.Task::(_updateState) Task=`44071566-91b7-494a-bebe-478ee1902c0b`::moving from state preparing -> state finished >Thread-204::DEBUG::2013-02-28 23:39:58,476::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-204::DEBUG::2013-02-28 23:39:58,476::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2013-02-28 23:39:58,476::task::957::TaskManager.Task::(_decref) Task=`44071566-91b7-494a-bebe-478ee1902c0b`::ref 0 aborting False >Thread-210::DEBUG::2013-02-28 23:40:13,724::task::568::TaskManager.Task::(_updateState) Task=`62963082-66d2-470a-a639-0941509a693d`::moving from state init -> state preparing >Thread-210::INFO::2013-02-28 23:40:13,731::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-210::INFO::2013-02-28 23:40:13,731::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-210::DEBUG::2013-02-28 23:40:13,731::task::1151::TaskManager.Task::(prepare) Task=`62963082-66d2-470a-a639-0941509a693d`::finished: {} >Thread-210::DEBUG::2013-02-28 23:40:13,732::task::568::TaskManager.Task::(_updateState) Task=`62963082-66d2-470a-a639-0941509a693d`::moving from state preparing -> state finished >Thread-210::DEBUG::2013-02-28 23:40:13,732::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-210::DEBUG::2013-02-28 23:40:13,732::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-210::DEBUG::2013-02-28 23:40:13,732::task::957::TaskManager.Task::(_decref) Task=`62963082-66d2-470a-a639-0941509a693d`::ref 0 aborting False >Thread-216::DEBUG::2013-02-28 23:40:28,946::task::568::TaskManager.Task::(_updateState) Task=`4edf5da8-e691-4c23-ae68-7fe6488bb7b5`::moving from state init -> state preparing >Thread-216::INFO::2013-02-28 23:40:28,947::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-216::INFO::2013-02-28 23:40:28,947::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-216::DEBUG::2013-02-28 23:40:28,947::task::1151::TaskManager.Task::(prepare) Task=`4edf5da8-e691-4c23-ae68-7fe6488bb7b5`::finished: {} >Thread-216::DEBUG::2013-02-28 23:40:28,947::task::568::TaskManager.Task::(_updateState) Task=`4edf5da8-e691-4c23-ae68-7fe6488bb7b5`::moving from state preparing -> state finished >Thread-216::DEBUG::2013-02-28 23:40:28,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-216::DEBUG::2013-02-28 23:40:28,948::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2013-02-28 23:40:28,948::task::957::TaskManager.Task::(_decref) Task=`4edf5da8-e691-4c23-ae68-7fe6488bb7b5`::ref 0 aborting False >Thread-222::DEBUG::2013-02-28 23:40:44,257::task::568::TaskManager.Task::(_updateState) Task=`25c29473-4444-434d-8c62-edc3acd48d34`::moving from state init -> state preparing >Thread-222::INFO::2013-02-28 23:40:44,258::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-222::INFO::2013-02-28 23:40:44,258::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-222::DEBUG::2013-02-28 23:40:44,258::task::1151::TaskManager.Task::(prepare) Task=`25c29473-4444-434d-8c62-edc3acd48d34`::finished: {} >Thread-222::DEBUG::2013-02-28 23:40:44,258::task::568::TaskManager.Task::(_updateState) Task=`25c29473-4444-434d-8c62-edc3acd48d34`::moving from state preparing -> state finished >Thread-222::DEBUG::2013-02-28 23:40:44,259::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-222::DEBUG::2013-02-28 23:40:44,259::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-222::DEBUG::2013-02-28 23:40:44,259::task::957::TaskManager.Task::(_decref) Task=`25c29473-4444-434d-8c62-edc3acd48d34`::ref 0 aborting False >Thread-228::DEBUG::2013-02-28 23:40:59,561::task::568::TaskManager.Task::(_updateState) Task=`5630239f-7b6d-4bfe-9473-16fd906b0851`::moving from state init -> state preparing >Thread-228::INFO::2013-02-28 23:40:59,564::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-228::INFO::2013-02-28 23:40:59,566::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-228::DEBUG::2013-02-28 23:40:59,569::task::1151::TaskManager.Task::(prepare) Task=`5630239f-7b6d-4bfe-9473-16fd906b0851`::finished: {} >Thread-228::DEBUG::2013-02-28 23:40:59,571::task::568::TaskManager.Task::(_updateState) Task=`5630239f-7b6d-4bfe-9473-16fd906b0851`::moving from state preparing -> state finished >Thread-228::DEBUG::2013-02-28 23:40:59,573::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-228::DEBUG::2013-02-28 23:40:59,576::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-228::DEBUG::2013-02-28 23:40:59,578::task::957::TaskManager.Task::(_decref) Task=`5630239f-7b6d-4bfe-9473-16fd906b0851`::ref 0 aborting False >Thread-234::DEBUG::2013-02-28 23:41:14,899::task::568::TaskManager.Task::(_updateState) Task=`a5189f7e-1073-4375-a0eb-e249a30ee031`::moving from state init -> state preparing >Thread-234::INFO::2013-02-28 23:41:14,899::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-234::INFO::2013-02-28 23:41:14,900::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-234::DEBUG::2013-02-28 23:41:14,900::task::1151::TaskManager.Task::(prepare) Task=`a5189f7e-1073-4375-a0eb-e249a30ee031`::finished: {} >Thread-234::DEBUG::2013-02-28 23:41:14,900::task::568::TaskManager.Task::(_updateState) Task=`a5189f7e-1073-4375-a0eb-e249a30ee031`::moving from state preparing -> state finished >Thread-234::DEBUG::2013-02-28 23:41:14,900::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-234::DEBUG::2013-02-28 23:41:14,901::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-234::DEBUG::2013-02-28 23:41:14,901::task::957::TaskManager.Task::(_decref) Task=`a5189f7e-1073-4375-a0eb-e249a30ee031`::ref 0 aborting False >Thread-240::DEBUG::2013-02-28 23:41:30,171::task::568::TaskManager.Task::(_updateState) Task=`6d69b96f-4b5b-430f-90a3-fb0d484c1ae7`::moving from state init -> state preparing >Thread-240::INFO::2013-02-28 23:41:30,171::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-240::INFO::2013-02-28 23:41:30,171::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-240::DEBUG::2013-02-28 23:41:30,172::task::1151::TaskManager.Task::(prepare) Task=`6d69b96f-4b5b-430f-90a3-fb0d484c1ae7`::finished: {} >Thread-240::DEBUG::2013-02-28 23:41:30,172::task::568::TaskManager.Task::(_updateState) Task=`6d69b96f-4b5b-430f-90a3-fb0d484c1ae7`::moving from state preparing -> state finished >Thread-240::DEBUG::2013-02-28 23:41:30,172::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-240::DEBUG::2013-02-28 23:41:30,172::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-240::DEBUG::2013-02-28 23:41:30,173::task::957::TaskManager.Task::(_decref) Task=`6d69b96f-4b5b-430f-90a3-fb0d484c1ae7`::ref 0 aborting False >Thread-246::DEBUG::2013-02-28 23:41:45,718::task::568::TaskManager.Task::(_updateState) Task=`95977851-ab9d-422f-adf3-648800fb16f1`::moving from state init -> state preparing >Thread-246::INFO::2013-02-28 23:41:45,718::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-246::INFO::2013-02-28 23:41:45,718::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-246::DEBUG::2013-02-28 23:41:45,718::task::1151::TaskManager.Task::(prepare) Task=`95977851-ab9d-422f-adf3-648800fb16f1`::finished: {} >Thread-246::DEBUG::2013-02-28 23:41:45,719::task::568::TaskManager.Task::(_updateState) Task=`95977851-ab9d-422f-adf3-648800fb16f1`::moving from state preparing -> state finished >Thread-246::DEBUG::2013-02-28 23:41:45,719::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-246::DEBUG::2013-02-28 23:41:45,719::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-246::DEBUG::2013-02-28 23:41:45,719::task::957::TaskManager.Task::(_decref) Task=`95977851-ab9d-422f-adf3-648800fb16f1`::ref 0 aborting False >Thread-252::DEBUG::2013-02-28 23:42:00,962::task::568::TaskManager.Task::(_updateState) Task=`f324c464-ba0e-40fa-9780-dbed5a1fb4db`::moving from state init -> state preparing >Thread-252::INFO::2013-02-28 23:42:00,962::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-252::INFO::2013-02-28 23:42:00,963::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-252::DEBUG::2013-02-28 23:42:00,963::task::1151::TaskManager.Task::(prepare) Task=`f324c464-ba0e-40fa-9780-dbed5a1fb4db`::finished: {} >Thread-252::DEBUG::2013-02-28 23:42:00,963::task::568::TaskManager.Task::(_updateState) Task=`f324c464-ba0e-40fa-9780-dbed5a1fb4db`::moving from state preparing -> state finished >Thread-252::DEBUG::2013-02-28 23:42:00,963::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-252::DEBUG::2013-02-28 23:42:00,963::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-252::DEBUG::2013-02-28 23:42:00,964::task::957::TaskManager.Task::(_decref) Task=`f324c464-ba0e-40fa-9780-dbed5a1fb4db`::ref 0 aborting False >Thread-258::DEBUG::2013-02-28 23:42:16,214::task::568::TaskManager.Task::(_updateState) Task=`a5294067-8ace-4cf2-aa7a-29327e7f302b`::moving from state init -> state preparing >Thread-258::INFO::2013-02-28 23:42:16,215::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-258::INFO::2013-02-28 23:42:16,215::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-258::DEBUG::2013-02-28 23:42:16,215::task::1151::TaskManager.Task::(prepare) Task=`a5294067-8ace-4cf2-aa7a-29327e7f302b`::finished: {} >Thread-258::DEBUG::2013-02-28 23:42:16,215::task::568::TaskManager.Task::(_updateState) Task=`a5294067-8ace-4cf2-aa7a-29327e7f302b`::moving from state preparing -> state finished >Thread-258::DEBUG::2013-02-28 23:42:16,216::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-258::DEBUG::2013-02-28 23:42:16,216::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-258::DEBUG::2013-02-28 23:42:16,216::task::957::TaskManager.Task::(_decref) Task=`a5294067-8ace-4cf2-aa7a-29327e7f302b`::ref 0 aborting False >Thread-264::DEBUG::2013-02-28 23:42:31,492::task::568::TaskManager.Task::(_updateState) Task=`aa4be70f-8955-4684-b755-206b57b3facc`::moving from state init -> state preparing >Thread-264::INFO::2013-02-28 23:42:31,493::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-264::INFO::2013-02-28 23:42:31,493::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-264::DEBUG::2013-02-28 23:42:31,493::task::1151::TaskManager.Task::(prepare) Task=`aa4be70f-8955-4684-b755-206b57b3facc`::finished: {} >Thread-264::DEBUG::2013-02-28 23:42:31,493::task::568::TaskManager.Task::(_updateState) Task=`aa4be70f-8955-4684-b755-206b57b3facc`::moving from state preparing -> state finished >Thread-264::DEBUG::2013-02-28 23:42:31,494::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-264::DEBUG::2013-02-28 23:42:31,494::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-264::DEBUG::2013-02-28 23:42:31,494::task::957::TaskManager.Task::(_decref) Task=`aa4be70f-8955-4684-b755-206b57b3facc`::ref 0 aborting False >Thread-270::DEBUG::2013-02-28 23:42:46,757::task::568::TaskManager.Task::(_updateState) Task=`0153e42c-4134-4930-b23f-440ccf98b02c`::moving from state init -> state preparing >Thread-270::INFO::2013-02-28 23:42:46,757::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-270::INFO::2013-02-28 23:42:46,757::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-270::DEBUG::2013-02-28 23:42:46,757::task::1151::TaskManager.Task::(prepare) Task=`0153e42c-4134-4930-b23f-440ccf98b02c`::finished: {} >Thread-270::DEBUG::2013-02-28 23:42:46,758::task::568::TaskManager.Task::(_updateState) Task=`0153e42c-4134-4930-b23f-440ccf98b02c`::moving from state preparing -> state finished >Thread-270::DEBUG::2013-02-28 23:42:46,758::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-270::DEBUG::2013-02-28 23:42:46,758::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-270::DEBUG::2013-02-28 23:42:46,758::task::957::TaskManager.Task::(_decref) Task=`0153e42c-4134-4930-b23f-440ccf98b02c`::ref 0 aborting False >Thread-276::DEBUG::2013-02-28 23:43:02,050::task::568::TaskManager.Task::(_updateState) Task=`c780b87f-a5c5-4841-8f3e-454f17d8863c`::moving from state init -> state preparing >Thread-276::INFO::2013-02-28 23:43:02,056::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-276::INFO::2013-02-28 23:43:02,056::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-276::DEBUG::2013-02-28 23:43:02,056::task::1151::TaskManager.Task::(prepare) Task=`c780b87f-a5c5-4841-8f3e-454f17d8863c`::finished: {} >Thread-276::DEBUG::2013-02-28 23:43:02,057::task::568::TaskManager.Task::(_updateState) Task=`c780b87f-a5c5-4841-8f3e-454f17d8863c`::moving from state preparing -> state finished >Thread-276::DEBUG::2013-02-28 23:43:02,057::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-276::DEBUG::2013-02-28 23:43:02,057::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-276::DEBUG::2013-02-28 23:43:02,057::task::957::TaskManager.Task::(_decref) Task=`c780b87f-a5c5-4841-8f3e-454f17d8863c`::ref 0 aborting False >Thread-282::DEBUG::2013-02-28 23:43:17,503::task::568::TaskManager.Task::(_updateState) Task=`df51d416-51a1-4c85-b55f-b5b194fa2ab1`::moving from state init -> state preparing >Thread-282::INFO::2013-02-28 23:43:17,510::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-282::INFO::2013-02-28 23:43:17,510::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-282::DEBUG::2013-02-28 23:43:17,510::task::1151::TaskManager.Task::(prepare) Task=`df51d416-51a1-4c85-b55f-b5b194fa2ab1`::finished: {} >Thread-282::DEBUG::2013-02-28 23:43:17,510::task::568::TaskManager.Task::(_updateState) Task=`df51d416-51a1-4c85-b55f-b5b194fa2ab1`::moving from state preparing -> state finished >Thread-282::DEBUG::2013-02-28 23:43:17,510::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-282::DEBUG::2013-02-28 23:43:17,511::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-282::DEBUG::2013-02-28 23:43:17,511::task::957::TaskManager.Task::(_decref) Task=`df51d416-51a1-4c85-b55f-b5b194fa2ab1`::ref 0 aborting False >Thread-288::DEBUG::2013-02-28 23:43:33,232::task::568::TaskManager.Task::(_updateState) Task=`222a934c-ac62-4d14-b557-e2081de03bd9`::moving from state init -> state preparing >Thread-288::INFO::2013-02-28 23:43:33,232::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288::INFO::2013-02-28 23:43:33,233::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-288::DEBUG::2013-02-28 23:43:33,233::task::1151::TaskManager.Task::(prepare) Task=`222a934c-ac62-4d14-b557-e2081de03bd9`::finished: {} >Thread-288::DEBUG::2013-02-28 23:43:33,233::task::568::TaskManager.Task::(_updateState) Task=`222a934c-ac62-4d14-b557-e2081de03bd9`::moving from state preparing -> state finished >Thread-288::DEBUG::2013-02-28 23:43:33,233::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288::DEBUG::2013-02-28 23:43:33,233::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288::DEBUG::2013-02-28 23:43:33,234::task::957::TaskManager.Task::(_decref) Task=`222a934c-ac62-4d14-b557-e2081de03bd9`::ref 0 aborting False >Thread-294::DEBUG::2013-02-28 23:43:48,655::task::568::TaskManager.Task::(_updateState) Task=`0af2c28c-8858-4f49-9f4e-c5a5b0494e2c`::moving from state init -> state preparing >Thread-294::INFO::2013-02-28 23:43:48,656::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-294::INFO::2013-02-28 23:43:48,656::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-294::DEBUG::2013-02-28 23:43:48,656::task::1151::TaskManager.Task::(prepare) Task=`0af2c28c-8858-4f49-9f4e-c5a5b0494e2c`::finished: {} >Thread-294::DEBUG::2013-02-28 23:43:48,656::task::568::TaskManager.Task::(_updateState) Task=`0af2c28c-8858-4f49-9f4e-c5a5b0494e2c`::moving from state preparing -> state finished >Thread-294::DEBUG::2013-02-28 23:43:48,657::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-294::DEBUG::2013-02-28 23:43:48,657::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-294::DEBUG::2013-02-28 23:43:48,657::task::957::TaskManager.Task::(_decref) Task=`0af2c28c-8858-4f49-9f4e-c5a5b0494e2c`::ref 0 aborting False >Thread-300::DEBUG::2013-02-28 23:44:04,463::task::568::TaskManager.Task::(_updateState) Task=`a27395fc-972a-498d-b83b-bfa5d360c82b`::moving from state init -> state preparing >Thread-300::INFO::2013-02-28 23:44:04,465::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-300::INFO::2013-02-28 23:44:04,465::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-300::DEBUG::2013-02-28 23:44:04,465::task::1151::TaskManager.Task::(prepare) Task=`a27395fc-972a-498d-b83b-bfa5d360c82b`::finished: {} >Thread-300::DEBUG::2013-02-28 23:44:04,466::task::568::TaskManager.Task::(_updateState) Task=`a27395fc-972a-498d-b83b-bfa5d360c82b`::moving from state preparing -> state finished >Thread-300::DEBUG::2013-02-28 23:44:04,466::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2013-02-28 23:44:04,467::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2013-02-28 23:44:04,467::task::957::TaskManager.Task::(_decref) Task=`a27395fc-972a-498d-b83b-bfa5d360c82b`::ref 0 aborting False >Thread-306::DEBUG::2013-02-28 23:44:19,786::task::568::TaskManager.Task::(_updateState) Task=`8e09adcd-44f0-48e0-a296-1915024a68d2`::moving from state init -> state preparing >Thread-306::INFO::2013-02-28 23:44:19,786::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-306::INFO::2013-02-28 23:44:19,786::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-306::DEBUG::2013-02-28 23:44:19,787::task::1151::TaskManager.Task::(prepare) Task=`8e09adcd-44f0-48e0-a296-1915024a68d2`::finished: {} >Thread-306::DEBUG::2013-02-28 23:44:19,787::task::568::TaskManager.Task::(_updateState) Task=`8e09adcd-44f0-48e0-a296-1915024a68d2`::moving from state preparing -> state finished >Thread-306::DEBUG::2013-02-28 23:44:19,787::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2013-02-28 23:44:19,787::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2013-02-28 23:44:19,788::task::957::TaskManager.Task::(_decref) Task=`8e09adcd-44f0-48e0-a296-1915024a68d2`::ref 0 aborting False >Thread-309::DEBUG::2013-03-01 12:40:06,672::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-309::DEBUG::2013-03-01 12:40:06,738::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '9.0.el6ev', 'buildtime': 1361372137L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '9.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >MainThread::INFO::2013-03-01 12:41:52,731::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-03-01 12:41:52,739::task::568::TaskManager.Task::(_updateState) Task=`9478a2a5-4303-4d54-9844-20e2149b71d2`::moving from state init -> state preparing >MainThread::INFO::2013-03-01 12:41:52,739::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-03-01 12:41:52,740::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-03-01 12:41:52,745::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,746::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,748::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,749::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,750::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,752::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,753::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,755::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,756::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,757::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,759::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,760::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,761::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,763::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,764::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,765::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,766::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,768::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,769::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,770::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,772::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,773::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,774::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,775::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,777::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,778::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,779::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,781::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,782::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,783::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,784::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,786::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,787::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,788::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,790::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:41:52,895::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-03-01 12:41:52,900::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-03-01 12:41:52,900::task::1151::TaskManager.Task::(prepare) Task=`9478a2a5-4303-4d54-9844-20e2149b71d2`::finished: None >MainThread::DEBUG::2013-03-01 12:41:52,901::task::568::TaskManager.Task::(_updateState) Task=`9478a2a5-4303-4d54-9844-20e2149b71d2`::moving from state preparing -> state finished >MainThread::DEBUG::2013-03-01 12:41:52,901::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-03-01 12:41:52,901::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-03-01 12:41:52,901::task::957::TaskManager.Task::(_decref) Task=`9478a2a5-4303-4d54-9844-20e2149b71d2`::ref 0 aborting False >MainThread::INFO::2013-03-01 12:41:52,901::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-03-01 12:41:52,901::vdsm::99::vds::(run) <_MainThread(MainThread, started 139680041998080)> >MainThread::INFO::2013-03-01 12:41:52,902::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 139679949436672)> >MainThread::INFO::2013-03-01 12:41:52,902::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-03-01 12:41:52,902::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 139678711805696)> >MainThread::INFO::2013-03-01 12:41:52,902::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 139679542261504)> >MainThread::INFO::2013-03-01 12:41:52,902::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 139679573731072)> >MainThread::INFO::2013-03-01 12:41:52,902::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 139679796446976)> >MainThread::INFO::2013-03-01 12:41:52,902::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 139679552751360)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 139679806936832)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 139679531771648)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 139679817426688)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 139679181567744)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139679139608320)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 139679563241216)> >MainThread::INFO::2013-03-01 12:41:52,903::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 139679584220928)> >MainThread::INFO::2013-03-01 12:47:32,505::vdsm::89::vds::(run) I am the actual vdsm 4.10-10.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-03-01 12:47:34,568::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-03-01 12:47:34,568::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-03-01 12:47:34,589::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-03-01 12:47:34,986::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,988::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,989::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,991::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,993::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,995::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,997::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:34,999::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,002::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,004::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,006::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,008::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,010::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,013::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,015::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,017::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,019::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,021::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,023::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,026::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,028::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,030::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,032::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,035::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,037::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,039::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,041::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,043::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,046::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,048::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,050::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,052::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,054::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,056::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,058::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 12:47:35,211::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-03-01 12:47:35,211::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 9d1dbfd5-fecb-4211-918d-69c871b7c6d5 7402 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-03-01 12:47:36,636::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-03-01 12:47:36,636::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-03-01 12:47:36,637::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-03-01 12:47:36,637::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-03-01 12:47:36,637::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-03-01 12:47:36,638::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-03-01 12:47:36,641::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-03-01 12:47:37,246::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-03-01 12:47:37,305::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-03-01 12:47:37,305::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-03-01 12:47:37,543::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-03-01 12:47:37,544::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-03-01 12:47:37,546::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-03-01 12:47:37,546::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-03-01 12:47:37,546::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-03-01 12:47:37,560::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-03-01 12:47:37,562::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-03-01 12:47:37,562::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:37,571::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::DEBUG::2013-03-01 12:47:37,601::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-03-01 12:47:37,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-03-01 12:47:37,714::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-03-01 12:47:37,714::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-03-01 12:47:37,715::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-03-01 12:47:37,720::vmChannels::127::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-03-01 12:47:37,987::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-03-01 12:47:37,987::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 12:47:37,991::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >KsmMonitor::DEBUG::2013-03-01 12:47:37,991::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >storageRefresh::DEBUG::2013-03-01 12:47:37,997::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:37,998::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >KsmMonitor::DEBUG::2013-03-01 12:47:38,025::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 12:47:38,224::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 12:47:38,224::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:38,225::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-03-01 12:47:38,451::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 12:47:38,451::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-03-01 12:47:38,452::misc::1055::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-03-01 12:47:38,452::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-03-01 12:47:38,452::misc::1055::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-03-01 12:47:38,452::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-03-01 12:47:38,481::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 12:47:38,482::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,484::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,487::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,490::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,493::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,496::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,499::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,502::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 12:47:38,505::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2013-03-01 12:47:39,043::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-13::DEBUG::2013-03-01 12:47:39,687::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-03-01 12:47:39,826::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-03-01 12:47:40,101::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-03-01 12:47:40,239::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-15::DEBUG::2013-03-01 12:47:40,278::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >Thread-16::DEBUG::2013-03-01 12:47:40,332::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-03-01 12:47:40,334::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >storageRefresh::DEBUG::2013-03-01 12:47:40,509::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-03-01 12:47:42,516::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 12:47:42,516::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:42,517::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:42,517::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:42,517::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:42,518::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:42,518::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 12:47:42,518::misc::1063::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-03-01 12:47:42,519::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-20::DEBUG::2013-03-01 12:47:48,908::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-20::DEBUG::2013-03-01 12:47:48,908::task::568::TaskManager.Task::(_updateState) Task=`b9385022-0bd3-44e2-afc7-03f03ada3c21`::moving from state init -> state preparing >Thread-20::INFO::2013-03-01 12:47:48,909::logUtils::37::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.7', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-20::DEBUG::2013-03-01 12:47:48,909::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-20::DEBUG::2013-03-01 12:47:48,947::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-03-01 12:47:48,948::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-20::DEBUG::2013-03-01 12:47:48,962::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: Cannot modify node.startup. Invalid param name.\n'; <rc> = 7 >Thread-20::DEBUG::2013-03-01 12:47:48,963::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-20::DEBUG::2013-03-01 12:47:48,995::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-03-01 12:47:48,995::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --discover' (cwd None) >Thread-20::DEBUG::2013-03-01 12:47:49,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-03-01 12:47:49,053::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=delete' (cwd None) >Thread-20::DEBUG::2013-03-01 12:47:49,067::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::INFO::2013-03-01 12:47:49,068::logUtils::39::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-20::DEBUG::2013-03-01 12:47:49,068::task::1151::TaskManager.Task::(prepare) Task=`b9385022-0bd3-44e2-afc7-03f03ada3c21`::finished: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-20::DEBUG::2013-03-01 12:47:49,068::task::568::TaskManager.Task::(_updateState) Task=`b9385022-0bd3-44e2-afc7-03f03ada3c21`::moving from state preparing -> state finished >Thread-20::DEBUG::2013-03-01 12:47:49,068::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2013-03-01 12:47:49,069::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2013-03-01 12:47:49,069::task::957::TaskManager.Task::(_decref) Task=`b9385022-0bd3-44e2-afc7-03f03ada3c21`::ref 0 aborting False >Thread-21::DEBUG::2013-03-01 12:47:49,655::task::568::TaskManager.Task::(_updateState) Task=`3567b98d-0047-4559-abb2-c0591fb8c618`::moving from state init -> state preparing >Thread-21::INFO::2013-03-01 12:47:49,656::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-21::INFO::2013-03-01 12:47:49,656::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-21::DEBUG::2013-03-01 12:47:49,656::task::1151::TaskManager.Task::(prepare) Task=`3567b98d-0047-4559-abb2-c0591fb8c618`::finished: {} >Thread-21::DEBUG::2013-03-01 12:47:49,657::task::568::TaskManager.Task::(_updateState) Task=`3567b98d-0047-4559-abb2-c0591fb8c618`::moving from state preparing -> state finished >Thread-21::DEBUG::2013-03-01 12:47:49,657::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-21::DEBUG::2013-03-01 12:47:49,657::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-21::DEBUG::2013-03-01 12:47:49,657::task::957::TaskManager.Task::(_decref) Task=`3567b98d-0047-4559-abb2-c0591fb8c618`::ref 0 aborting False >Thread-23::DEBUG::2013-03-01 12:47:50,061::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-23::DEBUG::2013-03-01 12:47:50,062::task::568::TaskManager.Task::(_updateState) Task=`58a54fdd-45b7-40ab-93bb-28fcaa94c65b`::moving from state init -> state preparing >Thread-23::INFO::2013-03-01 12:47:50,062::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-23::INFO::2013-03-01 12:47:50,062::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-23::DEBUG::2013-03-01 12:47:50,063::task::1151::TaskManager.Task::(prepare) Task=`58a54fdd-45b7-40ab-93bb-28fcaa94c65b`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-23::DEBUG::2013-03-01 12:47:50,063::task::568::TaskManager.Task::(_updateState) Task=`58a54fdd-45b7-40ab-93bb-28fcaa94c65b`::moving from state preparing -> state finished >Thread-23::DEBUG::2013-03-01 12:47:50,063::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-23::DEBUG::2013-03-01 12:47:50,063::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-23::DEBUG::2013-03-01 12:47:50,064::task::957::TaskManager.Task::(_decref) Task=`58a54fdd-45b7-40ab-93bb-28fcaa94c65b`::ref 0 aborting False >Thread-24::DEBUG::2013-03-01 12:47:50,119::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-24::DEBUG::2013-03-01 12:47:50,120::task::568::TaskManager.Task::(_updateState) Task=`0111dd64-1cca-49da-b4fe-b0356f65b077`::moving from state init -> state preparing >Thread-24::INFO::2013-03-01 12:47:50,120::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-24::DEBUG::2013-03-01 12:47:50,121::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-24::DEBUG::2013-03-01 12:47:50,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-03-01 12:47:50,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-24::DEBUG::2013-03-01 12:47:50,152::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-03-01 12:47:50,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-24::DEBUG::2013-03-01 12:47:50,167::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::INFO::2013-03-01 12:47:50,167::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-24::DEBUG::2013-03-01 12:47:50,167::task::1151::TaskManager.Task::(prepare) Task=`0111dd64-1cca-49da-b4fe-b0356f65b077`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-24::DEBUG::2013-03-01 12:47:50,168::task::568::TaskManager.Task::(_updateState) Task=`0111dd64-1cca-49da-b4fe-b0356f65b077`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-03-01 12:47:50,168::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-03-01 12:47:50,168::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-03-01 12:47:50,168::task::957::TaskManager.Task::(_decref) Task=`0111dd64-1cca-49da-b4fe-b0356f65b077`::ref 0 aborting False >Thread-25::DEBUG::2013-03-01 12:47:51,664::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-25::DEBUG::2013-03-01 12:47:51,665::task::568::TaskManager.Task::(_updateState) Task=`e5346300-7d2e-4eeb-9c07-785ef93d7115`::moving from state init -> state preparing >Thread-25::INFO::2013-03-01 12:47:51,665::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-25::INFO::2013-03-01 12:47:51,665::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-25::DEBUG::2013-03-01 12:47:51,666::task::1151::TaskManager.Task::(prepare) Task=`e5346300-7d2e-4eeb-9c07-785ef93d7115`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-25::DEBUG::2013-03-01 12:47:51,666::task::568::TaskManager.Task::(_updateState) Task=`e5346300-7d2e-4eeb-9c07-785ef93d7115`::moving from state preparing -> state finished >Thread-25::DEBUG::2013-03-01 12:47:51,666::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-25::DEBUG::2013-03-01 12:47:51,666::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-25::DEBUG::2013-03-01 12:47:51,667::task::957::TaskManager.Task::(_decref) Task=`e5346300-7d2e-4eeb-9c07-785ef93d7115`::ref 0 aborting False >Thread-26::DEBUG::2013-03-01 12:47:51,768::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-26::DEBUG::2013-03-01 12:47:51,768::task::568::TaskManager.Task::(_updateState) Task=`0d1c1b0d-beb3-47a1-975e-a19e66195f23`::moving from state init -> state preparing >Thread-26::INFO::2013-03-01 12:47:51,768::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-26::DEBUG::2013-03-01 12:47:51,769::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-26::DEBUG::2013-03-01 12:47:51,785::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2013-03-01 12:47:51,785::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-26::DEBUG::2013-03-01 12:47:51,802::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2013-03-01 12:47:51,802::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-26::DEBUG::2013-03-01 12:47:51,817::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::INFO::2013-03-01 12:47:51,817::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-26::DEBUG::2013-03-01 12:47:51,818::task::1151::TaskManager.Task::(prepare) Task=`0d1c1b0d-beb3-47a1-975e-a19e66195f23`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-26::DEBUG::2013-03-01 12:47:51,818::task::568::TaskManager.Task::(_updateState) Task=`0d1c1b0d-beb3-47a1-975e-a19e66195f23`::moving from state preparing -> state finished >Thread-26::DEBUG::2013-03-01 12:47:51,818::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26::DEBUG::2013-03-01 12:47:51,819::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26::DEBUG::2013-03-01 12:47:51,819::task::957::TaskManager.Task::(_decref) Task=`0d1c1b0d-beb3-47a1-975e-a19e66195f23`::ref 0 aborting False >Thread-27::DEBUG::2013-03-01 12:47:51,873::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-27::DEBUG::2013-03-01 12:47:51,874::task::568::TaskManager.Task::(_updateState) Task=`1248b62a-7b8b-4f64-9f80-dadc7e36beb3`::moving from state init -> state preparing >Thread-27::INFO::2013-03-01 12:47:51,874::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-27::DEBUG::2013-03-01 12:47:51,874::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-27::DEBUG::2013-03-01 12:47:51,875::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-27::DEBUG::2013-03-01 12:47:51,875::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-27::DEBUG::2013-03-01 12:47:51,875::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-27::DEBUG::2013-03-01 12:47:51,876::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-27::DEBUG::2013-03-01 12:47:51,899::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-27::DEBUG::2013-03-01 12:47:51,899::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,903::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,906::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,908::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,910::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,914::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,917::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:51,920::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-27::DEBUG::2013-03-01 12:47:53,923::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-27::DEBUG::2013-03-01 12:47:54,890::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-27::DEBUG::2013-03-01 12:47:54,891::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,892::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,892::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,892::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,893::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,893::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,894::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-27::DEBUG::2013-03-01 12:47:54,894::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-27::DEBUG::2013-03-01 12:47:54,897::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-27::DEBUG::2013-03-01 12:47:55,171::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-27::DEBUG::2013-03-01 12:47:55,172::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,177::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,180::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-0' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,183::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,187::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-1' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,189::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,192::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-2' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,202::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-4' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,208::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,211::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-5' (cwd None) >MainProcess|Thread-27::DEBUG::2013-03-01 12:47:55,214::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-27::DEBUG::2013-03-01 12:47:55,218::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a000489 /dev/mapper/3514f0c542a00049f /dev/mapper/3514f0c542a00048a /dev/mapper/3514f0c542a0004b9 /dev/mapper/3514f0c542a000488 /dev/mapper/3514f0c542a0004b8' (cwd None) >Thread-27::DEBUG::2013-03-01 12:47:55,477::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n'; <rc> = 0 >Thread-27::INFO::2013-03-01 12:47:55,478::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '32'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_e93c57bc1d924765a4736184c94e1855', 'GUID': '3514f0c542a000489', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '10737418240', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '34'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_1db7bd256dad40a29a13b648a567a21e', 'GUID': '3514f0c542a00049f', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '33'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_6e8ae99a8f2b4d1497ea5630efde57d3', 'GUID': '3514f0c542a00048a', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '36'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_da2a5cb8c5eb4fae8edae67fab81212d', 'GUID': '3514f0c542a0004b9', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '31'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_45df0a9322f74dec8cd80e22256ece84', 'GUID': '3514f0c542a000488', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '35'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_4a0496c174d34047b11cbebd359e60ba', 'GUID': '3514f0c542a0004b8', 'productID': 'XtremApp'}]} >Thread-27::DEBUG::2013-03-01 12:47:55,478::task::1151::TaskManager.Task::(prepare) Task=`1248b62a-7b8b-4f64-9f80-dadc7e36beb3`::finished: {'devList': [{'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_e93c57bc1d924765a4736184c94e1855', 'GUID': '3514f0c542a000489', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdb', 'state': 'active', 'type': 'iSCSI', 'lun': '32'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_1db7bd256dad40a29a13b648a567a21e', 'GUID': '3514f0c542a00049f', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '10737418240', 'pathstatus': [{'physdev': 'sdd', 'state': 'active', 'type': 'iSCSI', 'lun': '34'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_6e8ae99a8f2b4d1497ea5630efde57d3', 'GUID': '3514f0c542a00048a', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdc', 'state': 'active', 'type': 'iSCSI', 'lun': '33'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_da2a5cb8c5eb4fae8edae67fab81212d', 'GUID': '3514f0c542a0004b9', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '36'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_45df0a9322f74dec8cd80e22256ece84', 'GUID': '3514f0c542a000488', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdg', 'state': 'active', 'type': 'iSCSI', 'lun': '31'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_4a0496c174d34047b11cbebd359e60ba', 'GUID': '3514f0c542a0004b8', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '35'}], 'pvUUID': ''}]} >Thread-27::DEBUG::2013-03-01 12:47:55,479::task::568::TaskManager.Task::(_updateState) Task=`1248b62a-7b8b-4f64-9f80-dadc7e36beb3`::moving from state preparing -> state finished >Thread-27::DEBUG::2013-03-01 12:47:55,479::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-27::DEBUG::2013-03-01 12:47:55,479::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-27::DEBUG::2013-03-01 12:47:55,479::task::957::TaskManager.Task::(_decref) Task=`1248b62a-7b8b-4f64-9f80-dadc7e36beb3`::ref 0 aborting False >Thread-29::DEBUG::2013-03-01 12:47:55,714::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-29::DEBUG::2013-03-01 12:47:55,714::task::568::TaskManager.Task::(_updateState) Task=`6a15a172-80f5-41e7-acc1-3d8c61aa00bd`::moving from state init -> state preparing >Thread-29::INFO::2013-03-01 12:47:55,715::logUtils::37::dispatcher::(wrapper) Run and protect: createVG(vgname='a558fc2a-a4a3-4118-9b81-d1d601eaa295', devlist=['3514f0c542a0004b8'], force=False, options=None) >Thread-29::DEBUG::2013-03-01 12:47:55,717::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a0004b8' (cwd None) >Thread-29::DEBUG::2013-03-01 12:47:55,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2013-03-01 12:47:55,941::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:55,941::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:55,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/3514f0c542a0004b8' (cwd None) >Thread-29::DEBUG::2013-03-01 12:47:56,201::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2013-03-01 12:47:56,202::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY a558fc2a-a4a3-4118-9b81-d1d601eaa295 /dev/mapper/3514f0c542a0004b8' (cwd None) >Thread-29::DEBUG::2013-03-01 12:47:56,787::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2013-03-01 12:47:56,787::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:56,788::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:56,788::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:56,788::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:56,788::lvm::880::Storage.LVM::(createVG) Cache after createvg {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': Stub(name='a558fc2a-a4a3-4118-9b81-d1d601eaa295', stale=True)} >Thread-29::DEBUG::2013-03-01 12:47:56,789::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2013-03-01 12:47:56,789::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-29::DEBUG::2013-03-01 12:47:57,025::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2013-03-01 12:47:57,027::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::INFO::2013-03-01 12:47:57,027::logUtils::39::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS'} >Thread-29::DEBUG::2013-03-01 12:47:57,028::task::1151::TaskManager.Task::(prepare) Task=`6a15a172-80f5-41e7-acc1-3d8c61aa00bd`::finished: {'uuid': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS'} >Thread-29::DEBUG::2013-03-01 12:47:57,028::task::568::TaskManager.Task::(_updateState) Task=`6a15a172-80f5-41e7-acc1-3d8c61aa00bd`::moving from state preparing -> state finished >Thread-29::DEBUG::2013-03-01 12:47:57,028::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2013-03-01 12:47:57,029::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2013-03-01 12:47:57,029::task::957::TaskManager.Task::(_decref) Task=`6a15a172-80f5-41e7-acc1-3d8c61aa00bd`::ref 0 aborting False >Thread-31::DEBUG::2013-03-01 12:47:57,091::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-31::DEBUG::2013-03-01 12:47:57,091::task::568::TaskManager.Task::(_updateState) Task=`b15a41a2-4925-46c9-8247-104ab5ca5a4f`::moving from state init -> state preparing >Thread-31::INFO::2013-03-01 12:47:57,092::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', domainName='data_sd', typeSpecificArg='CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', domClass=1, domVersion='3', options=None) >Thread-31::INFO::2013-03-01 12:47:57,433::blockSD::459::Storage.StorageDomain::(create) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 domainName=data_sd domClass=1 vgUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS storageType=3 version=3 >Thread-31::DEBUG::2013-03-01 12:47:57,433::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:57,434::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-31::DEBUG::2013-03-01 12:47:57,625::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:47:57,626::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:57,627::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:57,627::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:47:57,811::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:47:57,811::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:57,812::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:57,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3514f0c542a0004b8' (cwd None) >Thread-31::DEBUG::2013-03-01 12:47:58,000::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:47:58,000::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-31::INFO::2013-03-01 12:47:58,001::blockSD::444::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-31::DEBUG::2013-03-01 12:47:58,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:47:59,215::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:47:59,216::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:59,217::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:59,217::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:59,217::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:59,218::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:47:59,219::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:47:59,423::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:47:59,425::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-31::INFO::2013-03-01 12:47:59,426::blockSD::630::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/3514f0c542a0004b8'] >Thread-31::DEBUG::2013-03-01 12:47:59,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:00,577::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:00,578::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:00,578::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:00,578::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:00,579::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:00,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/leases' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:00,594::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:00,595::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:01,910::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:01,910::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:01,911::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:01,911::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:01,911::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:01,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/ids' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:01,926::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:01,927::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:03,177::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:03,178::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:03,179::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:03,179::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:03,180::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:03,181::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-57::DEBUG::2013-03-01 12:48:05,005::task::568::TaskManager.Task::(_updateState) Task=`e22c8297-6b09-4259-8491-31f4ba4be6e3`::moving from state init -> state preparing >Thread-57::INFO::2013-03-01 12:48:05,005::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-57::INFO::2013-03-01 12:48:05,006::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-57::DEBUG::2013-03-01 12:48:05,006::task::1151::TaskManager.Task::(prepare) Task=`e22c8297-6b09-4259-8491-31f4ba4be6e3`::finished: {} >Thread-57::DEBUG::2013-03-01 12:48:05,006::task::568::TaskManager.Task::(_updateState) Task=`e22c8297-6b09-4259-8491-31f4ba4be6e3`::moving from state preparing -> state finished >Thread-57::DEBUG::2013-03-01 12:48:05,006::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2013-03-01 12:48:05,006::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2013-03-01 12:48:05,007::task::957::TaskManager.Task::(_decref) Task=`e22c8297-6b09-4259-8491-31f4ba4be6e3`::ref 0 aborting False >Thread-31::DEBUG::2013-03-01 12:48:05,201::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:05,202::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:05,202::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:05,202::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:05,203::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:05,203::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:06,585::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:06,586::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:06,592::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:06,592::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:06,592::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:06,593::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:06,625::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:06,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:06,859::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:06,860::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:07,067::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:07,068::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,068::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,069::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:07,192::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.116719 s, 359 MB/s\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:07,193::misc::344::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.116719 s, 359 MB/s'], size: 41943040 >Thread-31::DEBUG::2013-03-01 12:48:07,193::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:07,205::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00417631 s, 245 MB/s\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:07,205::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00417631 s, 245 MB/s'], size: 1024000 >Thread-31::DEBUG::2013-03-01 12:48:07,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:07,215::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00366972 s, 279 MB/s\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:07,216::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00366972 s, 279 MB/s'], size: 1024000 >Thread-31::DEBUG::2013-03-01 12:48:07,216::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-31::DEBUG::2013-03-01 12:48:07,217::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,217::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,218::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,218::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,218::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,219::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:07,702::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:07,704::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,704::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-31::WARNING::2013-03-01 12:48:07,705::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-31::DEBUG::2013-03-01 12:48:07,706::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-31::DEBUG::2013-03-01 12:48:07,706::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-31::DEBUG::2013-03-01 12:48:07,707::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca'] >Thread-31::DEBUG::2013-03-01 12:48:07,707::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,707::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,708::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,709::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,710::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,714::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:07,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:07,941::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:07,942::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_DESCRIPTION=data_sd, MDT_SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, MDT_VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS, MDT_CLASS=Data, MDT_LEASERETRIES=3, MDT_ROLE=Regular, MDT_LOCKRENEWALINTERVALSEC=5, MDT_LOGBLKSIZE=512, MDT_LEASETIMESEC=5, MDT_PV0=pv:3514f0c542a0004b8&44&uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ&44&pestart:0&44&pecount:397&44&mapoffset:0, MDT__SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca, MDT_VERSION=3, MDT_IOOPTIMEOUTSEC=1, MDT_LOCKPOLICY=, MDT_TYPE=ISCSI, MDT_PHYBLKSIZE=4096, MDT_POOL_UUID= removing= >Thread-31::DEBUG::2013-03-01 12:48:07,943::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_PHYBLKSIZE=4096 --addtag MDT_VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS --addtag MDT_ROLE=Regular --addtag MDT__SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca --addtag MDT_TYPE=ISCSI --addtag MDT_PV0=pv:3514f0c542a0004b8&44&uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ&44&pestart:0&44&pecount:397&44&mapoffset:0 --addtag MDT_LOGBLKSIZE=512 --addtag MDT_LEASERETRIES=3 --addtag MDT_LEASETIMESEC=5 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_LOCKPOLICY= --addtag MDT_IOOPTIMEOUTSEC=1 --addtag MDT_POOL_UUID= --addtag MDT_CLASS=Data --addtag MDT_DESCRIPTION=data_sd --addtag MDT_SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 --addtag MDT_VERSION=3 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:08,405::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:08,406::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,406::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,406::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-31::DEBUG::2013-03-01 12:48:08,407::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:08,773::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:08,774::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,774::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,774::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-31::DEBUG::2013-03-01 12:48:08,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:08,782::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000305807 s, 6.7 MB/s\n'; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:08,782::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000305807 s, 6.7 MB/s'], size: 2048 >Thread-31::DEBUG::2013-03-01 12:48:08,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-31::WARNING::2013-03-01 12:48:08,783::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-31::DEBUG::2013-03-01 12:48:08,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-31::DEBUG::2013-03-01 12:48:08,784::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,784::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,785::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,785::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,785::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:08,786::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:09,027::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:09,028::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:09,029::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', '_SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3'] >Thread-31::DEBUG::2013-03-01 12:48:09,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-31::DEBUG::2013-03-01 12:48:10,371::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-31::DEBUG::2013-03-01 12:48:10,371::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:10,372::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-31::DEBUG::2013-03-01 12:48:10,373::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS' >Thread-31::DEBUG::2013-03-01 12:48:10,373::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS' >Thread-31::DEBUG::2013-03-01 12:48:10,373::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS' >Thread-31::DEBUG::2013-03-01 12:48:10,374::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-31::DEBUG::2013-03-01 12:48:10,385::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-31::INFO::2013-03-01 12:48:10,386::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-31::DEBUG::2013-03-01 12:48:10,386::task::1151::TaskManager.Task::(prepare) Task=`b15a41a2-4925-46c9-8247-104ab5ca5a4f`::finished: None >Thread-31::DEBUG::2013-03-01 12:48:10,386::task::568::TaskManager.Task::(_updateState) Task=`b15a41a2-4925-46c9-8247-104ab5ca5a4f`::moving from state preparing -> state finished >Thread-31::DEBUG::2013-03-01 12:48:10,386::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-31::DEBUG::2013-03-01 12:48:10,386::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-31::DEBUG::2013-03-01 12:48:10,387::task::957::TaskManager.Task::(_decref) Task=`b15a41a2-4925-46c9-8247-104ab5ca5a4f`::ref 0 aborting False >Thread-60::DEBUG::2013-03-01 12:48:10,430::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-60::DEBUG::2013-03-01 12:48:10,431::task::568::TaskManager.Task::(_updateState) Task=`567dfe76-2e07-443f-acdd-20bc052ef00a`::moving from state init -> state preparing >Thread-60::INFO::2013-03-01 12:48:10,431::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', options=None) >Thread-60::DEBUG::2013-03-01 12:48:10,432::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`7f78de73-f9f3-4d38-b4e1-9c8e3a75ddee`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-60::DEBUG::2013-03-01 12:48:10,432::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-60::DEBUG::2013-03-01 12:48:10,432::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-60::DEBUG::2013-03-01 12:48:10,433::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`7f78de73-f9f3-4d38-b4e1-9c8e3a75ddee`::Granted request >Thread-60::DEBUG::2013-03-01 12:48:10,434::task::794::TaskManager.Task::(resourceAcquired) Task=`567dfe76-2e07-443f-acdd-20bc052ef00a`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-60::DEBUG::2013-03-01 12:48:10,434::task::957::TaskManager.Task::(_decref) Task=`567dfe76-2e07-443f-acdd-20bc052ef00a`::ref 1 aborting False >Thread-60::DEBUG::2013-03-01 12:48:10,463::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-60::DEBUG::2013-03-01 12:48:10,463::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-60::DEBUG::2013-03-01 12:48:10,464::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-60::DEBUG::2013-03-01 12:48:10,464::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-60::DEBUG::2013-03-01 12:48:10,464::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-60::DEBUG::2013-03-01 12:48:10,464::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-60::DEBUG::2013-03-01 12:48:10,471::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000374534 s, 5.5 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2013-03-01 12:48:10,472::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000374534 s, 5.5 MB/s'], size: 2048 >Thread-60::DEBUG::2013-03-01 12:48:10,472::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-60::WARNING::2013-03-01 12:48:10,472::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-60::DEBUG::2013-03-01 12:48:10,473::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-60::DEBUG::2013-03-01 12:48:10,473::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-60::DEBUG::2013-03-01 12:48:10,474::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-60::DEBUG::2013-03-01 12:48:10,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-60::DEBUG::2013-03-01 12:48:10,711::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-60::INFO::2013-03-01 12:48:10,712::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-60::DEBUG::2013-03-01 12:48:10,712::task::1151::TaskManager.Task::(prepare) Task=`567dfe76-2e07-443f-acdd-20bc052ef00a`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-60::DEBUG::2013-03-01 12:48:10,712::task::568::TaskManager.Task::(_updateState) Task=`567dfe76-2e07-443f-acdd-20bc052ef00a`::moving from state preparing -> state finished >Thread-60::DEBUG::2013-03-01 12:48:10,712::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-60::DEBUG::2013-03-01 12:48:10,713::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2013-03-01 12:48:10,713::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-60::DEBUG::2013-03-01 12:48:10,713::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-60::DEBUG::2013-03-01 12:48:10,714::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-60::DEBUG::2013-03-01 12:48:10,714::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-60::DEBUG::2013-03-01 12:48:10,714::task::957::TaskManager.Task::(_decref) Task=`567dfe76-2e07-443f-acdd-20bc052ef00a`::ref 0 aborting False >Thread-61::DEBUG::2013-03-01 12:48:10,813::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-61::DEBUG::2013-03-01 12:48:10,813::task::568::TaskManager.Task::(_updateState) Task=`5d571727-e5cf-4d6e-967f-ab26b432dabf`::moving from state init -> state preparing >Thread-61::INFO::2013-03-01 12:48:10,814::logUtils::37::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', options=None) >MainProcess|Thread-61::DEBUG::2013-03-01 12:48:10,824::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-61::DEBUG::2013-03-01 12:48:10,828::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-61::DEBUG::2013-03-01 12:48:10,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-5' (cwd None) >MainProcess|Thread-61::DEBUG::2013-03-01 12:48:10,834::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-61::INFO::2013-03-01 12:48:10,837::logUtils::39::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'vgfree': '49123688448', 'vgUUID': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '35'}], 'devtype': 'iSCSI', 'pvUUID': 'bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ', 'serial': 'SXtremIO_XtremApp_4a0496c174d34047b11cbebd359e60ba', 'GUID': '3514f0c542a0004b8', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-61::DEBUG::2013-03-01 12:48:10,838::task::1151::TaskManager.Task::(prepare) Task=`5d571727-e5cf-4d6e-967f-ab26b432dabf`::finished: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'vgfree': '49123688448', 'vgUUID': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '35'}], 'devtype': 'iSCSI', 'pvUUID': 'bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ', 'serial': 'SXtremIO_XtremApp_4a0496c174d34047b11cbebd359e60ba', 'GUID': '3514f0c542a0004b8', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-61::DEBUG::2013-03-01 12:48:10,838::task::568::TaskManager.Task::(_updateState) Task=`5d571727-e5cf-4d6e-967f-ab26b432dabf`::moving from state preparing -> state finished >Thread-61::DEBUG::2013-03-01 12:48:10,838::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2013-03-01 12:48:10,838::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2013-03-01 12:48:10,838::task::957::TaskManager.Task::(_decref) Task=`5d571727-e5cf-4d6e-967f-ab26b432dabf`::ref 0 aborting False >Thread-63::DEBUG::2013-03-01 12:48:12,720::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-63::DEBUG::2013-03-01 12:48:12,721::task::568::TaskManager.Task::(_updateState) Task=`6eacfac5-3e67-473e-a538-92a6ab2e6ea2`::moving from state init -> state preparing >Thread-63::INFO::2013-03-01 12:48:12,721::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-63::DEBUG::2013-03-01 12:48:12,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-63::DEBUG::2013-03-01 12:48:12,744::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2013-03-01 12:48:12,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-63::DEBUG::2013-03-01 12:48:12,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2013-03-01 12:48:12,762::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-63::DEBUG::2013-03-01 12:48:12,778::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::INFO::2013-03-01 12:48:12,778::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-63::DEBUG::2013-03-01 12:48:12,779::task::1151::TaskManager.Task::(prepare) Task=`6eacfac5-3e67-473e-a538-92a6ab2e6ea2`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-63::DEBUG::2013-03-01 12:48:12,779::task::568::TaskManager.Task::(_updateState) Task=`6eacfac5-3e67-473e-a538-92a6ab2e6ea2`::moving from state preparing -> state finished >Thread-63::DEBUG::2013-03-01 12:48:12,779::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-63::DEBUG::2013-03-01 12:48:12,779::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2013-03-01 12:48:12,779::task::957::TaskManager.Task::(_decref) Task=`6eacfac5-3e67-473e-a538-92a6ab2e6ea2`::ref 0 aborting False >Thread-64::DEBUG::2013-03-01 12:48:12,816::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-64::DEBUG::2013-03-01 12:48:12,816::task::568::TaskManager.Task::(_updateState) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::moving from state init -> state preparing >Thread-64::INFO::2013-03-01 12:48:12,817::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', poolName='clone_dc', masterDom='a558fc2a-a4a3-4118-9b81-d1d601eaa295', domList=['a558fc2a-a4a3-4118-9b81-d1d601eaa295'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-64::DEBUG::2013-03-01 12:48:12,817::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:12,818::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:12,818::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:12,818::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:12,819::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:12,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:13,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:13,060::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,060::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', '_SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3'] >Thread-64::INFO::2013-03-01 12:48:13,061::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-64::DEBUG::2013-03-01 12:48:13,061::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:13,300::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:13,301::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,301::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,302::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,302::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,302::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:13,539::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:13,540::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,541::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', '_SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3'] >Thread-64::DEBUG::2013-03-01 12:48:13,542::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e8927a9d-c1a5-451d-aed3-b9e86f5d42e5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-64::DEBUG::2013-03-01 12:48:13,542::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-64::DEBUG::2013-03-01 12:48:13,542::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-64::DEBUG::2013-03-01 12:48:13,542::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e8927a9d-c1a5-451d-aed3-b9e86f5d42e5`::Granted request >Thread-64::DEBUG::2013-03-01 12:48:13,543::task::794::TaskManager.Task::(resourceAcquired) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-64::DEBUG::2013-03-01 12:48:13,543::task::957::TaskManager.Task::(_decref) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::ref 1 aborting False >Thread-64::DEBUG::2013-03-01 12:48:13,543::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`61bd1d42-3623-4372-abe3-1843e23d5808`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-64::DEBUG::2013-03-01 12:48:13,544::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >Thread-64::DEBUG::2013-03-01 12:48:13,544::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >Thread-64::DEBUG::2013-03-01 12:48:13,544::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`61bd1d42-3623-4372-abe3-1843e23d5808`::Granted request >Thread-64::DEBUG::2013-03-01 12:48:13,545::task::794::TaskManager.Task::(resourceAcquired) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (exclusive) >Thread-64::DEBUG::2013-03-01 12:48:13,545::task::957::TaskManager.Task::(_decref) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::ref 1 aborting False >Thread-64::INFO::2013-03-01 12:48:13,545::sp::543::Storage.StoragePool::(create) spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be poolName=clone_dc master_sd=a558fc2a-a4a3-4118-9b81-d1d601eaa295 domList=['a558fc2a-a4a3-4118-9b81-d1d601eaa295'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-64::INFO::2013-03-01 12:48:13,545::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-64::DEBUG::2013-03-01 12:48:13,546::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:13,783::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:13,783::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,784::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,784::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,784::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,784::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:13,785::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:14,022::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:14,025::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,025::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', '_SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3'] >Thread-64::DEBUG::2013-03-01 12:48:14,026::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,027::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,027::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,027::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,027::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,028::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:14,268::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:14,270::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,271::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', '_SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3'] >Thread-64::DEBUG::2013-03-01 12:48:14,272::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-64::DEBUG::2013-03-01 12:48:14,272::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-64::DEBUG::2013-03-01 12:48:14,273::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f'] >Thread-64::DEBUG::2013-03-01 12:48:14,273::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,273::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,274::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,274::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,274::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:14,513::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:14,514::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:14,515::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_LEASETIMESEC=60, MDT_IOOPTIMEOUTSEC=10, MDT__SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f removing=MDT__SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca, MDT_LEASETIMESEC=5, MDT_IOOPTIMEOUTSEC=1 >Thread-64::DEBUG::2013-03-01 12:48:14,516::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_LEASETIMESEC=5 --deltag MDT_IOOPTIMEOUTSEC=1 --deltag MDT__SHA_CKSUM=b8effceb71c534ffee02653c16a30206aaecc1ca --addtag MDT_LEASETIMESEC=60 --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT__SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:15,401::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:15,414::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:15,421::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:15,426::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-64::INFO::2013-03-01 12:48:15,430::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 250) >Thread-67::DEBUG::2013-03-01 12:48:20,542::task::568::TaskManager.Task::(_updateState) Task=`cbfb4817-887d-45d0-8d08-60662f4437cf`::moving from state init -> state preparing >Thread-67::INFO::2013-03-01 12:48:20,543::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-67::INFO::2013-03-01 12:48:20,543::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-67::DEBUG::2013-03-01 12:48:20,543::task::1151::TaskManager.Task::(prepare) Task=`cbfb4817-887d-45d0-8d08-60662f4437cf`::finished: {} >Thread-67::DEBUG::2013-03-01 12:48:20,543::task::568::TaskManager.Task::(_updateState) Task=`cbfb4817-887d-45d0-8d08-60662f4437cf`::moving from state preparing -> state finished >Thread-67::DEBUG::2013-03-01 12:48:20,544::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2013-03-01 12:48:20,544::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2013-03-01 12:48:20,544::task::957::TaskManager.Task::(_decref) Task=`cbfb4817-887d-45d0-8d08-60662f4437cf`::ref 0 aborting False >Thread-73::DEBUG::2013-03-01 12:48:35,834::task::568::TaskManager.Task::(_updateState) Task=`638792ef-a8a9-4a07-a6e6-da4e5737fe98`::moving from state init -> state preparing >Thread-73::INFO::2013-03-01 12:48:35,834::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2013-03-01 12:48:35,834::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-73::DEBUG::2013-03-01 12:48:35,834::task::1151::TaskManager.Task::(prepare) Task=`638792ef-a8a9-4a07-a6e6-da4e5737fe98`::finished: {} >Thread-73::DEBUG::2013-03-01 12:48:35,835::task::568::TaskManager.Task::(_updateState) Task=`638792ef-a8a9-4a07-a6e6-da4e5737fe98`::moving from state preparing -> state finished >Thread-73::DEBUG::2013-03-01 12:48:35,835::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2013-03-01 12:48:35,835::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2013-03-01 12:48:35,835::task::957::TaskManager.Task::(_decref) Task=`638792ef-a8a9-4a07-a6e6-da4e5737fe98`::ref 0 aborting False >Thread-64::DEBUG::2013-03-01 12:48:36,489::clusterlock::191::SANLock::(acquireHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 250) >Thread-64::WARNING::2013-03-01 12:48:36,489::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-64::WARNING::2013-03-01 12:48:36,490::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-64::DEBUG::2013-03-01 12:48:36,491::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,491::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,491::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,491::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,492::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-64::DEBUG::2013-03-01 12:48:36,492::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:36,498::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000274458 s, 7.5 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:36,499::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000274458 s, 7.5 MB/s'], size: 2048 >Thread-64::DEBUG::2013-03-01 12:48:36,499::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-64::WARNING::2013-03-01 12:48:36,499::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-64::DEBUG::2013-03-01 12:48:36,499::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-64::DEBUG::2013-03-01 12:48:36,500::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,500::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,500::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,501::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,501::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,502::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:36,724::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:36,726::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,726::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f'] >Thread-64::INFO::2013-03-01 12:48:36,727::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 250) >Thread-64::DEBUG::2013-03-01 12:48:36,737::clusterlock::248::SANLock::(acquire) Cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 250) >Thread-64::INFO::2013-03-01 12:48:36,737::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 41b11cc6-b020-47d9-b70e-c4fadcc621be on sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-64::DEBUG::2013-03-01 12:48:36,738::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-64::DEBUG::2013-03-01 12:48:36,738::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-64::DEBUG::2013-03-01 12:48:36,738::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,739::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,739::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,739::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,739::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,740::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:36,963::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:36,964::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,965::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'ROLE=Regular', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f'] >Thread-64::DEBUG::2013-03-01 12:48:36,966::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-64::DEBUG::2013-03-01 12:48:36,966::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-64::DEBUG::2013-03-01 12:48:36,966::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-64::DEBUG::2013-03-01 12:48:36,966::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-64::DEBUG::2013-03-01 12:48:36,967::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e'] >Thread-64::DEBUG::2013-03-01 12:48:36,967::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,968::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,968::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,968::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,969::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:36,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:37,184::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:37,186::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,187::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT_ROLE=Master, MDT__SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e, MDT_POOL_SPM_LVER=-1, MDT_POOL_SPM_ID=-1, MDT_POOL_DESCRIPTION=clone_dc, MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be, MDT_MASTER_VERSION=1 removing=MDT_POOL_UUID=, MDT__SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f, MDT_ROLE=Regular >Thread-64::DEBUG::2013-03-01 12:48:37,188::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_UUID= --deltag MDT__SHA_CKSUM=8e80c908243d5256b9360f38fb1a2f921a68f88f --deltag MDT_ROLE=Regular --addtag MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be --addtag MDT_POOL_SPM_ID=-1 --addtag MDT_MASTER_VERSION=1 --addtag MDT_ROLE=Master --addtag MDT__SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e --addtag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_DESCRIPTION=clone_dc --addtag MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:37,645::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:37,646::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,646::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,647::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-64::DEBUG::2013-03-01 12:48:37,647::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-64::DEBUG::2013-03-01 12:48:37,648::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-64::DEBUG::2013-03-01 12:48:37,648::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-64::DEBUG::2013-03-01 12:48:37,648::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,649::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,649::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,649::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,650::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,651::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:37,884::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:37,886::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,887::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-75::DEBUG::2013-03-01 12:48:37,888::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-64::DEBUG::2013-03-01 12:48:37,888::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `41b11cc6-b020-47d9-b70e-c4fadcc621be` started monitoring domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >Thread-64::DEBUG::2013-03-01 12:48:37,890::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-64::WARNING::2013-03-01 12:48:37,891::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be already exists >Thread-75::DEBUG::2013-03-01 12:48:37,893::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-64::DEBUG::2013-03-01 12:48:37,900::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 12:48:37,900::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-75::DEBUG::2013-03-01 12:48:38,129::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 12:48:38,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-75::DEBUG::2013-03-01 12:48:38,137::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258854 s, 15.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:38,141::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 12:48:38,143::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::WARNING::2013-03-01 12:48:38,184::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-64::WARNING::2013-03-01 12:48:38,184::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-64::INFO::2013-03-01 12:48:38,184::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-64::INFO::2013-03-01 12:48:38,185::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd >Thread-64::INFO::2013-03-01 12:48:38,185::clusterlock::252::SANLock::(release) Releasing cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-64::DEBUG::2013-03-01 12:48:38,186::clusterlock::263::SANLock::(release) Cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully released >Thread-64::INFO::2013-03-01 12:48:38,186::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 250) >Thread-64::DEBUG::2013-03-01 12:48:40,187::clusterlock::206::SANLock::(releaseHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 released successfully (id: 250) >Thread-75::DEBUG::2013-03-01 12:48:40,187::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-75::INFO::2013-03-01 12:48:40,188::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 250) >Thread-75::DEBUG::2013-03-01 12:48:40,188::clusterlock::206::SANLock::(releaseHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 released successfully (id: 250) >Thread-64::INFO::2013-03-01 12:48:40,189::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-64::DEBUG::2013-03-01 12:48:40,189::task::1151::TaskManager.Task::(prepare) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::finished: True >Thread-64::DEBUG::2013-03-01 12:48:40,189::task::568::TaskManager.Task::(_updateState) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::moving from state preparing -> state finished >Thread-64::DEBUG::2013-03-01 12:48:40,189::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-64::DEBUG::2013-03-01 12:48:40,189::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2013-03-01 12:48:40,190::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-64::DEBUG::2013-03-01 12:48:40,190::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-64::DEBUG::2013-03-01 12:48:40,190::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-64::DEBUG::2013-03-01 12:48:40,190::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-64::DEBUG::2013-03-01 12:48:40,191::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-64::DEBUG::2013-03-01 12:48:40,191::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-64::DEBUG::2013-03-01 12:48:40,191::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-64::DEBUG::2013-03-01 12:48:40,191::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-64::DEBUG::2013-03-01 12:48:40,192::task::957::TaskManager.Task::(_decref) Task=`d6ad9655-4ed6-43e2-8f46-ba8e37574e10`::ref 0 aborting False >Thread-100::DEBUG::2013-03-01 12:48:40,313::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-100::DEBUG::2013-03-01 12:48:40,313::task::568::TaskManager.Task::(_updateState) Task=`fdb84ff1-195d-43e7-be47-bbe890703568`::moving from state init -> state preparing >Thread-100::INFO::2013-03-01 12:48:40,314::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-100::DEBUG::2013-03-01 12:48:40,315::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-100::DEBUG::2013-03-01 12:48:40,332::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-100::DEBUG::2013-03-01 12:48:40,332::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-100::DEBUG::2013-03-01 12:48:40,349::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-100::DEBUG::2013-03-01 12:48:40,349::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-100::DEBUG::2013-03-01 12:48:40,365::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-100::INFO::2013-03-01 12:48:40,365::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-100::DEBUG::2013-03-01 12:48:40,365::task::1151::TaskManager.Task::(prepare) Task=`fdb84ff1-195d-43e7-be47-bbe890703568`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-100::DEBUG::2013-03-01 12:48:40,366::task::568::TaskManager.Task::(_updateState) Task=`fdb84ff1-195d-43e7-be47-bbe890703568`::moving from state preparing -> state finished >Thread-100::DEBUG::2013-03-01 12:48:40,366::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2013-03-01 12:48:40,366::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2013-03-01 12:48:40,366::task::957::TaskManager.Task::(_decref) Task=`fdb84ff1-195d-43e7-be47-bbe890703568`::ref 0 aborting False >Thread-101::DEBUG::2013-03-01 12:48:40,465::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-101::DEBUG::2013-03-01 12:48:40,466::task::568::TaskManager.Task::(_updateState) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::moving from state init -> state preparing >Thread-101::INFO::2013-03-01 12:48:40,466::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-101::ERROR::2013-03-01 12:48:40,466::task::833::TaskManager.Task::(_setError) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 603, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 313, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('41b11cc6-b020-47d9-b70e-c4fadcc621be',) >Thread-101::DEBUG::2013-03-01 12:48:40,697::task::852::TaskManager.Task::(_run) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::Task._run: 7b2b59f1-2b4e-4fca-bd4a-282350f87191 ('41b11cc6-b020-47d9-b70e-c4fadcc621be',) {} failed - stopping task >Thread-101::DEBUG::2013-03-01 12:48:40,697::task::1177::TaskManager.Task::(stop) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::stopping in state preparing (force False) >Thread-101::DEBUG::2013-03-01 12:48:40,697::task::957::TaskManager.Task::(_decref) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::ref 1 aborting True >Thread-101::INFO::2013-03-01 12:48:40,698::task::1134::TaskManager.Task::(prepare) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-101::DEBUG::2013-03-01 12:48:40,698::task::1139::TaskManager.Task::(prepare) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::Prepare: aborted: Unknown pool id, pool not connected >Thread-101::DEBUG::2013-03-01 12:48:40,698::task::957::TaskManager.Task::(_decref) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::ref 0 aborting True >Thread-101::DEBUG::2013-03-01 12:48:40,698::task::892::TaskManager.Task::(_doAbort) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::Task._doAbort: force False >Thread-101::DEBUG::2013-03-01 12:48:40,699::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2013-03-01 12:48:40,699::task::568::TaskManager.Task::(_updateState) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::moving from state preparing -> state aborting >Thread-101::DEBUG::2013-03-01 12:48:40,699::task::523::TaskManager.Task::(__state_aborting) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::_aborting: recover policy none >Thread-101::DEBUG::2013-03-01 12:48:40,699::task::568::TaskManager.Task::(_updateState) Task=`7b2b59f1-2b4e-4fca-bd4a-282350f87191`::moving from state aborting -> state failed >Thread-101::DEBUG::2013-03-01 12:48:40,700::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2013-03-01 12:48:40,700::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::ERROR::2013-03-01 12:48:40,700::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('41b11cc6-b020-47d9-b70e-c4fadcc621be',)", 'code': 309}} >Thread-102::DEBUG::2013-03-01 12:48:40,748::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-102::DEBUG::2013-03-01 12:48:40,748::task::568::TaskManager.Task::(_updateState) Task=`4dc7f526-24a9-4a1c-93eb-e193aaa38ce2`::moving from state init -> state preparing >Thread-102::INFO::2013-03-01 12:48:40,748::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', hostID=1, scsiKey='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', masterVersion=1, options=None) >Thread-102::DEBUG::2013-03-01 12:48:40,749::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`dd0634c6-36ae-4c35-8292-0671d5ff104c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-102::DEBUG::2013-03-01 12:48:40,749::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-102::DEBUG::2013-03-01 12:48:40,749::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-102::DEBUG::2013-03-01 12:48:40,750::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`dd0634c6-36ae-4c35-8292-0671d5ff104c`::Granted request >Thread-102::INFO::2013-03-01 12:48:40,750::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 41b11cc6-b020-47d9-b70e-c4fadcc621be with master domain: a558fc2a-a4a3-4118-9b81-d1d601eaa295 (ver = 1) >Thread-102::DEBUG::2013-03-01 12:48:40,751::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:40,751::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:40,751::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:40,751::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:40,752::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:40,752::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:40,752::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-102::DEBUG::2013-03-01 12:48:40,752::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-102::DEBUG::2013-03-01 12:48:40,753::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-102::DEBUG::2013-03-01 12:48:40,753::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-102::DEBUG::2013-03-01 12:48:40,753::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:40,775::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:40,775::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:40,777::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:40,780::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:40,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:40,784::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:40,787::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:40,789::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:41,792::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-102::DEBUG::2013-03-01 12:48:41,795::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-102::DEBUG::2013-03-01 12:48:43,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,072::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:46,073::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,074::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,074::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,074::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,075::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,075::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,076::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-102::DEBUG::2013-03-01 12:48:46,076::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,079::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,263::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:46,265::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,265::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-102::DEBUG::2013-03-01 12:48:46,266::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,273::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000331662 s, 6.2 MB/s\n'; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:46,274::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000331662 s, 6.2 MB/s'], size: 2048 >Thread-102::DEBUG::2013-03-01 12:48:46,274::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-102::WARNING::2013-03-01 12:48:46,274::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-102::DEBUG::2013-03-01 12:48:46,275::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-102::DEBUG::2013-03-01 12:48:46,275::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,275::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,276::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,276::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,277::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,517::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:46,519::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,519::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-102::DEBUG::2013-03-01 12:48:46,520::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,521::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:46,763::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-102::WARNING::2013-03-01 12:48:46,764::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-102::WARNING::2013-03-01 12:48:46,764::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-102::WARNING::2013-03-01 12:48:46,765::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-102::DEBUG::2013-03-01 12:48:46,765::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-102::DEBUG::2013-03-01 12:48:46,765::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-102::DEBUG::2013-03-01 12:48:46,766::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-102::DEBUG::2013-03-01 12:48:46,766::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,767::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,767::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,767::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,768::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,769::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,972::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:46,974::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-102::DEBUG::2013-03-01 12:48:46,974::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-102::DEBUG::2013-03-01 12:48:46,975::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `41b11cc6-b020-47d9-b70e-c4fadcc621be` started monitoring domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >Thread-105::DEBUG::2013-03-01 12:48:46,975::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-102::DEBUG::2013-03-01 12:48:46,976::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-102::WARNING::2013-03-01 12:48:46,978::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be already exists >Thread-102::DEBUG::2013-03-01 12:48:46,981::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:48:46,982::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:46,989::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-105::DEBUG::2013-03-01 12:48:47,167::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:48:47,168::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:48:47,175::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028031 s, 14.6 MB/s\n'; <rc> = 0 >Thread-105::INFO::2013-03-01 12:48:47,178::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >Thread-105::DEBUG::2013-03-01 12:48:47,178::clusterlock::191::SANLock::(acquireHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 1) >Thread-102::DEBUG::2013-03-01 12:48:47,181::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:47,183::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-102::WARNING::2013-03-01 12:48:47,223::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-102::WARNING::2013-03-01 12:48:47,223::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-102::INFO::2013-03-01 12:48:47,224::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-102::INFO::2013-03-01 12:48:47,224::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd >Thread-102::DEBUG::2013-03-01 12:48:47,225::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-102::DEBUG::2013-03-01 12:48:47,227::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:47,235::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00144272 s, 2.8 MB/s\n'; <rc> = 0 >Thread-102::INFO::2013-03-01 12:48:47,235::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-102::DEBUG::2013-03-01 12:48:47,235::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-102::DEBUG::2013-03-01 12:48:48,243::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00142 s, 4.1 kB/s\n'; <rc> = 0 >Thread-102::DEBUG::2013-03-01 12:48:48,244::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-102::DEBUG::2013-03-01 12:48:48,244::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be on master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-102::DEBUG::2013-03-01 12:48:48,245::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-102::DEBUG::2013-03-01 12:48:48,245::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-102::DEBUG::2013-03-01 12:48:48,245::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-102::DEBUG::2013-03-01 12:48:48,246::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-102::INFO::2013-03-01 12:48:48,246::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-102::DEBUG::2013-03-01 12:48:48,246::task::1151::TaskManager.Task::(prepare) Task=`4dc7f526-24a9-4a1c-93eb-e193aaa38ce2`::finished: True >Thread-102::DEBUG::2013-03-01 12:48:48,247::task::568::TaskManager.Task::(_updateState) Task=`4dc7f526-24a9-4a1c-93eb-e193aaa38ce2`::moving from state preparing -> state finished >Thread-102::DEBUG::2013-03-01 12:48:48,247::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2013-03-01 12:48:48,247::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2013-03-01 12:48:48,248::task::957::TaskManager.Task::(_decref) Task=`4dc7f526-24a9-4a1c-93eb-e193aaa38ce2`::ref 0 aborting False >Thread-136::DEBUG::2013-03-01 12:48:48,275::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-136::DEBUG::2013-03-01 12:48:48,276::task::568::TaskManager.Task::(_updateState) Task=`6d029fe8-541a-478c-a098-818a2a8feb4d`::moving from state init -> state preparing >Thread-136::INFO::2013-03-01 12:48:48,276::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-136::INFO::2013-03-01 12:48:48,276::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-136::DEBUG::2013-03-01 12:48:48,277::task::1151::TaskManager.Task::(prepare) Task=`6d029fe8-541a-478c-a098-818a2a8feb4d`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-136::DEBUG::2013-03-01 12:48:48,277::task::568::TaskManager.Task::(_updateState) Task=`6d029fe8-541a-478c-a098-818a2a8feb4d`::moving from state preparing -> state finished >Thread-136::DEBUG::2013-03-01 12:48:48,277::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2013-03-01 12:48:48,277::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2013-03-01 12:48:48,278::task::957::TaskManager.Task::(_decref) Task=`6d029fe8-541a-478c-a098-818a2a8feb4d`::ref 0 aborting False >Thread-137::DEBUG::2013-03-01 12:48:48,325::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-137::DEBUG::2013-03-01 12:48:48,326::task::568::TaskManager.Task::(_updateState) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::moving from state init -> state preparing >Thread-137::INFO::2013-03-01 12:48:48,326::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-137::DEBUG::2013-03-01 12:48:48,327::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b2c247f9-74fe-4692-a5e5-0c6de949fe6c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-137::DEBUG::2013-03-01 12:48:48,327::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-137::DEBUG::2013-03-01 12:48:48,327::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-137::DEBUG::2013-03-01 12:48:48,328::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b2c247f9-74fe-4692-a5e5-0c6de949fe6c`::Granted request >Thread-137::DEBUG::2013-03-01 12:48:48,328::task::794::TaskManager.Task::(resourceAcquired) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-137::DEBUG::2013-03-01 12:48:48,328::task::957::TaskManager.Task::(_decref) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::ref 1 aborting False >Thread-137::INFO::2013-03-01 12:48:48,329::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-137::DEBUG::2013-03-01 12:48:48,329::task::1146::TaskManager.Task::(prepare) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::Prepare: 1 jobs exist, move to acquiring >Thread-137::DEBUG::2013-03-01 12:48:48,329::task::568::TaskManager.Task::(_updateState) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::moving from state preparing -> state acquiring >Thread-137::DEBUG::2013-03-01 12:48:48,330::task::568::TaskManager.Task::(_updateState) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::moving from state acquiring -> state queued >Thread-137::DEBUG::2013-03-01 12:48:48,330::taskManager::50::TaskManager::(_queueTask) queuing task: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-137::DEBUG::2013-03-01 12:48:48,330::taskManager::56::TaskManager::(_queueTask) task queued: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-8::DEBUG::2013-03-01 12:48:48,330::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-137::DEBUG::2013-03-01 12:48:48,331::task::1148::TaskManager.Task::(prepare) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::returning >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,332::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: c261e8ca-c11c-4e02-893d-4ee09209b7f0 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c0275560>> with: None >Thread-137::DEBUG::2013-03-01 12:48:48,333::task::957::TaskManager.Task::(_decref) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::ref 0 aborting False >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,333::task::1159::TaskManager.Task::(commit) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::committing task: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,334::task::568::TaskManager.Task::(_updateState) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::moving from state queued -> state running >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,335::task::872::TaskManager.Task::(_runJobs) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x17a8e90>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,336::task::304::TaskManager.Task::(run) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x17a8e90>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,336::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,337::misc::1055::SamplingMethod::(__call__) Got in to sampling method >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,337::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,337::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,338::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,338::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,338::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,339::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,513::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,515::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,515::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,516::misc::1063::SamplingMethod::(__call__) Returning last result >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,516::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,517::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,517::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,517::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,518::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,518::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,706::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,707::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:48:48,708::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::INFO::2013-03-01 12:48:48,708::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >Thread-138::DEBUG::2013-03-01 12:48:49,370::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-138::DEBUG::2013-03-01 12:48:49,370::task::568::TaskManager.Task::(_updateState) Task=`714cf7bb-198d-471f-b64d-4bce5d608b89`::moving from state init -> state preparing >Thread-138::INFO::2013-03-01 12:48:49,371::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-138::DEBUG::2013-03-01 12:48:49,371::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-138::DEBUG::2013-03-01 12:48:49,371::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-138::INFO::2013-03-01 12:48:49,371::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-138::DEBUG::2013-03-01 12:48:49,372::task::1151::TaskManager.Task::(prepare) Task=`714cf7bb-198d-471f-b64d-4bce5d608b89`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-138::DEBUG::2013-03-01 12:48:49,372::task::568::TaskManager.Task::(_updateState) Task=`714cf7bb-198d-471f-b64d-4bce5d608b89`::moving from state preparing -> state finished >Thread-138::DEBUG::2013-03-01 12:48:49,372::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138::DEBUG::2013-03-01 12:48:49,373::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2013-03-01 12:48:49,373::task::957::TaskManager.Task::(_decref) Task=`714cf7bb-198d-471f-b64d-4bce5d608b89`::ref 0 aborting False >Thread-139::DEBUG::2013-03-01 12:48:50,405::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-139::DEBUG::2013-03-01 12:48:50,405::task::568::TaskManager.Task::(_updateState) Task=`90684a97-0006-4977-b146-b66c96887f7d`::moving from state init -> state preparing >Thread-139::INFO::2013-03-01 12:48:50,405::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-139::DEBUG::2013-03-01 12:48:50,405::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-139::DEBUG::2013-03-01 12:48:50,406::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-139::INFO::2013-03-01 12:48:50,406::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-139::DEBUG::2013-03-01 12:48:50,406::task::1151::TaskManager.Task::(prepare) Task=`90684a97-0006-4977-b146-b66c96887f7d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-139::DEBUG::2013-03-01 12:48:50,406::task::568::TaskManager.Task::(_updateState) Task=`90684a97-0006-4977-b146-b66c96887f7d`::moving from state preparing -> state finished >Thread-139::DEBUG::2013-03-01 12:48:50,406::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-139::DEBUG::2013-03-01 12:48:50,407::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-139::DEBUG::2013-03-01 12:48:50,407::task::957::TaskManager.Task::(_decref) Task=`90684a97-0006-4977-b146-b66c96887f7d`::ref 0 aborting False >Thread-140::DEBUG::2013-03-01 12:48:51,092::task::568::TaskManager.Task::(_updateState) Task=`4713998f-abef-4894-b4fc-5926474e097d`::moving from state init -> state preparing >Thread-140::INFO::2013-03-01 12:48:51,092::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-140::INFO::2013-03-01 12:48:51,093::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00730800628662', 'lastCheck': '3.9', 'code': 0, 'valid': True}} >Thread-140::DEBUG::2013-03-01 12:48:51,093::task::1151::TaskManager.Task::(prepare) Task=`4713998f-abef-4894-b4fc-5926474e097d`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00730800628662', 'lastCheck': '3.9', 'code': 0, 'valid': True}} >Thread-140::DEBUG::2013-03-01 12:48:51,093::task::568::TaskManager.Task::(_updateState) Task=`4713998f-abef-4894-b4fc-5926474e097d`::moving from state preparing -> state finished >Thread-140::DEBUG::2013-03-01 12:48:51,093::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-140::DEBUG::2013-03-01 12:48:51,094::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-140::DEBUG::2013-03-01 12:48:51,094::task::957::TaskManager.Task::(_decref) Task=`4713998f-abef-4894-b4fc-5926474e097d`::ref 0 aborting False >Thread-142::DEBUG::2013-03-01 12:48:51,437::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-142::DEBUG::2013-03-01 12:48:51,438::task::568::TaskManager.Task::(_updateState) Task=`451bcbd6-5d50-4d1d-95dd-2ac9a87f318c`::moving from state init -> state preparing >Thread-142::INFO::2013-03-01 12:48:51,438::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-142::DEBUG::2013-03-01 12:48:51,438::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-142::DEBUG::2013-03-01 12:48:51,438::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-142::INFO::2013-03-01 12:48:51,438::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-142::DEBUG::2013-03-01 12:48:51,439::task::1151::TaskManager.Task::(prepare) Task=`451bcbd6-5d50-4d1d-95dd-2ac9a87f318c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-142::DEBUG::2013-03-01 12:48:51,439::task::568::TaskManager.Task::(_updateState) Task=`451bcbd6-5d50-4d1d-95dd-2ac9a87f318c`::moving from state preparing -> state finished >Thread-142::DEBUG::2013-03-01 12:48:51,439::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-142::DEBUG::2013-03-01 12:48:51,439::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-142::DEBUG::2013-03-01 12:48:51,440::task::957::TaskManager.Task::(_decref) Task=`451bcbd6-5d50-4d1d-95dd-2ac9a87f318c`::ref 0 aborting False >Thread-143::DEBUG::2013-03-01 12:48:52,469::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-143::DEBUG::2013-03-01 12:48:52,470::task::568::TaskManager.Task::(_updateState) Task=`377a738b-6373-4d88-8754-8735c00ce2d2`::moving from state init -> state preparing >Thread-143::INFO::2013-03-01 12:48:52,470::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-143::DEBUG::2013-03-01 12:48:52,470::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-143::DEBUG::2013-03-01 12:48:52,470::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-143::INFO::2013-03-01 12:48:52,471::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-143::DEBUG::2013-03-01 12:48:52,471::task::1151::TaskManager.Task::(prepare) Task=`377a738b-6373-4d88-8754-8735c00ce2d2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-143::DEBUG::2013-03-01 12:48:52,471::task::568::TaskManager.Task::(_updateState) Task=`377a738b-6373-4d88-8754-8735c00ce2d2`::moving from state preparing -> state finished >Thread-143::DEBUG::2013-03-01 12:48:52,471::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-143::DEBUG::2013-03-01 12:48:52,472::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-143::DEBUG::2013-03-01 12:48:52,472::task::957::TaskManager.Task::(_decref) Task=`377a738b-6373-4d88-8754-8735c00ce2d2`::ref 0 aborting False >Thread-144::DEBUG::2013-03-01 12:48:53,501::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-144::DEBUG::2013-03-01 12:48:53,501::task::568::TaskManager.Task::(_updateState) Task=`59ad65ef-1082-4872-8a38-5eeec6fc4867`::moving from state init -> state preparing >Thread-144::INFO::2013-03-01 12:48:53,502::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-144::DEBUG::2013-03-01 12:48:53,502::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-144::DEBUG::2013-03-01 12:48:53,502::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-144::INFO::2013-03-01 12:48:53,502::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-144::DEBUG::2013-03-01 12:48:53,503::task::1151::TaskManager.Task::(prepare) Task=`59ad65ef-1082-4872-8a38-5eeec6fc4867`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-144::DEBUG::2013-03-01 12:48:53,503::task::568::TaskManager.Task::(_updateState) Task=`59ad65ef-1082-4872-8a38-5eeec6fc4867`::moving from state preparing -> state finished >Thread-144::DEBUG::2013-03-01 12:48:53,503::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-144::DEBUG::2013-03-01 12:48:53,503::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2013-03-01 12:48:53,504::task::957::TaskManager.Task::(_decref) Task=`59ad65ef-1082-4872-8a38-5eeec6fc4867`::ref 0 aborting False >Thread-146::DEBUG::2013-03-01 12:48:54,534::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-146::DEBUG::2013-03-01 12:48:54,534::task::568::TaskManager.Task::(_updateState) Task=`99e817be-2f9f-4c55-8f7e-dba9463a305b`::moving from state init -> state preparing >Thread-146::INFO::2013-03-01 12:48:54,534::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-146::DEBUG::2013-03-01 12:48:54,535::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-146::DEBUG::2013-03-01 12:48:54,535::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-146::INFO::2013-03-01 12:48:54,535::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-146::DEBUG::2013-03-01 12:48:54,535::task::1151::TaskManager.Task::(prepare) Task=`99e817be-2f9f-4c55-8f7e-dba9463a305b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-146::DEBUG::2013-03-01 12:48:54,535::task::568::TaskManager.Task::(_updateState) Task=`99e817be-2f9f-4c55-8f7e-dba9463a305b`::moving from state preparing -> state finished >Thread-146::DEBUG::2013-03-01 12:48:54,535::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-146::DEBUG::2013-03-01 12:48:54,536::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-03-01 12:48:54,536::task::957::TaskManager.Task::(_decref) Task=`99e817be-2f9f-4c55-8f7e-dba9463a305b`::ref 0 aborting False >Thread-147::DEBUG::2013-03-01 12:48:55,566::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-147::DEBUG::2013-03-01 12:48:55,566::task::568::TaskManager.Task::(_updateState) Task=`3d69e9a6-e8a6-4052-b291-4d762525d05c`::moving from state init -> state preparing >Thread-147::INFO::2013-03-01 12:48:55,567::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-147::DEBUG::2013-03-01 12:48:55,567::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-147::DEBUG::2013-03-01 12:48:55,567::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-147::INFO::2013-03-01 12:48:55,567::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-147::DEBUG::2013-03-01 12:48:55,567::task::1151::TaskManager.Task::(prepare) Task=`3d69e9a6-e8a6-4052-b291-4d762525d05c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-147::DEBUG::2013-03-01 12:48:55,567::task::568::TaskManager.Task::(_updateState) Task=`3d69e9a6-e8a6-4052-b291-4d762525d05c`::moving from state preparing -> state finished >Thread-147::DEBUG::2013-03-01 12:48:55,568::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-147::DEBUG::2013-03-01 12:48:55,568::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-147::DEBUG::2013-03-01 12:48:55,568::task::957::TaskManager.Task::(_decref) Task=`3d69e9a6-e8a6-4052-b291-4d762525d05c`::ref 0 aborting False >Thread-148::DEBUG::2013-03-01 12:48:56,611::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-148::DEBUG::2013-03-01 12:48:56,611::task::568::TaskManager.Task::(_updateState) Task=`a3b56ea9-cdbc-4ab6-921d-a29e6d79b25f`::moving from state init -> state preparing >Thread-148::INFO::2013-03-01 12:48:56,611::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-148::DEBUG::2013-03-01 12:48:56,612::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-148::DEBUG::2013-03-01 12:48:56,612::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-148::INFO::2013-03-01 12:48:56,612::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-148::DEBUG::2013-03-01 12:48:56,612::task::1151::TaskManager.Task::(prepare) Task=`a3b56ea9-cdbc-4ab6-921d-a29e6d79b25f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-148::DEBUG::2013-03-01 12:48:56,613::task::568::TaskManager.Task::(_updateState) Task=`a3b56ea9-cdbc-4ab6-921d-a29e6d79b25f`::moving from state preparing -> state finished >Thread-148::DEBUG::2013-03-01 12:48:56,613::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-148::DEBUG::2013-03-01 12:48:56,613::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-148::DEBUG::2013-03-01 12:48:56,613::task::957::TaskManager.Task::(_decref) Task=`a3b56ea9-cdbc-4ab6-921d-a29e6d79b25f`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 12:48:57,179::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:48:57,187::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000315407 s, 13.0 MB/s\n'; <rc> = 0 >Thread-150::DEBUG::2013-03-01 12:48:57,642::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-150::DEBUG::2013-03-01 12:48:57,643::task::568::TaskManager.Task::(_updateState) Task=`2f2ae014-59a3-4da8-bd40-f116aee1399c`::moving from state init -> state preparing >Thread-150::INFO::2013-03-01 12:48:57,643::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-150::DEBUG::2013-03-01 12:48:57,643::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-150::DEBUG::2013-03-01 12:48:57,643::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-150::INFO::2013-03-01 12:48:57,644::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-150::DEBUG::2013-03-01 12:48:57,644::task::1151::TaskManager.Task::(prepare) Task=`2f2ae014-59a3-4da8-bd40-f116aee1399c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-150::DEBUG::2013-03-01 12:48:57,644::task::568::TaskManager.Task::(_updateState) Task=`2f2ae014-59a3-4da8-bd40-f116aee1399c`::moving from state preparing -> state finished >Thread-150::DEBUG::2013-03-01 12:48:57,644::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-150::DEBUG::2013-03-01 12:48:57,645::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2013-03-01 12:48:57,645::task::957::TaskManager.Task::(_decref) Task=`2f2ae014-59a3-4da8-bd40-f116aee1399c`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 12:48:58,675::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-151::DEBUG::2013-03-01 12:48:58,676::task::568::TaskManager.Task::(_updateState) Task=`7839959e-fe14-4513-bd21-489147970d8c`::moving from state init -> state preparing >Thread-151::INFO::2013-03-01 12:48:58,676::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-151::DEBUG::2013-03-01 12:48:58,676::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-151::DEBUG::2013-03-01 12:48:58,676::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-151::INFO::2013-03-01 12:48:58,677::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-151::DEBUG::2013-03-01 12:48:58,677::task::1151::TaskManager.Task::(prepare) Task=`7839959e-fe14-4513-bd21-489147970d8c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-151::DEBUG::2013-03-01 12:48:58,677::task::568::TaskManager.Task::(_updateState) Task=`7839959e-fe14-4513-bd21-489147970d8c`::moving from state preparing -> state finished >Thread-151::DEBUG::2013-03-01 12:48:58,678::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2013-03-01 12:48:58,678::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-151::DEBUG::2013-03-01 12:48:58,678::task::957::TaskManager.Task::(_decref) Task=`7839959e-fe14-4513-bd21-489147970d8c`::ref 0 aborting False >Thread-152::DEBUG::2013-03-01 12:48:59,708::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-152::DEBUG::2013-03-01 12:48:59,708::task::568::TaskManager.Task::(_updateState) Task=`2d46cad1-4d60-4396-b894-43b8b0dc226b`::moving from state init -> state preparing >Thread-152::INFO::2013-03-01 12:48:59,708::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-152::DEBUG::2013-03-01 12:48:59,708::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-152::DEBUG::2013-03-01 12:48:59,709::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-152::INFO::2013-03-01 12:48:59,709::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-152::DEBUG::2013-03-01 12:48:59,709::task::1151::TaskManager.Task::(prepare) Task=`2d46cad1-4d60-4396-b894-43b8b0dc226b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-152::DEBUG::2013-03-01 12:48:59,709::task::568::TaskManager.Task::(_updateState) Task=`2d46cad1-4d60-4396-b894-43b8b0dc226b`::moving from state preparing -> state finished >Thread-152::DEBUG::2013-03-01 12:48:59,709::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-152::DEBUG::2013-03-01 12:48:59,709::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-152::DEBUG::2013-03-01 12:48:59,710::task::957::TaskManager.Task::(_decref) Task=`2d46cad1-4d60-4396-b894-43b8b0dc226b`::ref 0 aborting False >Thread-154::DEBUG::2013-03-01 12:49:00,741::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-154::DEBUG::2013-03-01 12:49:00,741::task::568::TaskManager.Task::(_updateState) Task=`f384f18a-568c-4ab4-91c9-6b357fe9ebb6`::moving from state init -> state preparing >Thread-154::INFO::2013-03-01 12:49:00,741::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-154::DEBUG::2013-03-01 12:49:00,741::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-154::DEBUG::2013-03-01 12:49:00,741::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-154::INFO::2013-03-01 12:49:00,742::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-154::DEBUG::2013-03-01 12:49:00,742::task::1151::TaskManager.Task::(prepare) Task=`f384f18a-568c-4ab4-91c9-6b357fe9ebb6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-154::DEBUG::2013-03-01 12:49:00,742::task::568::TaskManager.Task::(_updateState) Task=`f384f18a-568c-4ab4-91c9-6b357fe9ebb6`::moving from state preparing -> state finished >Thread-154::DEBUG::2013-03-01 12:49:00,742::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-154::DEBUG::2013-03-01 12:49:00,742::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-154::DEBUG::2013-03-01 12:49:00,742::task::957::TaskManager.Task::(_decref) Task=`f384f18a-568c-4ab4-91c9-6b357fe9ebb6`::ref 0 aborting False >Thread-155::DEBUG::2013-03-01 12:49:01,772::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-155::DEBUG::2013-03-01 12:49:01,772::task::568::TaskManager.Task::(_updateState) Task=`68661e42-5dd4-4c0b-87b1-824ded653fab`::moving from state init -> state preparing >Thread-155::INFO::2013-03-01 12:49:01,773::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-155::DEBUG::2013-03-01 12:49:01,773::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-155::DEBUG::2013-03-01 12:49:01,773::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-155::INFO::2013-03-01 12:49:01,773::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-155::DEBUG::2013-03-01 12:49:01,774::task::1151::TaskManager.Task::(prepare) Task=`68661e42-5dd4-4c0b-87b1-824ded653fab`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-155::DEBUG::2013-03-01 12:49:01,774::task::568::TaskManager.Task::(_updateState) Task=`68661e42-5dd4-4c0b-87b1-824ded653fab`::moving from state preparing -> state finished >Thread-155::DEBUG::2013-03-01 12:49:01,774::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2013-03-01 12:49:01,774::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2013-03-01 12:49:01,775::task::957::TaskManager.Task::(_decref) Task=`68661e42-5dd4-4c0b-87b1-824ded653fab`::ref 0 aborting False >Thread-156::DEBUG::2013-03-01 12:49:02,803::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-156::DEBUG::2013-03-01 12:49:02,804::task::568::TaskManager.Task::(_updateState) Task=`c7c62adc-a423-4c14-bb18-a3f8396e1b6d`::moving from state init -> state preparing >Thread-156::INFO::2013-03-01 12:49:02,804::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-156::DEBUG::2013-03-01 12:49:02,804::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-156::DEBUG::2013-03-01 12:49:02,804::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-156::INFO::2013-03-01 12:49:02,804::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-156::DEBUG::2013-03-01 12:49:02,804::task::1151::TaskManager.Task::(prepare) Task=`c7c62adc-a423-4c14-bb18-a3f8396e1b6d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-156::DEBUG::2013-03-01 12:49:02,805::task::568::TaskManager.Task::(_updateState) Task=`c7c62adc-a423-4c14-bb18-a3f8396e1b6d`::moving from state preparing -> state finished >Thread-156::DEBUG::2013-03-01 12:49:02,805::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-156::DEBUG::2013-03-01 12:49:02,805::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-156::DEBUG::2013-03-01 12:49:02,805::task::957::TaskManager.Task::(_decref) Task=`c7c62adc-a423-4c14-bb18-a3f8396e1b6d`::ref 0 aborting False >Thread-158::DEBUG::2013-03-01 12:49:03,835::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-158::DEBUG::2013-03-01 12:49:03,835::task::568::TaskManager.Task::(_updateState) Task=`44e5dc96-9723-4a26-9db7-e3430210c184`::moving from state init -> state preparing >Thread-158::INFO::2013-03-01 12:49:03,836::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-158::DEBUG::2013-03-01 12:49:03,836::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-158::DEBUG::2013-03-01 12:49:03,836::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-158::INFO::2013-03-01 12:49:03,836::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-158::DEBUG::2013-03-01 12:49:03,836::task::1151::TaskManager.Task::(prepare) Task=`44e5dc96-9723-4a26-9db7-e3430210c184`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-158::DEBUG::2013-03-01 12:49:03,836::task::568::TaskManager.Task::(_updateState) Task=`44e5dc96-9723-4a26-9db7-e3430210c184`::moving from state preparing -> state finished >Thread-158::DEBUG::2013-03-01 12:49:03,837::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-158::DEBUG::2013-03-01 12:49:03,837::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-158::DEBUG::2013-03-01 12:49:03,837::task::957::TaskManager.Task::(_decref) Task=`44e5dc96-9723-4a26-9db7-e3430210c184`::ref 0 aborting False >Thread-159::DEBUG::2013-03-01 12:49:04,867::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-159::DEBUG::2013-03-01 12:49:04,868::task::568::TaskManager.Task::(_updateState) Task=`b3eedb69-17e9-4b14-800e-88e31cee2179`::moving from state init -> state preparing >Thread-159::INFO::2013-03-01 12:49:04,868::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-159::DEBUG::2013-03-01 12:49:04,868::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-159::DEBUG::2013-03-01 12:49:04,868::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-159::INFO::2013-03-01 12:49:04,869::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-159::DEBUG::2013-03-01 12:49:04,869::task::1151::TaskManager.Task::(prepare) Task=`b3eedb69-17e9-4b14-800e-88e31cee2179`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-159::DEBUG::2013-03-01 12:49:04,869::task::568::TaskManager.Task::(_updateState) Task=`b3eedb69-17e9-4b14-800e-88e31cee2179`::moving from state preparing -> state finished >Thread-159::DEBUG::2013-03-01 12:49:04,869::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-159::DEBUG::2013-03-01 12:49:04,870::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-159::DEBUG::2013-03-01 12:49:04,870::task::957::TaskManager.Task::(_decref) Task=`b3eedb69-17e9-4b14-800e-88e31cee2179`::ref 0 aborting False >Thread-160::DEBUG::2013-03-01 12:49:05,900::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-160::DEBUG::2013-03-01 12:49:05,901::task::568::TaskManager.Task::(_updateState) Task=`53320efb-9d24-444f-b790-8f553ea57790`::moving from state init -> state preparing >Thread-160::INFO::2013-03-01 12:49:05,901::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-160::DEBUG::2013-03-01 12:49:05,901::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-160::DEBUG::2013-03-01 12:49:05,901::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-160::INFO::2013-03-01 12:49:05,902::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-160::DEBUG::2013-03-01 12:49:05,902::task::1151::TaskManager.Task::(prepare) Task=`53320efb-9d24-444f-b790-8f553ea57790`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-160::DEBUG::2013-03-01 12:49:05,902::task::568::TaskManager.Task::(_updateState) Task=`53320efb-9d24-444f-b790-8f553ea57790`::moving from state preparing -> state finished >Thread-160::DEBUG::2013-03-01 12:49:05,902::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-160::DEBUG::2013-03-01 12:49:05,902::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-160::DEBUG::2013-03-01 12:49:05,903::task::957::TaskManager.Task::(_decref) Task=`53320efb-9d24-444f-b790-8f553ea57790`::ref 0 aborting False >Thread-161::DEBUG::2013-03-01 12:49:06,343::task::568::TaskManager.Task::(_updateState) Task=`cd7ff444-571c-4a39-8b28-8a2f0ed34358`::moving from state init -> state preparing >Thread-161::INFO::2013-03-01 12:49:06,343::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-161::INFO::2013-03-01 12:49:06,344::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00730800628662', 'lastCheck': '19.2', 'code': 0, 'valid': True}} >Thread-161::DEBUG::2013-03-01 12:49:06,344::task::1151::TaskManager.Task::(prepare) Task=`cd7ff444-571c-4a39-8b28-8a2f0ed34358`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00730800628662', 'lastCheck': '19.2', 'code': 0, 'valid': True}} >Thread-161::DEBUG::2013-03-01 12:49:06,344::task::568::TaskManager.Task::(_updateState) Task=`cd7ff444-571c-4a39-8b28-8a2f0ed34358`::moving from state preparing -> state finished >Thread-161::DEBUG::2013-03-01 12:49:06,344::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2013-03-01 12:49:06,345::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2013-03-01 12:49:06,345::task::957::TaskManager.Task::(_decref) Task=`cd7ff444-571c-4a39-8b28-8a2f0ed34358`::ref 0 aborting False >Thread-163::DEBUG::2013-03-01 12:49:06,943::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-163::DEBUG::2013-03-01 12:49:06,943::task::568::TaskManager.Task::(_updateState) Task=`564e2d3d-9f49-441a-ac7c-c67819398e7e`::moving from state init -> state preparing >Thread-163::INFO::2013-03-01 12:49:06,943::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-163::DEBUG::2013-03-01 12:49:06,943::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-163::DEBUG::2013-03-01 12:49:06,944::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-163::INFO::2013-03-01 12:49:06,944::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-163::DEBUG::2013-03-01 12:49:06,944::task::1151::TaskManager.Task::(prepare) Task=`564e2d3d-9f49-441a-ac7c-c67819398e7e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-163::DEBUG::2013-03-01 12:49:06,944::task::568::TaskManager.Task::(_updateState) Task=`564e2d3d-9f49-441a-ac7c-c67819398e7e`::moving from state preparing -> state finished >Thread-163::DEBUG::2013-03-01 12:49:06,945::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-163::DEBUG::2013-03-01 12:49:06,945::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-163::DEBUG::2013-03-01 12:49:06,945::task::957::TaskManager.Task::(_decref) Task=`564e2d3d-9f49-441a-ac7c-c67819398e7e`::ref 0 aborting False >Thread-164::DEBUG::2013-03-01 12:49:07,978::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-164::DEBUG::2013-03-01 12:49:07,997::task::568::TaskManager.Task::(_updateState) Task=`39dcbc73-3c62-4bb4-b15e-14a243082e0a`::moving from state init -> state preparing >Thread-164::INFO::2013-03-01 12:49:07,997::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-164::DEBUG::2013-03-01 12:49:07,998::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-164::DEBUG::2013-03-01 12:49:07,998::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-164::INFO::2013-03-01 12:49:07,998::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-164::DEBUG::2013-03-01 12:49:07,998::task::1151::TaskManager.Task::(prepare) Task=`39dcbc73-3c62-4bb4-b15e-14a243082e0a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-164::DEBUG::2013-03-01 12:49:07,998::task::568::TaskManager.Task::(_updateState) Task=`39dcbc73-3c62-4bb4-b15e-14a243082e0a`::moving from state preparing -> state finished >Thread-164::DEBUG::2013-03-01 12:49:07,998::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-164::DEBUG::2013-03-01 12:49:07,999::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-164::DEBUG::2013-03-01 12:49:07,999::task::957::TaskManager.Task::(_decref) Task=`39dcbc73-3c62-4bb4-b15e-14a243082e0a`::ref 0 aborting False >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,711::clusterlock::191::SANLock::(acquireHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 1) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:08,711::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:08,712::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,712::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,713::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,713::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,713::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,713::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,714::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,721::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000262565 s, 7.8 MB/s\n'; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,721::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000262565 s, 7.8 MB/s'], size: 2048 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,722::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:08,722::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,722::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,723::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,723::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,724::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,724::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,724::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,910::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,912::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,912::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::INFO::2013-03-01 12:49:08,913::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,921::clusterlock::248::SANLock::(acquire) Cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 1) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,922::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,922::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,922::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,923::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,923::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,923::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:08,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-165::DEBUG::2013-03-01 12:49:09,031::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-165::DEBUG::2013-03-01 12:49:09,032::task::568::TaskManager.Task::(_updateState) Task=`bda116ed-0ccd-4328-bb4b-eb23c1ea3296`::moving from state init -> state preparing >Thread-165::INFO::2013-03-01 12:49:09,032::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-165::DEBUG::2013-03-01 12:49:09,033::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-165::DEBUG::2013-03-01 12:49:09,033::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-165::INFO::2013-03-01 12:49:09,033::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-165::DEBUG::2013-03-01 12:49:09,033::task::1151::TaskManager.Task::(prepare) Task=`bda116ed-0ccd-4328-bb4b-eb23c1ea3296`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-165::DEBUG::2013-03-01 12:49:09,033::task::568::TaskManager.Task::(_updateState) Task=`bda116ed-0ccd-4328-bb4b-eb23c1ea3296`::moving from state preparing -> state finished >Thread-165::DEBUG::2013-03-01 12:49:09,033::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-165::DEBUG::2013-03-01 12:49:09,034::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-165::DEBUG::2013-03-01 12:49:09,034::task::957::TaskManager.Task::(_decref) Task=`bda116ed-0ccd-4328-bb4b-eb23c1ea3296`::ref 0 aborting False >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,108::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,110::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,110::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', '_SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,110::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,111::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,111::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,111::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,112::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,112::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,113::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,113::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,114::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,300::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,302::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,302::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9, MDT_POOL_SPM_LVER=0, MDT_POOL_SPM_ID=1 removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT__SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=d2e3115b630182457df04c6f923fd7d85d1c5c6e --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9 --addtag MDT_POOL_SPM_LVER=0 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,680::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,681::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,681::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,681::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,682::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`41afd0cf-eb9c-437f-8996-b2e90ec8f3c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,682::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,683::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,683::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`41afd0cf-eb9c-437f-8996-b2e90ec8f3c2`::Granted request >c261e8ca-c11c-4e02-893d-4ee09209b7f0::INFO::2013-03-01 12:49:09,683::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,684::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`40ae9aed-aa8c-4daf-b957-d6c5d23688bf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,684::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,684::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,685::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`40ae9aed-aa8c-4daf-b957-d6c5d23688bf`::Granted request >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,685::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,686::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,917::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,919::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,919::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,919::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,927::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000307184 s, 6.7 MB/s\n'; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,927::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000307184 s, 6.7 MB/s'], size: 2048 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,927::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:09,928::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,928::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,928::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,929::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,929::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,929::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,930::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:09,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-167::DEBUG::2013-03-01 12:49:10,070::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-167::DEBUG::2013-03-01 12:49:10,071::task::568::TaskManager.Task::(_updateState) Task=`86c8b788-6b7c-43c7-8047-3023d124322e`::moving from state init -> state preparing >Thread-167::INFO::2013-03-01 12:49:10,071::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-167::DEBUG::2013-03-01 12:49:10,072::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-167::DEBUG::2013-03-01 12:49:10,072::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-167::INFO::2013-03-01 12:49:10,072::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-167::DEBUG::2013-03-01 12:49:10,072::task::1151::TaskManager.Task::(prepare) Task=`86c8b788-6b7c-43c7-8047-3023d124322e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-167::DEBUG::2013-03-01 12:49:10,072::task::568::TaskManager.Task::(_updateState) Task=`86c8b788-6b7c-43c7-8047-3023d124322e`::moving from state preparing -> state finished >Thread-167::DEBUG::2013-03-01 12:49:10,073::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-167::DEBUG::2013-03-01 12:49:10,073::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-167::DEBUG::2013-03-01 12:49:10,073::task::957::TaskManager.Task::(_decref) Task=`86c8b788-6b7c-43c7-8047-3023d124322e`::ref 0 aborting False >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,112::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,114::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,114::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9', 'POOL_SPM_LVER=0'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:10,116::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:10,116::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:10,116::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,117::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,117::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,118::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,118::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,118::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,119::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,119::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,119::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,120::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,120::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,120::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,121::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/fsck -p /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,289::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,290::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,325::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,326::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,408::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:10,414::sd::600::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master/vms) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::WARNING::2013-03-01 12:49:10,416::sd::605::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master/tasks) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,420::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,423::storage_mailbox::504::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,423::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,471::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408905 s, 25.0 MB/s\n'; <rc> = 0 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,471::storage_mailbox::511::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,472::sp::302::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be on master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,473::sp::309::Storage.StoragePool::(startSpm) ended. >Dummy-173::DEBUG::2013-03-01 12:49:10,473::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,474::task::568::TaskManager.Task::(_updateState) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::moving from state running -> state finished >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,483::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,484::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,486::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,487::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,488::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,489::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,490::task::880::TaskManager.Task::(_runJobs) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::Task.run: exit - success: result >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,491::task::957::TaskManager.Task::(_decref) Task=`c261e8ca-c11c-4e02-893d-4ee09209b7f0`::ref 0 aborting False >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:49:10,492::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:49:11,095::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0532148 s, 19.2 MB/s\n'; <rc> = 0 >Thread-174::DEBUG::2013-03-01 12:49:11,217::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-174::DEBUG::2013-03-01 12:49:11,226::task::568::TaskManager.Task::(_updateState) Task=`c675f90f-fd79-4c70-963f-d138faf53741`::moving from state init -> state preparing >Thread-174::INFO::2013-03-01 12:49:11,234::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-174::DEBUG::2013-03-01 12:49:11,242::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-174::DEBUG::2013-03-01 12:49:11,244::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'} >Thread-174::INFO::2013-03-01 12:49:11,247::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-174::DEBUG::2013-03-01 12:49:11,250::task::1151::TaskManager.Task::(prepare) Task=`c675f90f-fd79-4c70-963f-d138faf53741`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c261e8ca-c11c-4e02-893d-4ee09209b7f0'}} >Thread-174::DEBUG::2013-03-01 12:49:11,253::task::568::TaskManager.Task::(_updateState) Task=`c675f90f-fd79-4c70-963f-d138faf53741`::moving from state preparing -> state finished >Thread-174::DEBUG::2013-03-01 12:49:11,255::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-174::DEBUG::2013-03-01 12:49:11,258::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-174::DEBUG::2013-03-01 12:49:11,260::task::957::TaskManager.Task::(_decref) Task=`c675f90f-fd79-4c70-963f-d138faf53741`::ref 0 aborting False >Thread-175::DEBUG::2013-03-01 12:49:11,364::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-175::DEBUG::2013-03-01 12:49:11,370::task::568::TaskManager.Task::(_updateState) Task=`161271cc-bfbe-409b-ae56-3e276b6856f7`::moving from state init -> state preparing >Thread-175::INFO::2013-03-01 12:49:11,374::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-175::INFO::2013-03-01 12:49:11,381::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-175::DEBUG::2013-03-01 12:49:11,383::task::1151::TaskManager.Task::(prepare) Task=`161271cc-bfbe-409b-ae56-3e276b6856f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-175::DEBUG::2013-03-01 12:49:11,386::task::568::TaskManager.Task::(_updateState) Task=`161271cc-bfbe-409b-ae56-3e276b6856f7`::moving from state preparing -> state finished >Thread-175::DEBUG::2013-03-01 12:49:11,389::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-175::DEBUG::2013-03-01 12:49:11,391::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-175::DEBUG::2013-03-01 12:49:11,394::task::957::TaskManager.Task::(_decref) Task=`161271cc-bfbe-409b-ae56-3e276b6856f7`::ref 0 aborting False >Thread-176::DEBUG::2013-03-01 12:49:11,514::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-176::DEBUG::2013-03-01 12:49:11,519::task::568::TaskManager.Task::(_updateState) Task=`aebd4ab5-1830-438a-9b40-ab6f8b3dc972`::moving from state init -> state preparing >Thread-176::INFO::2013-03-01 12:49:11,524::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='c261e8ca-c11c-4e02-893d-4ee09209b7f0', spUUID=None, options=None) >Thread-176::DEBUG::2013-03-01 12:49:11,526::taskManager::161::TaskManager::(clearTask) Entry. taskID: c261e8ca-c11c-4e02-893d-4ee09209b7f0 >Thread-176::DEBUG::2013-03-01 12:49:11,529::taskManager::166::TaskManager::(clearTask) Return. >Thread-176::INFO::2013-03-01 12:49:11,531::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-176::DEBUG::2013-03-01 12:49:11,534::task::1151::TaskManager.Task::(prepare) Task=`aebd4ab5-1830-438a-9b40-ab6f8b3dc972`::finished: None >Thread-176::DEBUG::2013-03-01 12:49:11,536::task::568::TaskManager.Task::(_updateState) Task=`aebd4ab5-1830-438a-9b40-ab6f8b3dc972`::moving from state preparing -> state finished >Thread-176::DEBUG::2013-03-01 12:49:11,540::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-176::DEBUG::2013-03-01 12:49:11,543::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-176::DEBUG::2013-03-01 12:49:11,547::task::957::TaskManager.Task::(_decref) Task=`aebd4ab5-1830-438a-9b40-ab6f8b3dc972`::ref 0 aborting False >Thread-177::DEBUG::2013-03-01 12:49:11,684::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-177::DEBUG::2013-03-01 12:49:11,690::task::568::TaskManager.Task::(_updateState) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::moving from state init -> state preparing >Thread-177::INFO::2013-03-01 12:49:11,694::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-177::DEBUG::2013-03-01 12:49:11,702::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e05f3ebf-851d-4c60-bef9-cdbc2a913a95`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-177::DEBUG::2013-03-01 12:49:11,704::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-177::DEBUG::2013-03-01 12:49:11,709::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-177::DEBUG::2013-03-01 12:49:11,711::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e05f3ebf-851d-4c60-bef9-cdbc2a913a95`::Granted request >Thread-177::DEBUG::2013-03-01 12:49:11,718::task::794::TaskManager.Task::(resourceAcquired) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-177::DEBUG::2013-03-01 12:49:11,721::task::957::TaskManager.Task::(_decref) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::ref 1 aborting False >Thread-177::DEBUG::2013-03-01 12:49:11,726::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1b006e0c-9f5c-420f-b6f7-2c72bb6f9f81`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-177::DEBUG::2013-03-01 12:49:11,729::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >Thread-177::DEBUG::2013-03-01 12:49:11,732::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >Thread-177::DEBUG::2013-03-01 12:49:11,735::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1b006e0c-9f5c-420f-b6f7-2c72bb6f9f81`::Granted request >Thread-177::DEBUG::2013-03-01 12:49:11,741::task::794::TaskManager.Task::(resourceAcquired) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (exclusive) >Thread-177::DEBUG::2013-03-01 12:49:11,743::task::957::TaskManager.Task::(_decref) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::ref 1 aborting False >Thread-177::INFO::2013-03-01 12:49:11,746::sp::1045::Storage.StoragePool::(activateSD) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-177::INFO::2013-03-01 12:49:11,752::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-177::DEBUG::2013-03-01 12:49:11,754::task::1151::TaskManager.Task::(prepare) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::finished: None >Thread-177::DEBUG::2013-03-01 12:49:11,756::task::568::TaskManager.Task::(_updateState) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::moving from state preparing -> state finished >Thread-177::DEBUG::2013-03-01 12:49:11,759::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-177::DEBUG::2013-03-01 12:49:11,762::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-177::DEBUG::2013-03-01 12:49:11,766::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-177::DEBUG::2013-03-01 12:49:11,769::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-177::DEBUG::2013-03-01 12:49:11,771::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-177::DEBUG::2013-03-01 12:49:11,774::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-177::DEBUG::2013-03-01 12:49:11,778::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-177::DEBUG::2013-03-01 12:49:11,781::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-177::DEBUG::2013-03-01 12:49:11,784::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-177::DEBUG::2013-03-01 12:49:11,786::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-177::DEBUG::2013-03-01 12:49:11,790::task::957::TaskManager.Task::(_decref) Task=`2726477f-2b23-4032-8417-0dfd2e55a479`::ref 0 aborting False >Thread-178::DEBUG::2013-03-01 12:49:11,979::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-178::DEBUG::2013-03-01 12:49:11,990::task::568::TaskManager.Task::(_updateState) Task=`2ba09784-8f3c-4c30-8d85-2b39796855fb`::moving from state init -> state preparing >Thread-178::INFO::2013-03-01 12:49:11,998::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', hostID=1, scsiKey='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', masterVersion=1, options=None) >Thread-178::DEBUG::2013-03-01 12:49:12,009::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`08519507-edef-454d-a883-9d4e3df115dd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-178::DEBUG::2013-03-01 12:49:12,013::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-178::DEBUG::2013-03-01 12:49:12,020::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-178::DEBUG::2013-03-01 12:49:12,024::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`08519507-edef-454d-a883-9d4e3df115dd`::Granted request >Thread-178::DEBUG::2013-03-01 12:49:12,037::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-178::DEBUG::2013-03-01 12:49:12,043::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-178::DEBUG::2013-03-01 12:49:12,049::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-178::DEBUG::2013-03-01 12:49:12,053::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-178::DEBUG::2013-03-01 12:49:12,057::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-178::INFO::2013-03-01 12:49:12,062::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-178::DEBUG::2013-03-01 12:49:12,066::task::1151::TaskManager.Task::(prepare) Task=`2ba09784-8f3c-4c30-8d85-2b39796855fb`::finished: None >Thread-178::DEBUG::2013-03-01 12:49:12,070::task::568::TaskManager.Task::(_updateState) Task=`2ba09784-8f3c-4c30-8d85-2b39796855fb`::moving from state preparing -> state finished >Thread-178::DEBUG::2013-03-01 12:49:12,073::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-178::DEBUG::2013-03-01 12:49:12,079::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-178::DEBUG::2013-03-01 12:49:12,083::task::957::TaskManager.Task::(_decref) Task=`2ba09784-8f3c-4c30-8d85-2b39796855fb`::ref 0 aborting False >Thread-180::DEBUG::2013-03-01 12:49:13,130::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-180::DEBUG::2013-03-01 12:49:13,130::task::568::TaskManager.Task::(_updateState) Task=`76dd255e-1a22-49cc-8144-ed1cbf876277`::moving from state init -> state preparing >Thread-180::INFO::2013-03-01 12:49:13,131::logUtils::37::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.7', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-180::DEBUG::2013-03-01 12:49:13,131::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-180::DEBUG::2013-03-01 12:49:13,149::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-180::DEBUG::2013-03-01 12:49:13,150::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-180::DEBUG::2013-03-01 12:49:13,166::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: Cannot modify node.startup. Invalid param name.\n'; <rc> = 7 >Thread-180::DEBUG::2013-03-01 12:49:13,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-180::DEBUG::2013-03-01 12:49:13,183::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-180::DEBUG::2013-03-01 12:49:13,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --discover' (cwd None) >Thread-180::DEBUG::2013-03-01 12:49:13,204::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-180::DEBUG::2013-03-01 12:49:13,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=delete' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:13,212::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-180::DEBUG::2013-03-01 12:49:13,220::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-180::INFO::2013-03-01 12:49:13,221::logUtils::39::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-180::DEBUG::2013-03-01 12:49:13,222::task::1151::TaskManager.Task::(prepare) Task=`76dd255e-1a22-49cc-8144-ed1cbf876277`::finished: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-180::DEBUG::2013-03-01 12:49:13,223::task::568::TaskManager.Task::(_updateState) Task=`76dd255e-1a22-49cc-8144-ed1cbf876277`::moving from state preparing -> state finished >Thread-180::DEBUG::2013-03-01 12:49:13,224::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-180::DEBUG::2013-03-01 12:49:13,226::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-180::DEBUG::2013-03-01 12:49:13,227::task::957::TaskManager.Task::(_decref) Task=`76dd255e-1a22-49cc-8144-ed1cbf876277`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:49:13,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426451 s, 24.0 MB/s\n'; <rc> = 0 >Thread-181::DEBUG::2013-03-01 12:49:13,781::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-181::DEBUG::2013-03-01 12:49:13,782::task::568::TaskManager.Task::(_updateState) Task=`1d7727da-7492-4560-9b76-29b3a1976627`::moving from state init -> state preparing >Thread-181::INFO::2013-03-01 12:49:13,782::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-181::INFO::2013-03-01 12:49:13,782::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-181::DEBUG::2013-03-01 12:49:13,783::task::1151::TaskManager.Task::(prepare) Task=`1d7727da-7492-4560-9b76-29b3a1976627`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-181::DEBUG::2013-03-01 12:49:13,783::task::568::TaskManager.Task::(_updateState) Task=`1d7727da-7492-4560-9b76-29b3a1976627`::moving from state preparing -> state finished >Thread-181::DEBUG::2013-03-01 12:49:13,783::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-181::DEBUG::2013-03-01 12:49:13,783::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-181::DEBUG::2013-03-01 12:49:13,784::task::957::TaskManager.Task::(_decref) Task=`1d7727da-7492-4560-9b76-29b3a1976627`::ref 0 aborting False >Thread-182::DEBUG::2013-03-01 12:49:13,831::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-182::DEBUG::2013-03-01 12:49:13,832::task::568::TaskManager.Task::(_updateState) Task=`d8d006d7-f272-4216-8964-73a86f2545ef`::moving from state init -> state preparing >Thread-182::INFO::2013-03-01 12:49:13,832::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-182::DEBUG::2013-03-01 12:49:13,833::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-182::DEBUG::2013-03-01 12:49:13,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-182::DEBUG::2013-03-01 12:49:13,851::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-182::DEBUG::2013-03-01 12:49:13,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-182::DEBUG::2013-03-01 12:49:13,869::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-182::DEBUG::2013-03-01 12:49:13,886::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-182::INFO::2013-03-01 12:49:13,887::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-182::DEBUG::2013-03-01 12:49:13,888::task::1151::TaskManager.Task::(prepare) Task=`d8d006d7-f272-4216-8964-73a86f2545ef`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-182::DEBUG::2013-03-01 12:49:13,888::task::568::TaskManager.Task::(_updateState) Task=`d8d006d7-f272-4216-8964-73a86f2545ef`::moving from state preparing -> state finished >Thread-182::DEBUG::2013-03-01 12:49:13,888::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-182::DEBUG::2013-03-01 12:49:13,888::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-182::DEBUG::2013-03-01 12:49:13,889::task::957::TaskManager.Task::(_decref) Task=`d8d006d7-f272-4216-8964-73a86f2545ef`::ref 0 aborting False >Thread-183::DEBUG::2013-03-01 12:49:14,658::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-183::DEBUG::2013-03-01 12:49:14,919::task::568::TaskManager.Task::(_updateState) Task=`cc8c1ce6-08a3-4ccb-8fcf-a9d346c29a89`::moving from state init -> state preparing >Thread-183::INFO::2013-03-01 12:49:14,919::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-183::INFO::2013-03-01 12:49:14,919::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-183::DEBUG::2013-03-01 12:49:14,919::task::1151::TaskManager.Task::(prepare) Task=`cc8c1ce6-08a3-4ccb-8fcf-a9d346c29a89`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-183::DEBUG::2013-03-01 12:49:14,920::task::568::TaskManager.Task::(_updateState) Task=`cc8c1ce6-08a3-4ccb-8fcf-a9d346c29a89`::moving from state preparing -> state finished >Thread-183::DEBUG::2013-03-01 12:49:14,920::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-183::DEBUG::2013-03-01 12:49:14,920::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-183::DEBUG::2013-03-01 12:49:14,920::task::957::TaskManager.Task::(_decref) Task=`cc8c1ce6-08a3-4ccb-8fcf-a9d346c29a89`::ref 0 aborting False >Thread-184::DEBUG::2013-03-01 12:49:14,960::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-184::DEBUG::2013-03-01 12:49:14,960::task::568::TaskManager.Task::(_updateState) Task=`dc9eb4d1-1802-4c5e-b4f9-6d0d01ad1bda`::moving from state init -> state preparing >Thread-184::INFO::2013-03-01 12:49:14,961::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-184::DEBUG::2013-03-01 12:49:14,961::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-184::DEBUG::2013-03-01 12:49:14,979::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-184::DEBUG::2013-03-01 12:49:14,980::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-184::DEBUG::2013-03-01 12:49:14,998::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-184::DEBUG::2013-03-01 12:49:14,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-184::DEBUG::2013-03-01 12:49:15,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-184::INFO::2013-03-01 12:49:15,017::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-184::DEBUG::2013-03-01 12:49:15,017::task::1151::TaskManager.Task::(prepare) Task=`dc9eb4d1-1802-4c5e-b4f9-6d0d01ad1bda`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-184::DEBUG::2013-03-01 12:49:15,017::task::568::TaskManager.Task::(_updateState) Task=`dc9eb4d1-1802-4c5e-b4f9-6d0d01ad1bda`::moving from state preparing -> state finished >Thread-184::DEBUG::2013-03-01 12:49:15,018::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184::DEBUG::2013-03-01 12:49:15,018::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184::DEBUG::2013-03-01 12:49:15,018::task::957::TaskManager.Task::(_decref) Task=`dc9eb4d1-1802-4c5e-b4f9-6d0d01ad1bda`::ref 0 aborting False >Thread-185::DEBUG::2013-03-01 12:49:15,071::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-185::DEBUG::2013-03-01 12:49:15,071::task::568::TaskManager.Task::(_updateState) Task=`4018361f-eb66-4fdd-ad2b-bb60f9fc9290`::moving from state init -> state preparing >Thread-185::INFO::2013-03-01 12:49:15,072::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-185::DEBUG::2013-03-01 12:49:15,072::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-185::DEBUG::2013-03-01 12:49:15,072::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-185::DEBUG::2013-03-01 12:49:15,073::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-185::DEBUG::2013-03-01 12:49:15,073::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-185::DEBUG::2013-03-01 12:49:15,073::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-185::DEBUG::2013-03-01 12:49:15,098::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-185::DEBUG::2013-03-01 12:49:15,098::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:15,100::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:15,314::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:15,399::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357809 s, 28.6 MB/s\n'; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:16,104::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:16,107::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:16,109::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:16,111::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:17,115::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:17,415::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:17,497::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329337 s, 31.1 MB/s\n'; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:18,119::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:18,122::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-105::DEBUG::2013-03-01 12:49:18,712::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:18,932::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:49:18,933::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:18,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000300243 s, 13.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:19,518::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-185::DEBUG::2013-03-01 12:49:20,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:21,087::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.754928 s, 1.4 MB/s\n'; <rc> = 0 >Thread-188::DEBUG::2013-03-01 12:49:21,764::task::568::TaskManager.Task::(_updateState) Task=`0799d469-371a-4935-89ea-429122c3d20c`::moving from state init -> state preparing >Thread-188::INFO::2013-03-01 12:49:21,771::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-188::INFO::2013-03-01 12:49:21,776::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00843095779419', 'lastCheck': '2.8', 'code': 0, 'valid': True}} >Thread-188::DEBUG::2013-03-01 12:49:21,779::task::1151::TaskManager.Task::(prepare) Task=`0799d469-371a-4935-89ea-429122c3d20c`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00843095779419', 'lastCheck': '2.8', 'code': 0, 'valid': True}} >Thread-188::DEBUG::2013-03-01 12:49:21,782::task::568::TaskManager.Task::(_updateState) Task=`0799d469-371a-4935-89ea-429122c3d20c`::moving from state preparing -> state finished >Thread-188::DEBUG::2013-03-01 12:49:21,785::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-188::DEBUG::2013-03-01 12:49:21,788::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-188::DEBUG::2013-03-01 12:49:21,791::task::957::TaskManager.Task::(_decref) Task=`0799d469-371a-4935-89ea-429122c3d20c`::ref 0 aborting False >Thread-189::DEBUG::2013-03-01 12:49:21,869::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-189::DEBUG::2013-03-01 12:49:21,869::task::568::TaskManager.Task::(_updateState) Task=`b552739b-7c08-4fd8-b681-e0e1a76b02a6`::moving from state init -> state preparing >Thread-189::INFO::2013-03-01 12:49:21,869::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-189::INFO::2013-03-01 12:49:21,870::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-189::DEBUG::2013-03-01 12:49:21,870::task::1151::TaskManager.Task::(prepare) Task=`b552739b-7c08-4fd8-b681-e0e1a76b02a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-189::DEBUG::2013-03-01 12:49:21,870::task::568::TaskManager.Task::(_updateState) Task=`b552739b-7c08-4fd8-b681-e0e1a76b02a6`::moving from state preparing -> state finished >Thread-189::DEBUG::2013-03-01 12:49:21,870::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2013-03-01 12:49:21,870::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2013-03-01 12:49:21,871::task::957::TaskManager.Task::(_decref) Task=`b552739b-7c08-4fd8-b681-e0e1a76b02a6`::ref 0 aborting False >Thread-191::DEBUG::2013-03-01 12:49:21,915::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-191::DEBUG::2013-03-01 12:49:21,915::task::568::TaskManager.Task::(_updateState) Task=`57d69c24-e521-4761-93d8-e4cb0eeebe9a`::moving from state init -> state preparing >Thread-191::INFO::2013-03-01 12:49:21,916::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-191::DEBUG::2013-03-01 12:49:21,916::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`46d70736-854c-4c8a-a1f5-76846311017d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-191::DEBUG::2013-03-01 12:49:21,917::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-191::DEBUG::2013-03-01 12:49:21,917::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-191::DEBUG::2013-03-01 12:49:21,917::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`46d70736-854c-4c8a-a1f5-76846311017d`::Granted request >Thread-191::DEBUG::2013-03-01 12:49:21,918::task::794::TaskManager.Task::(resourceAcquired) Task=`57d69c24-e521-4761-93d8-e4cb0eeebe9a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-191::DEBUG::2013-03-01 12:49:21,918::task::957::TaskManager.Task::(_decref) Task=`57d69c24-e521-4761-93d8-e4cb0eeebe9a`::ref 1 aborting False >Thread-191::INFO::2013-03-01 12:49:21,919::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-191::DEBUG::2013-03-01 12:49:21,920::task::1151::TaskManager.Task::(prepare) Task=`57d69c24-e521-4761-93d8-e4cb0eeebe9a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-191::DEBUG::2013-03-01 12:49:21,920::task::568::TaskManager.Task::(_updateState) Task=`57d69c24-e521-4761-93d8-e4cb0eeebe9a`::moving from state preparing -> state finished >Thread-191::DEBUG::2013-03-01 12:49:21,920::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-191::DEBUG::2013-03-01 12:49:21,920::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-191::DEBUG::2013-03-01 12:49:21,921::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-191::DEBUG::2013-03-01 12:49:21,921::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-191::DEBUG::2013-03-01 12:49:21,921::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-191::DEBUG::2013-03-01 12:49:21,921::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-191::DEBUG::2013-03-01 12:49:21,921::task::957::TaskManager.Task::(_decref) Task=`57d69c24-e521-4761-93d8-e4cb0eeebe9a`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:49:23,266::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:23,344::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309934 s, 33.0 MB/s\n'; <rc> = 0 >Thread-185::DEBUG::2013-03-01 12:49:23,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-185::DEBUG::2013-03-01 12:49:23,869::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,870::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,870::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,870::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,870::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,871::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,871::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-185::DEBUG::2013-03-01 12:49:23,871::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-185::DEBUG::2013-03-01 12:49:23,873::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-185::DEBUG::2013-03-01 12:49:24,120::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-185::DEBUG::2013-03-01 12:49:24,121::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,122::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,126::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,129::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-0' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,132::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-1' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,139::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,141::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-2' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,147::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,150::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-4' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,156::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,158::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-5' (cwd None) >MainProcess|Thread-185::DEBUG::2013-03-01 12:49:24,162::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-185::DEBUG::2013-03-01 12:49:24,168::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a000489 /dev/mapper/3514f0c542a00049f /dev/mapper/3514f0c542a00048a /dev/mapper/3514f0c542a0004b9 /dev/mapper/3514f0c542a000488 /dev/mapper/3514f0c542a0004b8' (cwd None) >Thread-185::DEBUG::2013-03-01 12:49:24,391::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004b8" of volume group "a558fc2a-a4a3-4118-9b81-d1d601eaa295" without -ff\n'; <rc> = 5 >Thread-185::DEBUG::2013-03-01 12:49:24,392::lvm::809::Storage.LVM::(testPVCreate) rc: 5, out: [' Physical volume "/dev/mapper/3514f0c542a000489" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00049f" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00048a" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b9" successfully created', ' Physical volume "/dev/mapper/3514f0c542a000488" successfully created'], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004b8" of volume group "a558fc2a-a4a3-4118-9b81-d1d601eaa295" without -ff'], unusedDevs: set(['/dev/mapper/3514f0c542a00048a', '/dev/mapper/3514f0c542a000489', '/dev/mapper/3514f0c542a0004b9', '/dev/mapper/3514f0c542a000488', '/dev/mapper/3514f0c542a00049f']), usedDevs: set(['/dev/mapper/3514f0c542a0004b8']) >Thread-185::INFO::2013-03-01 12:49:24,394::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '32'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_e93c57bc1d924765a4736184c94e1855', 'GUID': '3514f0c542a000489', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '10737418240', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '34'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_1db7bd256dad40a29a13b648a567a21e', 'GUID': '3514f0c542a00049f', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '33'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_6e8ae99a8f2b4d1497ea5630efde57d3', 'GUID': '3514f0c542a00048a', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '36'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_da2a5cb8c5eb4fae8edae67fab81212d', 'GUID': '3514f0c542a0004b9', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '31'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_45df0a9322f74dec8cd80e22256ece84', 'GUID': '3514f0c542a000488', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '35'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ', 'serial': 'SXtremIO_XtremApp_4a0496c174d34047b11cbebd359e60ba', 'GUID': '3514f0c542a0004b8', 'productID': 'XtremApp'}]} >Thread-185::DEBUG::2013-03-01 12:49:24,394::task::1151::TaskManager.Task::(prepare) Task=`4018361f-eb66-4fdd-ad2b-bb60f9fc9290`::finished: {'devList': [{'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_e93c57bc1d924765a4736184c94e1855', 'GUID': '3514f0c542a000489', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdb', 'state': 'active', 'type': 'iSCSI', 'lun': '32'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_1db7bd256dad40a29a13b648a567a21e', 'GUID': '3514f0c542a00049f', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '10737418240', 'pathstatus': [{'physdev': 'sdd', 'state': 'active', 'type': 'iSCSI', 'lun': '34'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_6e8ae99a8f2b4d1497ea5630efde57d3', 'GUID': '3514f0c542a00048a', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdc', 'state': 'active', 'type': 'iSCSI', 'lun': '33'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_da2a5cb8c5eb4fae8edae67fab81212d', 'GUID': '3514f0c542a0004b9', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '36'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_45df0a9322f74dec8cd80e22256ece84', 'GUID': '3514f0c542a000488', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdg', 'state': 'active', 'type': 'iSCSI', 'lun': '31'}], 'pvUUID': ''}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_4a0496c174d34047b11cbebd359e60ba', 'GUID': '3514f0c542a0004b8', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '35'}], 'pvUUID': 'bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ'}]} >Thread-185::DEBUG::2013-03-01 12:49:24,394::task::568::TaskManager.Task::(_updateState) Task=`4018361f-eb66-4fdd-ad2b-bb60f9fc9290`::moving from state preparing -> state finished >Thread-185::DEBUG::2013-03-01 12:49:24,395::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-185::DEBUG::2013-03-01 12:49:24,395::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-185::DEBUG::2013-03-01 12:49:24,395::task::957::TaskManager.Task::(_decref) Task=`4018361f-eb66-4fdd-ad2b-bb60f9fc9290`::ref 0 aborting False >Thread-192::DEBUG::2013-03-01 12:49:24,521::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-192::DEBUG::2013-03-01 12:49:24,522::task::568::TaskManager.Task::(_updateState) Task=`6815c91a-d293-44aa-92bb-17e4e3361388`::moving from state init -> state preparing >Thread-192::INFO::2013-03-01 12:49:24,522::logUtils::37::dispatcher::(wrapper) Run and protect: createVG(vgname='4b95f32d-26ca-467b-96e6-692c57bcface', devlist=['3514f0c542a0004b9'], force=False, options=None) >Thread-192::DEBUG::2013-03-01 12:49:24,525::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a0004b9' (cwd None) >Thread-192::DEBUG::2013-03-01 12:49:24,706::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-192::DEBUG::2013-03-01 12:49:24,707::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:24,707::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:24,708::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/3514f0c542a0004b9' (cwd None) >Thread-192::DEBUG::2013-03-01 12:49:24,975::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-192::DEBUG::2013-03-01 12:49:24,976::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 4b95f32d-26ca-467b-96e6-692c57bcface /dev/mapper/3514f0c542a0004b9' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:25,358::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-192::DEBUG::2013-03-01 12:49:25,449::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-192::DEBUG::2013-03-01 12:49:25,451::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:25,453::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:25,454::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:25,456::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:25,457::lvm::880::Storage.LVM::(createVG) Cache after createvg {'4b95f32d-26ca-467b-96e6-692c57bcface': Stub(name='4b95f32d-26ca-467b-96e6-692c57bcface', stale=True)} >Thread-192::DEBUG::2013-03-01 12:49:25,458::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-192::DEBUG::2013-03-01 12:49:25,463::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:25,488::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345176 s, 29.7 MB/s\n'; <rc> = 0 >Thread-192::DEBUG::2013-03-01 12:49:25,687::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-192::DEBUG::2013-03-01 12:49:25,689::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-192::INFO::2013-03-01 12:49:25,689::logUtils::39::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2'} >Thread-192::DEBUG::2013-03-01 12:49:25,690::task::1151::TaskManager.Task::(prepare) Task=`6815c91a-d293-44aa-92bb-17e4e3361388`::finished: {'uuid': 'QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2'} >Thread-192::DEBUG::2013-03-01 12:49:25,690::task::568::TaskManager.Task::(_updateState) Task=`6815c91a-d293-44aa-92bb-17e4e3361388`::moving from state preparing -> state finished >Thread-192::DEBUG::2013-03-01 12:49:25,690::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-192::DEBUG::2013-03-01 12:49:25,690::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2013-03-01 12:49:25,691::task::957::TaskManager.Task::(_decref) Task=`6815c91a-d293-44aa-92bb-17e4e3361388`::ref 0 aborting False >Thread-194::DEBUG::2013-03-01 12:49:25,721::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-194::DEBUG::2013-03-01 12:49:25,722::task::568::TaskManager.Task::(_updateState) Task=`8f7bca9f-933f-4d0a-ba55-3a348b8b1573`::moving from state init -> state preparing >Thread-194::INFO::2013-03-01 12:49:25,722::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', domainName='data_sd2', typeSpecificArg='QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', domClass=1, domVersion='3', options=None) >Thread-194::INFO::2013-03-01 12:49:25,767::blockSD::459::Storage.StorageDomain::(create) sdUUID=4b95f32d-26ca-467b-96e6-692c57bcface domainName=data_sd2 domClass=1 vgUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2 storageType=3 version=3 >Thread-194::DEBUG::2013-03-01 12:49:25,767::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:25,768::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:25,979::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:25,983::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:25,983::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:25,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:26,226::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:26,227::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:26,227::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:26,228::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3514f0c542a0004b9' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:26,461::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:26,462::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-194::INFO::2013-03-01 12:49:26,462::blockSD::444::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-194::DEBUG::2013-03-01 12:49:26,463::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:27,501::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:27,602::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436316 s, 23.5 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:27,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:27,892::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:27,892::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:27,892::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:27,892::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:27,893::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:27,893::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:28,134::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:28,136::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-194::INFO::2013-03-01 12:49:28,136::blockSD::630::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/3514f0c542a0004b9'] >Thread-194::DEBUG::2013-03-01 12:49:28,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:29,021::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:29,030::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287613 s, 14.2 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:29,561::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:29,562::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:29,562::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:29,562::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:29,563::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:29,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/4b95f32d-26ca-467b-96e6-692c57bcface/leases' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:29,580::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:29,581::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:29,619::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:29,696::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334747 s, 30.6 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:31,002::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:31,003::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:31,003::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:31,004::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:31,004::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:31,005::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/4b95f32d-26ca-467b-96e6-692c57bcface/ids' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:31,020::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:31,021::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:31,709::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:31,800::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385191 s, 26.6 MB/s\n'; <rc> = 0 >Thread-220::DEBUG::2013-03-01 12:49:31,961::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-220::DEBUG::2013-03-01 12:49:31,962::task::568::TaskManager.Task::(_updateState) Task=`9e48b6a7-e803-4ed4-892a-45218d1387d2`::moving from state init -> state preparing >Thread-220::INFO::2013-03-01 12:49:31,963::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-220::INFO::2013-03-01 12:49:31,963::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-220::DEBUG::2013-03-01 12:49:31,963::task::1151::TaskManager.Task::(prepare) Task=`9e48b6a7-e803-4ed4-892a-45218d1387d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-220::DEBUG::2013-03-01 12:49:31,964::task::568::TaskManager.Task::(_updateState) Task=`9e48b6a7-e803-4ed4-892a-45218d1387d2`::moving from state preparing -> state finished >Thread-220::DEBUG::2013-03-01 12:49:31,964::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-220::DEBUG::2013-03-01 12:49:31,964::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-220::DEBUG::2013-03-01 12:49:31,965::task::957::TaskManager.Task::(_decref) Task=`9e48b6a7-e803-4ed4-892a-45218d1387d2`::ref 0 aborting False >Thread-221::DEBUG::2013-03-01 12:49:31,997::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-221::DEBUG::2013-03-01 12:49:31,997::task::568::TaskManager.Task::(_updateState) Task=`b2dd42e1-f24d-4da4-9e35-b8dfef3f40b5`::moving from state init -> state preparing >Thread-221::INFO::2013-03-01 12:49:31,997::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-221::DEBUG::2013-03-01 12:49:31,998::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`8c945ee5-16fb-4f29-8755-78459dc42a30`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-221::DEBUG::2013-03-01 12:49:31,998::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-221::DEBUG::2013-03-01 12:49:31,998::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-221::DEBUG::2013-03-01 12:49:31,999::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`8c945ee5-16fb-4f29-8755-78459dc42a30`::Granted request >Thread-221::DEBUG::2013-03-01 12:49:31,999::task::794::TaskManager.Task::(resourceAcquired) Task=`b2dd42e1-f24d-4da4-9e35-b8dfef3f40b5`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-221::DEBUG::2013-03-01 12:49:31,999::task::957::TaskManager.Task::(_decref) Task=`b2dd42e1-f24d-4da4-9e35-b8dfef3f40b5`::ref 1 aborting False >Thread-221::INFO::2013-03-01 12:49:32,000::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-221::DEBUG::2013-03-01 12:49:32,001::task::1151::TaskManager.Task::(prepare) Task=`b2dd42e1-f24d-4da4-9e35-b8dfef3f40b5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-221::DEBUG::2013-03-01 12:49:32,001::task::568::TaskManager.Task::(_updateState) Task=`b2dd42e1-f24d-4da4-9e35-b8dfef3f40b5`::moving from state preparing -> state finished >Thread-221::DEBUG::2013-03-01 12:49:32,001::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-221::DEBUG::2013-03-01 12:49:32,001::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221::DEBUG::2013-03-01 12:49:32,002::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-221::DEBUG::2013-03-01 12:49:32,002::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-221::DEBUG::2013-03-01 12:49:32,002::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-221::DEBUG::2013-03-01 12:49:32,002::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-221::DEBUG::2013-03-01 12:49:32,002::task::957::TaskManager.Task::(_decref) Task=`b2dd42e1-f24d-4da4-9e35-b8dfef3f40b5`::ref 0 aborting False >Thread-194::DEBUG::2013-03-01 12:49:32,423::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:32,423::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:32,424::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:32,424::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:32,424::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:32,426::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:33,815::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:33,896::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:33,898::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:33,900::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:33,902::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:33,903::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:33,907::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:33,930::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400539 s, 25.6 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:35,446::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:35,473::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:35,474::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:35,474::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:35,474::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:35,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/4b95f32d-26ca-467b-96e6-692c57bcface/master' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:35,491::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:35,492::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/4b95f32d-26ca-467b-96e6-692c57bcface/master' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:35,652::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:35,653::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 4b95f32d-26ca-467b-96e6-692c57bcface/master' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:35,847::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:35,847::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:35,847::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:35,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:35,945::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:36,008::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.14919 s, 281 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:36,009::misc::344::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.14919 s, 281 MB/s'], size: 41943040 >Thread-194::DEBUG::2013-03-01 12:49:36,010::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:36,025::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00348374 s, 294 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:36,027::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00348374 s, 294 MB/s'], size: 1024000 >Thread-194::DEBUG::2013-03-01 12:49:36,029::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:36,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00339617 s, 302 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:36,044::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00339617 s, 302 MB/s'], size: 1024000 >Thread-194::DEBUG::2013-03-01 12:49:36,045::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-194::DEBUG::2013-03-01 12:49:36,047::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,049::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,050::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,052::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,054::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:36,074::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332343 s, 30.8 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:36,546::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:36,548::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,548::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-194::WARNING::2013-03-01 12:49:36,549::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-194::DEBUG::2013-03-01 12:49:36,549::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-194::DEBUG::2013-03-01 12:49:36,549::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-194::DEBUG::2013-03-01 12:49:36,550::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', '_SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc'] >Thread-194::DEBUG::2013-03-01 12:49:36,550::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,550::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,551::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,551::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,551::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:36,769::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:36,771::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:36,771::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_ROLE=Regular, MDT_POOL_UUID=, MDT_SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface, MDT_LEASERETRIES=3, MDT_CLASS=Data, MDT_LOCKRENEWALINTERVALSEC=5, MDT_LOGBLKSIZE=512, MDT_IOOPTIMEOUTSEC=1, MDT_PV0=pv:3514f0c542a0004b9&44&uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG&44&pestart:0&44&pecount:397&44&mapoffset:0, MDT_VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2, MDT_VERSION=3, MDT_LEASETIMESEC=5, MDT__SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc, MDT_LOCKPOLICY=, MDT_TYPE=ISCSI, MDT_PHYBLKSIZE=4096, MDT_DESCRIPTION=data_sd2 removing= >Thread-194::DEBUG::2013-03-01 12:49:36,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_PV0=pv:3514f0c542a0004b9&44&uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG&44&pestart:0&44&pecount:397&44&mapoffset:0 --addtag MDT_PHYBLKSIZE=4096 --addtag MDT_ROLE=Regular --addtag MDT_SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface --addtag MDT_VERSION=3 --addtag MDT_TYPE=ISCSI --addtag MDT_VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2 --addtag MDT_LOGBLKSIZE=512 --addtag MDT_DESCRIPTION=data_sd2 --addtag MDT_LEASERETRIES=3 --addtag MDT_LEASETIMESEC=5 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_IOOPTIMEOUTSEC=1 --addtag MDT_POOL_UUID= --addtag MDT__SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc --addtag MDT_CLASS=Data --addtag MDT_LOCKPOLICY= 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-223::DEBUG::2013-03-01 12:49:37,138::task::568::TaskManager.Task::(_updateState) Task=`9e7684f7-154b-4ff5-8564-49d4b851ffc4`::moving from state init -> state preparing >Thread-223::INFO::2013-03-01 12:49:37,139::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-223::INFO::2013-03-01 12:49:37,139::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00970888137817', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-223::DEBUG::2013-03-01 12:49:37,139::task::1151::TaskManager.Task::(prepare) Task=`9e7684f7-154b-4ff5-8564-49d4b851ffc4`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00970888137817', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-223::DEBUG::2013-03-01 12:49:37,139::task::568::TaskManager.Task::(_updateState) Task=`9e7684f7-154b-4ff5-8564-49d4b851ffc4`::moving from state preparing -> state finished >Thread-223::DEBUG::2013-03-01 12:49:37,140::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-223::DEBUG::2013-03-01 12:49:37,140::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-223::DEBUG::2013-03-01 12:49:37,140::task::957::TaskManager.Task::(_decref) Task=`9e7684f7-154b-4ff5-8564-49d4b851ffc4`::ref 0 aborting False >Thread-194::DEBUG::2013-03-01 12:49:37,176::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:37,177::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,177::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,177::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-194::DEBUG::2013-03-01 12:49:37,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:37,494::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:37,495::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,495::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,495::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-194::DEBUG::2013-03-01 12:49:37,496::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:37,505::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000340571 s, 6.0 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:37,506::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000340571 s, 6.0 MB/s'], size: 2048 >Thread-194::DEBUG::2013-03-01 12:49:37,506::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-194::WARNING::2013-03-01 12:49:37,506::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-194::DEBUG::2013-03-01 12:49:37,507::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-194::DEBUG::2013-03-01 12:49:37,507::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,508::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,508::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,508::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,509::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-194::DEBUG::2013-03-01 12:49:37,700::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:37,702::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:37,702::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', '_SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc', 'CLASS=Data', 'LOCKPOLICY='] >Thread-194::DEBUG::2013-03-01 12:49:37,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 4b95f32d-26ca-467b-96e6-692c57bcface/master' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:38,088::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:38,166::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302666 s, 33.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:49:39,035::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:39,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000290648 s, 14.1 MB/s\n'; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:39,182::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2013-03-01 12:49:39,183::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:39,183::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-194::DEBUG::2013-03-01 12:49:39,184::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '4b95f32d-26ca-467b-96e6-692c57bcface_imageNS' >Thread-194::DEBUG::2013-03-01 12:49:39,185::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS' >Thread-194::DEBUG::2013-03-01 12:49:39,185::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS' >Thread-194::DEBUG::2013-03-01 12:49:39,185::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-194::DEBUG::2013-03-01 12:49:39,196::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-194::INFO::2013-03-01 12:49:39,196::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-194::DEBUG::2013-03-01 12:49:39,197::task::1151::TaskManager.Task::(prepare) Task=`8f7bca9f-933f-4d0a-ba55-3a348b8b1573`::finished: None >Thread-194::DEBUG::2013-03-01 12:49:39,197::task::568::TaskManager.Task::(_updateState) Task=`8f7bca9f-933f-4d0a-ba55-3a348b8b1573`::moving from state preparing -> state finished >Thread-194::DEBUG::2013-03-01 12:49:39,197::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-194::DEBUG::2013-03-01 12:49:39,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-194::DEBUG::2013-03-01 12:49:39,198::task::957::TaskManager.Task::(_decref) Task=`8f7bca9f-933f-4d0a-ba55-3a348b8b1573`::ref 0 aborting False >Thread-225::DEBUG::2013-03-01 12:49:39,230::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-225::DEBUG::2013-03-01 12:49:39,230::task::568::TaskManager.Task::(_updateState) Task=`0a2049c7-3ded-4166-8c82-47cb83e4ed6c`::moving from state init -> state preparing >Thread-225::INFO::2013-03-01 12:49:39,231::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', options=None) >Thread-225::DEBUG::2013-03-01 12:49:39,231::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`73976a16-51cc-4ffd-8870-fa2a08193f61`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-225::DEBUG::2013-03-01 12:49:39,232::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' for lock type 'shared' >Thread-225::DEBUG::2013-03-01 12:49:39,232::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free. Now locking as 'shared' (1 active user) >Thread-225::DEBUG::2013-03-01 12:49:39,232::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`73976a16-51cc-4ffd-8870-fa2a08193f61`::Granted request >Thread-225::DEBUG::2013-03-01 12:49:39,233::task::794::TaskManager.Task::(resourceAcquired) Task=`0a2049c7-3ded-4166-8c82-47cb83e4ed6c`::_resourcesAcquired: Storage.4b95f32d-26ca-467b-96e6-692c57bcface (shared) >Thread-225::DEBUG::2013-03-01 12:49:39,233::task::957::TaskManager.Task::(_decref) Task=`0a2049c7-3ded-4166-8c82-47cb83e4ed6c`::ref 1 aborting False >Thread-225::DEBUG::2013-03-01 12:49:39,235::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-225::DEBUG::2013-03-01 12:49:39,236::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-225::DEBUG::2013-03-01 12:49:39,236::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-225::DEBUG::2013-03-01 12:49:39,236::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-225::DEBUG::2013-03-01 12:49:39,237::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-225::DEBUG::2013-03-01 12:49:39,237::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-225::DEBUG::2013-03-01 12:49:39,246::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000276953 s, 7.4 MB/s\n'; <rc> = 0 >Thread-225::DEBUG::2013-03-01 12:49:39,246::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000276953 s, 7.4 MB/s'], size: 2048 >Thread-225::DEBUG::2013-03-01 12:49:39,246::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-225::WARNING::2013-03-01 12:49:39,246::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-225::DEBUG::2013-03-01 12:49:39,247::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-225::DEBUG::2013-03-01 12:49:39,247::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-225::DEBUG::2013-03-01 12:49:39,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-225::DEBUG::2013-03-01 12:49:39,490::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-225::DEBUG::2013-03-01 12:49:39,492::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-225::INFO::2013-03-01 12:49:39,492::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-225::DEBUG::2013-03-01 12:49:39,492::task::1151::TaskManager.Task::(prepare) Task=`0a2049c7-3ded-4166-8c82-47cb83e4ed6c`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-225::DEBUG::2013-03-01 12:49:39,493::task::568::TaskManager.Task::(_updateState) Task=`0a2049c7-3ded-4166-8c82-47cb83e4ed6c`::moving from state preparing -> state finished >Thread-225::DEBUG::2013-03-01 12:49:39,493::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4b95f32d-26ca-467b-96e6-692c57bcface': < ResourceRef 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', isValid: 'True' obj: 'None'>} >Thread-225::DEBUG::2013-03-01 12:49:39,493::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-225::DEBUG::2013-03-01 12:49:39,494::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' >Thread-225::DEBUG::2013-03-01 12:49:39,494::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' (0 active users) >Thread-225::DEBUG::2013-03-01 12:49:39,495::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free, finding out if anyone is waiting for it. >Thread-225::DEBUG::2013-03-01 12:49:39,495::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', Clearing records. >Thread-225::DEBUG::2013-03-01 12:49:39,495::task::957::TaskManager.Task::(_decref) Task=`0a2049c7-3ded-4166-8c82-47cb83e4ed6c`::ref 0 aborting False >Thread-226::DEBUG::2013-03-01 12:49:39,534::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-226::DEBUG::2013-03-01 12:49:39,534::task::568::TaskManager.Task::(_updateState) Task=`373aa8fe-1d3c-4c4e-922e-d02c298006c9`::moving from state init -> state preparing >Thread-226::INFO::2013-03-01 12:49:39,535::logUtils::37::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', options=None) >MainProcess|Thread-226::DEBUG::2013-03-01 12:49:39,536::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-226::DEBUG::2013-03-01 12:49:39,541::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-226::DEBUG::2013-03-01 12:49:39,544::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3' (cwd None) >MainProcess|Thread-226::DEBUG::2013-03-01 12:49:39,548::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-226::INFO::2013-03-01 12:49:39,552::logUtils::39::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '4b95f32d-26ca-467b-96e6-692c57bcface', 'vgfree': '49123688448', 'vgUUID': 'QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '36'}], 'devtype': 'iSCSI', 'pvUUID': 'jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG', 'serial': 'SXtremIO_XtremApp_da2a5cb8c5eb4fae8edae67fab81212d', 'GUID': '3514f0c542a0004b9', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-226::DEBUG::2013-03-01 12:49:39,552::task::1151::TaskManager.Task::(prepare) Task=`373aa8fe-1d3c-4c4e-922e-d02c298006c9`::finished: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '4b95f32d-26ca-467b-96e6-692c57bcface', 'vgfree': '49123688448', 'vgUUID': 'QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '36'}], 'devtype': 'iSCSI', 'pvUUID': 'jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG', 'serial': 'SXtremIO_XtremApp_da2a5cb8c5eb4fae8edae67fab81212d', 'GUID': '3514f0c542a0004b9', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-226::DEBUG::2013-03-01 12:49:39,552::task::568::TaskManager.Task::(_updateState) Task=`373aa8fe-1d3c-4c4e-922e-d02c298006c9`::moving from state preparing -> state finished >Thread-226::DEBUG::2013-03-01 12:49:39,553::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-226::DEBUG::2013-03-01 12:49:39,553::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2013-03-01 12:49:39,553::task::957::TaskManager.Task::(_decref) Task=`373aa8fe-1d3c-4c4e-922e-d02c298006c9`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:49:40,180::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:40,275::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362878 s, 28.2 MB/s\n'; <rc> = 0 >Thread-228::DEBUG::2013-03-01 12:49:40,534::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-228::DEBUG::2013-03-01 12:49:40,535::task::568::TaskManager.Task::(_updateState) Task=`d63121e7-3805-42be-a89c-c26e0d9957db`::moving from state init -> state preparing >Thread-228::INFO::2013-03-01 12:49:40,536::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-228::DEBUG::2013-03-01 12:49:40,536::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-228::DEBUG::2013-03-01 12:49:40,562::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-228::DEBUG::2013-03-01 12:49:40,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-228::DEBUG::2013-03-01 12:49:40,583::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-228::DEBUG::2013-03-01 12:49:40,584::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-228::DEBUG::2013-03-01 12:49:40,601::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-228::INFO::2013-03-01 12:49:40,602::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-228::DEBUG::2013-03-01 12:49:40,602::task::1151::TaskManager.Task::(prepare) Task=`d63121e7-3805-42be-a89c-c26e0d9957db`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-228::DEBUG::2013-03-01 12:49:40,602::task::568::TaskManager.Task::(_updateState) Task=`d63121e7-3805-42be-a89c-c26e0d9957db`::moving from state preparing -> state finished >Thread-228::DEBUG::2013-03-01 12:49:40,602::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-228::DEBUG::2013-03-01 12:49:40,603::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-228::DEBUG::2013-03-01 12:49:40,603::task::957::TaskManager.Task::(_decref) Task=`d63121e7-3805-42be-a89c-c26e0d9957db`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 12:49:40,634::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-229::DEBUG::2013-03-01 12:49:40,634::task::568::TaskManager.Task::(_updateState) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::moving from state init -> state preparing >Thread-229::INFO::2013-03-01 12:49:40,635::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-229::DEBUG::2013-03-01 12:49:40,635::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`c8b5319f-4ff1-4235-aef8-d26fcdcb22c4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-229::DEBUG::2013-03-01 12:49:40,636::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-229::DEBUG::2013-03-01 12:49:40,636::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-229::DEBUG::2013-03-01 12:49:40,636::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`c8b5319f-4ff1-4235-aef8-d26fcdcb22c4`::Granted request >Thread-229::DEBUG::2013-03-01 12:49:40,637::task::794::TaskManager.Task::(resourceAcquired) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-229::DEBUG::2013-03-01 12:49:40,637::task::957::TaskManager.Task::(_decref) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::ref 1 aborting False >Thread-229::DEBUG::2013-03-01 12:49:40,638::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`37f3b2ed-b26e-44d2-a768-0bfb2f5e231c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-229::DEBUG::2013-03-01 12:49:40,638::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' for lock type 'exclusive' >Thread-229::DEBUG::2013-03-01 12:49:40,638::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free. Now locking as 'exclusive' (1 active user) >Thread-229::DEBUG::2013-03-01 12:49:40,639::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`37f3b2ed-b26e-44d2-a768-0bfb2f5e231c`::Granted request >Thread-229::DEBUG::2013-03-01 12:49:40,639::task::794::TaskManager.Task::(resourceAcquired) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::_resourcesAcquired: Storage.4b95f32d-26ca-467b-96e6-692c57bcface (exclusive) >Thread-229::DEBUG::2013-03-01 12:49:40,639::task::957::TaskManager.Task::(_decref) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::ref 1 aborting False >Thread-229::INFO::2013-03-01 12:49:40,639::sp::918::Storage.StoragePool::(attachSD) sdUUID=4b95f32d-26ca-467b-96e6-692c57bcface spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-229::INFO::2013-03-01 12:49:40,640::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface (id: 1) >Dummy-173::DEBUG::2013-03-01 12:49:42,290::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:42,391::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388939 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:44,411::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:44,506::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315353 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:46,526::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:46,635::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451263 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:48,654::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:48,748::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040156 s, 25.5 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:49:49,050::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:49,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000261244 s, 15.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:50,768::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:50,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313441 s, 32.7 MB/s\n'; <rc> = 0 >Thread-233::DEBUG::2013-03-01 12:49:52,395::task::568::TaskManager.Task::(_updateState) Task=`f58999e1-a9de-49f4-b9a2-ee34642bf02b`::moving from state init -> state preparing >Thread-233::INFO::2013-03-01 12:49:52,396::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-233::INFO::2013-03-01 12:49:52,396::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00887203216553', 'lastCheck': '3.3', 'code': 0, 'valid': True}} >Thread-233::DEBUG::2013-03-01 12:49:52,396::task::1151::TaskManager.Task::(prepare) Task=`f58999e1-a9de-49f4-b9a2-ee34642bf02b`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00887203216553', 'lastCheck': '3.3', 'code': 0, 'valid': True}} >Thread-233::DEBUG::2013-03-01 12:49:52,396::task::568::TaskManager.Task::(_updateState) Task=`f58999e1-a9de-49f4-b9a2-ee34642bf02b`::moving from state preparing -> state finished >Thread-233::DEBUG::2013-03-01 12:49:52,396::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-233::DEBUG::2013-03-01 12:49:52,397::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-233::DEBUG::2013-03-01 12:49:52,397::task::957::TaskManager.Task::(_decref) Task=`f58999e1-a9de-49f4-b9a2-ee34642bf02b`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:49:52,869::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:52,973::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429005 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:54,992::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:55,083::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029131 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:57,101::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:57,176::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306004 s, 33.5 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:49:59,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:49:59,071::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000328695 s, 12.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:49:59,190::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:49:59,269::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341284 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:50:01,282::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:01,375::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350323 s, 29.2 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:01,643::clusterlock::191::SANLock::(acquireHostId) Host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface successfully acquired (id: 1) >Thread-229::WARNING::2013-03-01 12:50:01,649::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/images already exists >Thread-229::WARNING::2013-03-01 12:50:01,650::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/dom_md already exists >Thread-229::DEBUG::2013-03-01 12:50:01,651::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,651::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,651::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,652::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,652::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-229::DEBUG::2013-03-01 12:50:01,653::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 12:50:01,660::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00025335 s, 8.1 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:01,661::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00025335 s, 8.1 MB/s'], size: 2048 >Thread-229::DEBUG::2013-03-01 12:50:01,661::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-229::WARNING::2013-03-01 12:50:01,661::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-229::DEBUG::2013-03-01 12:50:01,661::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-229::DEBUG::2013-03-01 12:50:01,662::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,662::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,663::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,663::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,663::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:01,664::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-229::DEBUG::2013-03-01 12:50:01,880::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:02,281::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,281::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', '_SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc', 'CLASS=Data', 'LOCKPOLICY='] >Thread-229::INFO::2013-03-01 12:50:02,282::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 4b95f32d-26ca-467b-96e6-692c57bcface (id: 1) >Thread-229::DEBUG::2013-03-01 12:50:02,293::clusterlock::248::SANLock::(acquire) Cluster lock for domain 4b95f32d-26ca-467b-96e6-692c57bcface successfully acquired (id: 1) >Thread-229::DEBUG::2013-03-01 12:50:02,294::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,294::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,294::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,295::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,295::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,295::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-229::DEBUG::2013-03-01 12:50:02,506::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:02,507::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,507::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', '_SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc', 'CLASS=Data', 'LOCKPOLICY='] >Thread-229::DEBUG::2013-03-01 12:50:02,508::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-229::DEBUG::2013-03-01 12:50:02,508::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-229::DEBUG::2013-03-01 12:50:02,508::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', '_SHA_CKSUM=6c6038d295b4ec90d4d93e7c11fd93cc486e72d7'] >Thread-229::DEBUG::2013-03-01 12:50:02,509::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,509::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,509::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,509::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,510::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:02,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:03,394::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 12:50:09,076::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:50:23,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000206722 s, 19.8 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:23,095::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:23,099::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:23,101::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=6c6038d295b4ec90d4d93e7c11fd93cc486e72d7, MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be removing=MDT__SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc, MDT_POOL_UUID= >Thread-229::DEBUG::2013-03-01 12:50:23,111::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_UUID= --deltag MDT__SHA_CKSUM=a283ab0d97b58be2b8b484111181ab7b870c08dc --addtag MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be --addtag MDT__SHA_CKSUM=6c6038d295b4ec90d4d93e7c11fd93cc486e72d7 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:23,143::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.05672 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:50:25,277::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-239::DEBUG::2013-03-01 12:50:26,069::task::568::TaskManager.Task::(_updateState) Task=`0bb58b55-cb45-459c-812a-252a841dcc72`::moving from state init -> state preparing >Thread-105::DEBUG::2013-03-01 12:50:33,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-239::INFO::2013-03-01 12:50:38,136::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-239::INFO::2013-03-01 12:50:38,147::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '13.9679858685', 'lastCheck': '15.1', 'code': 0, 'valid': True}} >Thread-239::DEBUG::2013-03-01 12:50:38,148::task::1151::TaskManager.Task::(prepare) Task=`0bb58b55-cb45-459c-812a-252a841dcc72`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '13.9679858685', 'lastCheck': '15.1', 'code': 0, 'valid': True}} >Thread-239::DEBUG::2013-03-01 12:50:38,151::task::568::TaskManager.Task::(_updateState) Task=`0bb58b55-cb45-459c-812a-252a841dcc72`::moving from state preparing -> state finished >Thread-239::DEBUG::2013-03-01 12:50:38,154::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-239::DEBUG::2013-03-01 12:50:38,156::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2013-03-01 12:50:38,158::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000262984 s, 15.6 MB/s\n'; <rc> = 0 >Thread-239::DEBUG::2013-03-01 12:50:38,158::task::957::TaskManager.Task::(_decref) Task=`0bb58b55-cb45-459c-812a-252a841dcc72`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:50:38,248::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0663826 s, 15.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:50:40,262::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-229::DEBUG::2013-03-01 12:50:44,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:44,823::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,826::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,828::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-229::DEBUG::2013-03-01 12:50:44,830::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-229::DEBUG::2013-03-01 12:50:44,833::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-229::DEBUG::2013-03-01 12:50:44,834::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972'] >Thread-229::DEBUG::2013-03-01 12:50:44,836::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,838::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,839::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,842::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,844::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:44,847::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:44,875::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03907 s, 26.2 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:45,523::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:45,525::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:45,525::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 removing=MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9 >Thread-229::DEBUG::2013-03-01 12:50:45,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9 --deltag MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active --addtag MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 --addtag MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-229::DEBUG::2013-03-01 12:50:46,565::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:46,565::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,572::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,572::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-229::WARNING::2013-03-01 12:50:46,573::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/images already exists >Thread-229::WARNING::2013-03-01 12:50:46,574::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/dom_md already exists >Thread-229::INFO::2013-03-01 12:50:46,575::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/4b95f32d-26ca-467b-96e6-692c57bcface >Thread-229::DEBUG::2013-03-01 12:50:46,575::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-229::DEBUG::2013-03-01 12:50:46,576::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-229::DEBUG::2013-03-01 12:50:46,576::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-229::DEBUG::2013-03-01 12:50:46,576::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-229::DEBUG::2013-03-01 12:50:46,577::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=0', 'PHYBLKSIZE=4096', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-229::DEBUG::2013-03-01 12:50:46,577::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,577::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,578::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,578::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,579::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-229::DEBUG::2013-03-01 12:50:46,822::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:46,823::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:46,824::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c, MDT_MASTER_VERSION=0 removing=MDT__SHA_CKSUM=6c6038d295b4ec90d4d93e7c11fd93cc486e72d7 >Thread-229::DEBUG::2013-03-01 12:50:46,824::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=6c6038d295b4ec90d4d93e7c11fd93cc486e72d7 --addtag MDT_MASTER_VERSION=0 --addtag MDT__SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:46,888::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:46,972::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037713 s, 27.2 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:47,142::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:47,142::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:47,143::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 12:50:47,143::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-229::INFO::2013-03-01 12:50:47,144::clusterlock::252::SANLock::(release) Releasing cluster lock for domain 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-229::DEBUG::2013-03-01 12:50:47,145::clusterlock::263::SANLock::(release) Cluster lock for domain 4b95f32d-26ca-467b-96e6-692c57bcface successfully released >Thread-229::INFO::2013-03-01 12:50:47,146::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface (id: 1) >Thread-105::DEBUG::2013-03-01 12:50:48,178::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:50:48,179::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:50:48,375::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:50:48,377::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:50:48,377::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:50:48,386::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026629 s, 15.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:50:48,986::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:49,075::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429487 s, 23.8 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 12:50:50,147::clusterlock::206::SANLock::(releaseHostId) Host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface released successfully (id: 1) >Thread-229::DEBUG::2013-03-01 12:50:50,148::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-229::DEBUG::2013-03-01 12:50:50,148::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-229::DEBUG::2013-03-01 12:50:50,149::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-229::INFO::2013-03-01 12:50:50,149::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-229::DEBUG::2013-03-01 12:50:50,150::task::1151::TaskManager.Task::(prepare) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::finished: None >Thread-229::DEBUG::2013-03-01 12:50:50,150::task::568::TaskManager.Task::(_updateState) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::moving from state preparing -> state finished >Thread-229::DEBUG::2013-03-01 12:50:50,151::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4b95f32d-26ca-467b-96e6-692c57bcface': < ResourceRef 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-229::DEBUG::2013-03-01 12:50:50,151::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2013-03-01 12:50:50,152::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' >Thread-229::DEBUG::2013-03-01 12:50:50,152::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' (0 active users) >Thread-229::DEBUG::2013-03-01 12:50:50,152::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free, finding out if anyone is waiting for it. >Thread-229::DEBUG::2013-03-01 12:50:50,153::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', Clearing records. >Thread-229::DEBUG::2013-03-01 12:50:50,153::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-229::DEBUG::2013-03-01 12:50:50,154::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-229::DEBUG::2013-03-01 12:50:50,154::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-229::DEBUG::2013-03-01 12:50:50,154::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-229::DEBUG::2013-03-01 12:50:50,155::task::957::TaskManager.Task::(_decref) Task=`7adc9adb-5eec-47d2-86ac-2ace32c4cf11`::ref 0 aborting False >Thread-243::DEBUG::2013-03-01 12:50:50,193::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-243::DEBUG::2013-03-01 12:50:50,193::task::568::TaskManager.Task::(_updateState) Task=`908f1b8b-499d-4d57-bc5b-4c96bfcd68f9`::moving from state init -> state preparing >Thread-243::INFO::2013-03-01 12:50:50,194::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-243::INFO::2013-03-01 12:50:50,194::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-243::DEBUG::2013-03-01 12:50:50,194::task::1151::TaskManager.Task::(prepare) Task=`908f1b8b-499d-4d57-bc5b-4c96bfcd68f9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-243::DEBUG::2013-03-01 12:50:50,194::task::568::TaskManager.Task::(_updateState) Task=`908f1b8b-499d-4d57-bc5b-4c96bfcd68f9`::moving from state preparing -> state finished >Thread-243::DEBUG::2013-03-01 12:50:50,194::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-243::DEBUG::2013-03-01 12:50:50,195::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-243::DEBUG::2013-03-01 12:50:50,195::task::957::TaskManager.Task::(_decref) Task=`908f1b8b-499d-4d57-bc5b-4c96bfcd68f9`::ref 0 aborting False >Thread-244::DEBUG::2013-03-01 12:50:50,248::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-244::DEBUG::2013-03-01 12:50:50,248::task::568::TaskManager.Task::(_updateState) Task=`3ecafc6e-957f-430f-bdd1-907254aedb0a`::moving from state init -> state preparing >Thread-244::INFO::2013-03-01 12:50:50,248::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-244::DEBUG::2013-03-01 12:50:50,249::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`02b13142-f3c2-4806-bfaa-757d8099ac5a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-244::DEBUG::2013-03-01 12:50:50,249::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-244::DEBUG::2013-03-01 12:50:50,249::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-244::DEBUG::2013-03-01 12:50:50,249::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`02b13142-f3c2-4806-bfaa-757d8099ac5a`::Granted request >Thread-244::DEBUG::2013-03-01 12:50:50,250::task::794::TaskManager.Task::(resourceAcquired) Task=`3ecafc6e-957f-430f-bdd1-907254aedb0a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-244::DEBUG::2013-03-01 12:50:50,250::task::957::TaskManager.Task::(_decref) Task=`3ecafc6e-957f-430f-bdd1-907254aedb0a`::ref 1 aborting False >Thread-244::INFO::2013-03-01 12:50:50,251::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': '4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': 'Attached'}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-244::DEBUG::2013-03-01 12:50:50,251::task::1151::TaskManager.Task::(prepare) Task=`3ecafc6e-957f-430f-bdd1-907254aedb0a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': '4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': 'Attached'}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-244::DEBUG::2013-03-01 12:50:50,251::task::568::TaskManager.Task::(_updateState) Task=`3ecafc6e-957f-430f-bdd1-907254aedb0a`::moving from state preparing -> state finished >Thread-244::DEBUG::2013-03-01 12:50:50,251::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-244::DEBUG::2013-03-01 12:50:50,251::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-244::DEBUG::2013-03-01 12:50:50,252::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-244::DEBUG::2013-03-01 12:50:50,252::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-244::DEBUG::2013-03-01 12:50:50,252::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-244::DEBUG::2013-03-01 12:50:50,252::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-244::DEBUG::2013-03-01 12:50:50,252::task::957::TaskManager.Task::(_decref) Task=`3ecafc6e-957f-430f-bdd1-907254aedb0a`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:50:51,088::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:51,158::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255753 s, 40.0 MB/s\n'; <rc> = 0 >Thread-246::DEBUG::2013-03-01 12:50:51,369::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-246::DEBUG::2013-03-01 12:50:51,370::task::568::TaskManager.Task::(_updateState) Task=`07548351-3c3a-4fe6-8d41-ae661d4f8db5`::moving from state init -> state preparing >Thread-246::INFO::2013-03-01 12:50:51,370::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-246::DEBUG::2013-03-01 12:50:51,371::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-246::DEBUG::2013-03-01 12:50:51,390::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-246::DEBUG::2013-03-01 12:50:51,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-246::DEBUG::2013-03-01 12:50:51,407::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-246::DEBUG::2013-03-01 12:50:51,408::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-246::DEBUG::2013-03-01 12:50:51,423::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-246::INFO::2013-03-01 12:50:51,423::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-246::DEBUG::2013-03-01 12:50:51,424::task::1151::TaskManager.Task::(prepare) Task=`07548351-3c3a-4fe6-8d41-ae661d4f8db5`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-246::DEBUG::2013-03-01 12:50:51,424::task::568::TaskManager.Task::(_updateState) Task=`07548351-3c3a-4fe6-8d41-ae661d4f8db5`::moving from state preparing -> state finished >Thread-246::DEBUG::2013-03-01 12:50:51,424::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-246::DEBUG::2013-03-01 12:50:51,425::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-246::DEBUG::2013-03-01 12:50:51,425::task::957::TaskManager.Task::(_decref) Task=`07548351-3c3a-4fe6-8d41-ae661d4f8db5`::ref 0 aborting False >Thread-247::DEBUG::2013-03-01 12:50:51,453::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-247::DEBUG::2013-03-01 12:50:51,453::task::568::TaskManager.Task::(_updateState) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::moving from state init -> state preparing >Thread-247::INFO::2013-03-01 12:50:51,454::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-247::DEBUG::2013-03-01 12:50:51,454::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`338e9fe7-14c4-4817-8de0-2a6e3c0520a9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-247::DEBUG::2013-03-01 12:50:51,454::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-247::DEBUG::2013-03-01 12:50:51,455::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-247::DEBUG::2013-03-01 12:50:51,455::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`338e9fe7-14c4-4817-8de0-2a6e3c0520a9`::Granted request >Thread-247::DEBUG::2013-03-01 12:50:51,456::task::794::TaskManager.Task::(resourceAcquired) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-247::DEBUG::2013-03-01 12:50:51,456::task::957::TaskManager.Task::(_decref) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::ref 1 aborting False >Thread-247::DEBUG::2013-03-01 12:50:51,457::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`5e594d44-ee39-4f39-8aef-1d7bd1388a9c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-247::DEBUG::2013-03-01 12:50:51,457::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' for lock type 'exclusive' >Thread-247::DEBUG::2013-03-01 12:50:51,457::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free. Now locking as 'exclusive' (1 active user) >Thread-247::DEBUG::2013-03-01 12:50:51,458::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`5e594d44-ee39-4f39-8aef-1d7bd1388a9c`::Granted request >Thread-247::DEBUG::2013-03-01 12:50:51,458::task::794::TaskManager.Task::(resourceAcquired) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::_resourcesAcquired: Storage.4b95f32d-26ca-467b-96e6-692c57bcface (exclusive) >Thread-247::DEBUG::2013-03-01 12:50:51,459::task::957::TaskManager.Task::(_decref) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::ref 1 aborting False >Thread-247::INFO::2013-03-01 12:50:51,459::sp::1045::Storage.StoragePool::(activateSD) sdUUID=4b95f32d-26ca-467b-96e6-692c57bcface spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-247::DEBUG::2013-03-01 12:50:51,460::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-247::DEBUG::2013-03-01 12:50:51,460::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-247::DEBUG::2013-03-01 12:50:51,460::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-247::DEBUG::2013-03-01 12:50:51,461::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-247::DEBUG::2013-03-01 12:50:51,461::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-247::DEBUG::2013-03-01 12:50:51,485::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:50:51,485::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-247::DEBUG::2013-03-01 12:50:51,490::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-247::DEBUG::2013-03-01 12:50:52,494::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:50:53,171::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 12:50:58,392::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:51:15,448::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000311343 s, 13.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:51:15,558::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0805137 s, 12.7 MB/s\n'; <rc> = 0 >MainProcess|Thread-247::DEBUG::2013-03-01 12:51:16,425::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-247::DEBUG::2013-03-01 12:51:17,430::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-247::DEBUG::2013-03-01 12:51:17,434::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:17,572::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:17,657::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388947 s, 26.3 MB/s\n'; <rc> = 0 >MainProcess|Thread-247::DEBUG::2013-03-01 12:51:18,438::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-247::DEBUG::2013-03-01 12:51:18,441::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-247::DEBUG::2013-03-01 12:51:18,444::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-249::DEBUG::2013-03-01 12:51:18,475::task::568::TaskManager.Task::(_updateState) Task=`8482f086-d858-4652-b724-f62d7edb64f9`::moving from state init -> state preparing >Thread-249::INFO::2013-03-01 12:51:18,475::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-249::INFO::2013-03-01 12:51:18,475::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '17.0568521023', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-249::DEBUG::2013-03-01 12:51:18,476::task::1151::TaskManager.Task::(prepare) Task=`8482f086-d858-4652-b724-f62d7edb64f9`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '17.0568521023', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-249::DEBUG::2013-03-01 12:51:18,476::task::568::TaskManager.Task::(_updateState) Task=`8482f086-d858-4652-b724-f62d7edb64f9`::moving from state preparing -> state finished >Thread-249::DEBUG::2013-03-01 12:51:18,476::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-249::DEBUG::2013-03-01 12:51:18,477::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-249::DEBUG::2013-03-01 12:51:18,477::task::957::TaskManager.Task::(_decref) Task=`8482f086-d858-4652-b724-f62d7edb64f9`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:51:19,671::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:19,757::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364375 s, 28.1 MB/s\n'; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:20,448::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:21,770::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:21,873::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442338 s, 23.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:51:23,887::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:23,964::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304022 s, 33.7 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:51:25,468::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:51:25,477::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00029797 s, 13.7 MB/s\n'; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:25,635::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:25,954::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,960::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,961::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,962::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,962::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,962::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,962::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-247::DEBUG::2013-03-01 12:51:25,963::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:25,966::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:25,978::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:26,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350978 s, 29.2 MB/s\n'; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:26,182::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:26,183::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,184::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-247::DEBUG::2013-03-01 12:51:26,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-247::DEBUG::2013-03-01 12:51:26,192::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000292095 s, 7.0 MB/s\n'; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:26,192::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000292095 s, 7.0 MB/s'], size: 2048 >Thread-247::DEBUG::2013-03-01 12:51:26,192::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-247::WARNING::2013-03-01 12:51:26,193::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-247::DEBUG::2013-03-01 12:51:26,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-247::DEBUG::2013-03-01 12:51:26,194::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,194::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,195::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,195::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,195::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,196::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-247::DEBUG::2013-03-01 12:51:26,379::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:26,381::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,381::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-247::DEBUG::2013-03-01 12:51:26,382::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-247::DEBUG::2013-03-01 12:51:26,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:26,588::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-247::WARNING::2013-03-01 12:51:26,589::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-247::WARNING::2013-03-01 12:51:26,589::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-247::WARNING::2013-03-01 12:51:26,589::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-247::DEBUG::2013-03-01 12:51:26,590::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-247::DEBUG::2013-03-01 12:51:26,590::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-247::DEBUG::2013-03-01 12:51:26,590::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b'] >Thread-247::DEBUG::2013-03-01 12:51:26,591::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,591::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,591::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,591::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,592::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,592::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-247::DEBUG::2013-03-01 12:51:26,778::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:26,780::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:26,780::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b removing=MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 >Thread-247::DEBUG::2013-03-01 12:51:26,781::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 --deltag MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active --addtag MDT__SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b --addtag MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:28,071::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:28,151::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348219 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:51:30,165::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:30,240::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293275 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:51:32,254::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:32,337::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338958 s, 30.2 MB/s\n'; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:33,053::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-247::DEBUG::2013-03-01 12:51:33,053::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:33,054::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-247::DEBUG::2013-03-01 12:51:33,054::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-247::WARNING::2013-03-01 12:51:33,054::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/images already exists >Thread-247::WARNING::2013-03-01 12:51:33,056::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/dom_md already exists >Thread-247::INFO::2013-03-01 12:51:33,056::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/4b95f32d-26ca-467b-96e6-692c57bcface >Thread-247::DEBUG::2013-03-01 12:51:33,057::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-247::DEBUG::2013-03-01 12:51:33,058::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-247::DEBUG::2013-03-01 12:51:33,058::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-247::DEBUG::2013-03-01 12:51:33,058::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-247::DEBUG::2013-03-01 12:51:33,058::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-247::DEBUG::2013-03-01 12:51:33,059::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-247::DEBUG::2013-03-01 12:51:33,060::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `41b11cc6-b020-47d9-b70e-c4fadcc621be` started monitoring domain `4b95f32d-26ca-467b-96e6-692c57bcface` >Thread-255::DEBUG::2013-03-01 12:51:33,060::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-247::DEBUG::2013-03-01 12:51:33,061::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-247::INFO::2013-03-01 12:51:33,062::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-247::DEBUG::2013-03-01 12:51:33,064::task::1151::TaskManager.Task::(prepare) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::finished: None >Thread-247::DEBUG::2013-03-01 12:51:33,065::task::568::TaskManager.Task::(_updateState) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::moving from state preparing -> state finished >Thread-247::DEBUG::2013-03-01 12:51:33,067::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4b95f32d-26ca-467b-96e6-692c57bcface': < ResourceRef 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-255::DEBUG::2013-03-01 12:51:33,067::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-247::DEBUG::2013-03-01 12:51:33,068::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-247::DEBUG::2013-03-01 12:51:33,078::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' >Thread-247::DEBUG::2013-03-01 12:51:33,079::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' (0 active users) >Thread-247::DEBUG::2013-03-01 12:51:33,079::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free, finding out if anyone is waiting for it. >Thread-247::DEBUG::2013-03-01 12:51:33,079::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', Clearing records. >Thread-247::DEBUG::2013-03-01 12:51:33,080::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-247::DEBUG::2013-03-01 12:51:33,080::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-247::DEBUG::2013-03-01 12:51:33,080::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-247::DEBUG::2013-03-01 12:51:33,081::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-247::DEBUG::2013-03-01 12:51:33,081::task::957::TaskManager.Task::(_decref) Task=`a98589ad-2cc2-414e-b71f-a4a98d6549a4`::ref 0 aborting False >Thread-256::DEBUG::2013-03-01 12:51:33,110::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-256::DEBUG::2013-03-01 12:51:33,110::task::568::TaskManager.Task::(_updateState) Task=`a2da235d-2b59-4a71-97d9-472b51c22519`::moving from state init -> state preparing >Thread-256::INFO::2013-03-01 12:51:33,110::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-256::INFO::2013-03-01 12:51:33,111::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-256::DEBUG::2013-03-01 12:51:33,111::task::1151::TaskManager.Task::(prepare) Task=`a2da235d-2b59-4a71-97d9-472b51c22519`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-256::DEBUG::2013-03-01 12:51:33,111::task::568::TaskManager.Task::(_updateState) Task=`a2da235d-2b59-4a71-97d9-472b51c22519`::moving from state preparing -> state finished >Thread-256::DEBUG::2013-03-01 12:51:33,111::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256::DEBUG::2013-03-01 12:51:33,112::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256::DEBUG::2013-03-01 12:51:33,112::task::957::TaskManager.Task::(_decref) Task=`a2da235d-2b59-4a71-97d9-472b51c22519`::ref 0 aborting False >Thread-257::DEBUG::2013-03-01 12:51:33,127::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-257::DEBUG::2013-03-01 12:51:33,127::task::568::TaskManager.Task::(_updateState) Task=`1073cb66-be2f-480a-b464-1b1f202c12d2`::moving from state init -> state preparing >Thread-257::INFO::2013-03-01 12:51:33,128::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', masterVersion=1, options=None) >Thread-257::DEBUG::2013-03-01 12:51:33,128::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e74580fc-3bfd-429e-9dc1-856ba8f69cb8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-257::DEBUG::2013-03-01 12:51:33,128::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-257::DEBUG::2013-03-01 12:51:33,129::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-257::DEBUG::2013-03-01 12:51:33,129::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e74580fc-3bfd-429e-9dc1-856ba8f69cb8`::Granted request >Thread-257::DEBUG::2013-03-01 12:51:33,129::task::794::TaskManager.Task::(resourceAcquired) Task=`1073cb66-be2f-480a-b464-1b1f202c12d2`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-257::DEBUG::2013-03-01 12:51:33,129::task::957::TaskManager.Task::(_decref) Task=`1073cb66-be2f-480a-b464-1b1f202c12d2`::ref 1 aborting False >Thread-257::INFO::2013-03-01 12:51:33,130::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-257::DEBUG::2013-03-01 12:51:33,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-258::DEBUG::2013-03-01 12:51:33,139::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-258::DEBUG::2013-03-01 12:51:33,139::task::568::TaskManager.Task::(_updateState) Task=`7b3496a5-d93c-4e82-93a1-e81cea3f6d37`::moving from state init -> state preparing >Thread-258::INFO::2013-03-01 12:51:33,139::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-258::DEBUG::2013-03-01 12:51:33,140::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7025c863-ef3e-44d5-a154-2dcc89b8ed45`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-258::DEBUG::2013-03-01 12:51:33,140::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-258::DEBUG::2013-03-01 12:51:33,140::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-258::DEBUG::2013-03-01 12:51:33,141::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7025c863-ef3e-44d5-a154-2dcc89b8ed45`::Granted request >Thread-258::DEBUG::2013-03-01 12:51:33,141::task::794::TaskManager.Task::(resourceAcquired) Task=`7b3496a5-d93c-4e82-93a1-e81cea3f6d37`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-258::DEBUG::2013-03-01 12:51:33,141::task::957::TaskManager.Task::(_decref) Task=`7b3496a5-d93c-4e82-93a1-e81cea3f6d37`::ref 1 aborting False >Thread-258::DEBUG::2013-03-01 12:51:33,142::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:51:33,143::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 12:51:33,279::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:51:33,279::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:51:33,287::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268402 s, 15.3 MB/s\n'; <rc> = 0 >Thread-255::INFO::2013-03-01 12:51:33,289::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface (id: 1) >Thread-255::DEBUG::2013-03-01 12:51:33,290::clusterlock::191::SANLock::(acquireHostId) Host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface successfully acquired (id: 1) >Thread-257::DEBUG::2013-03-01 12:51:33,344::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-257::DEBUG::2013-03-01 12:51:33,345::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-258::DEBUG::2013-03-01 12:51:33,349::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:51:33,351::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,351::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,352::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,352::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,352::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,352::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,353::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-257::DEBUG::2013-03-01 12:51:33,544::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-257::DEBUG::2013-03-01 12:51:33,547::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,547::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-257::DEBUG::2013-03-01 12:51:33,550::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,551::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,551::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,552::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,552::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:51:33,552::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:51:33,553::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-258::DEBUG::2013-03-01 12:51:33,553::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-258::DEBUG::2013-03-01 12:51:33,553::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-258::DEBUG::2013-03-01 12:51:33,554::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-258::DEBUG::2013-03-01 12:51:33,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-258::DEBUG::2013-03-01 12:51:33,577::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:51:33,577::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:33,580::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-259::DEBUG::2013-03-01 12:51:33,722::task::568::TaskManager.Task::(_updateState) Task=`d0a1a3da-c7a0-47c7-88b0-6f79b29ecfc1`::moving from state init -> state preparing >Thread-259::INFO::2013-03-01 12:51:33,728::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-259::INFO::2013-03-01 12:51:33,729::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00870800018311', 'lastCheck': '0.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.483640909195', 'lastCheck': '7.8', 'code': 0, 'valid': True}} >Thread-259::DEBUG::2013-03-01 12:51:33,729::task::1151::TaskManager.Task::(prepare) Task=`d0a1a3da-c7a0-47c7-88b0-6f79b29ecfc1`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00870800018311', 'lastCheck': '0.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.483640909195', 'lastCheck': '7.8', 'code': 0, 'valid': True}} >Thread-259::DEBUG::2013-03-01 12:51:33,730::task::568::TaskManager.Task::(_updateState) Task=`d0a1a3da-c7a0-47c7-88b0-6f79b29ecfc1`::moving from state preparing -> state finished >Thread-259::DEBUG::2013-03-01 12:51:33,730::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-259::DEBUG::2013-03-01 12:51:33,730::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-259::DEBUG::2013-03-01 12:51:33,731::task::957::TaskManager.Task::(_decref) Task=`d0a1a3da-c7a0-47c7-88b0-6f79b29ecfc1`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:51:34,352::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:34,440::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423021 s, 24.2 MB/s\n'; <rc> = 0 >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:34,583::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:35,587::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:35,594::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:35,597::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:35,600::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:35,603::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:36,456::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:36,604::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332722 s, 30.8 MB/s\n'; <rc> = 0 >MainProcess|Thread-258::DEBUG::2013-03-01 12:51:36,607::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-258::DEBUG::2013-03-01 12:51:38,611::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:51:38,621::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 12:51:43,294::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Dummy-173::DEBUG::2013-03-01 12:52:00,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357806 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:52:02,869::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:52:20,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314368 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:52:22,732::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:52:47,578::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296733 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:52:49,594::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-258::DEBUG::2013-03-01 12:52:49,832::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:52:49,834::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:49,841::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:49,842::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:49,844::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:49,847::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:49,849::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:49,850::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-255::DEBUG::2013-03-01 12:52:49,851::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-255::DEBUG::2013-03-01 12:52:49,853::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-258::DEBUG::2013-03-01 12:52:49,854::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:52:49,854::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-255::DEBUG::2013-03-01 12:52:49,857::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-258::DEBUG::2013-03-01 12:52:49,877::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 12:52:49,897::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:52:49,898::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:49,902::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:49,905::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:49,907::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:49,910::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:49,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:49,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:52:49,953::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938015 s, 10.9 MB/s\n'; <rc> = 0 >Thread-265::DEBUG::2013-03-01 12:52:50,540::task::568::TaskManager.Task::(_updateState) Task=`7393a418-d2d2-42f8-b666-610c629c1107`::moving from state init -> state preparing >Thread-265::INFO::2013-03-01 12:52:50,835::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-265::INFO::2013-03-01 12:52:50,835::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00870800018311', 'lastCheck': '77.5', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.483640909195', 'lastCheck': '84.9', 'code': 0, 'valid': True}} >Thread-265::DEBUG::2013-03-01 12:52:50,836::task::1151::TaskManager.Task::(prepare) Task=`7393a418-d2d2-42f8-b666-610c629c1107`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00870800018311', 'lastCheck': '77.5', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.483640909195', 'lastCheck': '84.9', 'code': 0, 'valid': True}} >Thread-265::DEBUG::2013-03-01 12:52:50,836::task::568::TaskManager.Task::(_updateState) Task=`7393a418-d2d2-42f8-b666-610c629c1107`::moving from state preparing -> state finished >Thread-265::DEBUG::2013-03-01 12:52:50,836::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-265::DEBUG::2013-03-01 12:52:50,836::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-265::DEBUG::2013-03-01 12:52:50,836::task::957::TaskManager.Task::(_decref) Task=`7393a418-d2d2-42f8-b666-610c629c1107`::ref 0 aborting False >Thread-258::DEBUG::2013-03-01 12:52:50,877::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:52:50,878::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:50,879::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-258::DEBUG::2013-03-01 12:52:50,880::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-258::DEBUG::2013-03-01 12:52:50,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000284306 s, 7.2 MB/s\n'; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:52:50,895::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000284306 s, 7.2 MB/s'], size: 2048 >Thread-258::DEBUG::2013-03-01 12:52:50,896::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-258::WARNING::2013-03-01 12:52:50,897::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-258::DEBUG::2013-03-01 12:52:50,899::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-258::DEBUG::2013-03-01 12:52:50,899::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:50,899::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:50,899::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:50,900::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:50,900::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:50,901::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:50,918::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >Thread-258::DEBUG::2013-03-01 12:52:51,127::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:52:51,129::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:51,129::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-258::DEBUG::2013-03-01 12:52:51,130::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-258::DEBUG::2013-03-01 12:52:51,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-258::DEBUG::2013-03-01 12:52:51,800::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-258::DEBUG::2013-03-01 12:52:51,801::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-258::WARNING::2013-03-01 12:52:51,802::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-258::WARNING::2013-03-01 12:52:51,802::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-258::WARNING::2013-03-01 12:52:51,802::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-257::DEBUG::2013-03-01 12:52:51,805::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-257::DEBUG::2013-03-01 12:52:51,807::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-257::DEBUG::2013-03-01 12:52:51,808::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-257::DEBUG::2013-03-01 12:52:51,809::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-105::DEBUG::2013-03-01 12:52:51,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-257::WARNING::2013-03-01 12:52:51,810::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be already exists >Thread-257::DEBUG::2013-03-01 12:52:51,820::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-257::DEBUG::2013-03-01 12:52:51,821::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >MainProcess|Thread-255::DEBUG::2013-03-01 12:52:51,923::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 12:52:51,966::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 12:52:52,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:52:52,045::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-257::DEBUG::2013-03-01 12:52:52,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-257::DEBUG::2013-03-01 12:52:52,064::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-257::WARNING::2013-03-01 12:52:52,066::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/dom_md already exists >Thread-257::WARNING::2013-03-01 12:52:52,068::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface/images already exists >Thread-105::DEBUG::2013-03-01 12:52:52,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000251047 s, 16.3 MB/s\n'; <rc> = 0 >Thread-257::INFO::2013-03-01 12:52:52,137::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/4b95f32d-26ca-467b-96e6-692c57bcface to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/4b95f32d-26ca-467b-96e6-692c57bcface >Thread-257::WARNING::2013-03-01 12:52:52,139::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-257::WARNING::2013-03-01 12:52:52,140::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-257::INFO::2013-03-01 12:52:52,143::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-257::INFO::2013-03-01 12:52:52,144::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd >Thread-257::INFO::2013-03-01 12:52:52,146::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-257::DEBUG::2013-03-01 12:52:52,147::task::1151::TaskManager.Task::(prepare) Task=`1073cb66-be2f-480a-b464-1b1f202c12d2`::finished: None >Thread-257::DEBUG::2013-03-01 12:52:52,149::task::568::TaskManager.Task::(_updateState) Task=`1073cb66-be2f-480a-b464-1b1f202c12d2`::moving from state preparing -> state finished >Thread-257::DEBUG::2013-03-01 12:52:52,150::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-257::DEBUG::2013-03-01 12:52:52,151::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-257::DEBUG::2013-03-01 12:52:52,154::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-257::DEBUG::2013-03-01 12:52:52,156::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (1 active users) >Thread-257::DEBUG::2013-03-01 12:52:52,158::task::957::TaskManager.Task::(_decref) Task=`1073cb66-be2f-480a-b464-1b1f202c12d2`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:52:52,174::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347726 s, 29.4 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:52:53,951::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:52:54,195::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:52:55,555::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.481351 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:52:57,743::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:52:58,204::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307158 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:53:00,217::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:53:00,291::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293391 s, 34.9 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:53:02,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:53:02,305::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 12:53:02,476::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716641 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:53:02,563::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598114 s, 17.1 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,039::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,039::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,040::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,040::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,040::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,041::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,041::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,041::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-255::DEBUG::2013-03-01 12:53:03,042::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,052::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:03,306::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,308::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,308::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-255::DEBUG::2013-03-01 12:53:03,308::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:03,317::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000422098 s, 4.9 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,317::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000422098 s, 4.9 MB/s'], size: 2048 >Thread-255::DEBUG::2013-03-01 12:53:03,318::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-255::WARNING::2013-03-01 12:53:03,318::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-255::DEBUG::2013-03-01 12:53:03,320::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-255::DEBUG::2013-03-01 12:53:03,320::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,320::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,321::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,321::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,322::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:03,511::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,512::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,513::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-255::DEBUG::2013-03-01 12:53:03,514::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:53:03,514::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:03,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,710::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-255::WARNING::2013-03-01 12:53:03,711::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-255::WARNING::2013-03-01 12:53:03,711::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-255::WARNING::2013-03-01 12:53:03,711::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-258::INFO::2013-03-01 12:53:03,713::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-258::DEBUG::2013-03-01 12:53:03,714::task::1151::TaskManager.Task::(prepare) Task=`7b3496a5-d93c-4e82-93a1-e81cea3f6d37`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-255::DEBUG::2013-03-01 12:53:03,716::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-258::DEBUG::2013-03-01 12:53:03,716::task::568::TaskManager.Task::(_updateState) Task=`7b3496a5-d93c-4e82-93a1-e81cea3f6d37`::moving from state preparing -> state finished >Thread-258::DEBUG::2013-03-01 12:53:03,724::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-258::DEBUG::2013-03-01 12:53:03,725::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-258::DEBUG::2013-03-01 12:53:03,726::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-258::DEBUG::2013-03-01 12:53:03,726::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-258::DEBUG::2013-03-01 12:53:03,726::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-258::DEBUG::2013-03-01 12:53:03,726::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-258::DEBUG::2013-03-01 12:53:03,727::task::957::TaskManager.Task::(_decref) Task=`7b3496a5-d93c-4e82-93a1-e81cea3f6d37`::ref 0 aborting False >Thread-293::DEBUG::2013-03-01 12:53:03,773::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-293::DEBUG::2013-03-01 12:53:03,774::task::568::TaskManager.Task::(_updateState) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::moving from state init -> state preparing >Thread-293::INFO::2013-03-01 12:53:03,774::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='641da936-3f96-4831-a341-cd57756ebef7', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-293::INFO::2013-03-01 12:53:03,774::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-293::DEBUG::2013-03-01 12:53:03,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:03,901::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:53:03,902::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:03,910::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000269497 s, 15.2 MB/s\n'; <rc> = 0 >Thread-293::DEBUG::2013-03-01 12:53:03,953::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-293::DEBUG::2013-03-01 12:53:03,953::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-293::DEBUG::2013-03-01 12:53:03,953::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-293::DEBUG::2013-03-01 12:53:03,954::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-293::DEBUG::2013-03-01 12:53:03,954::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-293::DEBUG::2013-03-01 12:53:03,954::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-293::DEBUG::2013-03-01 12:53:03,955::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-293::DEBUG::2013-03-01 12:53:04,153::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-293::DEBUG::2013-03-01 12:53:04,155::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-293::DEBUG::2013-03-01 12:53:04,155::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-293::DEBUG::2013-03-01 12:53:04,156::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`dd253463-0660-4396-a642-fdba078447a3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-293::DEBUG::2013-03-01 12:53:04,157::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-293::DEBUG::2013-03-01 12:53:04,157::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-293::DEBUG::2013-03-01 12:53:04,157::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`dd253463-0660-4396-a642-fdba078447a3`::Granted request >Thread-293::DEBUG::2013-03-01 12:53:04,158::task::794::TaskManager.Task::(resourceAcquired) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-293::DEBUG::2013-03-01 12:53:04,158::task::957::TaskManager.Task::(_decref) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::ref 1 aborting False >Thread-293::DEBUG::2013-03-01 12:53:04,244::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >Thread-293::DEBUG::2013-03-01 12:53:04,251::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task d7b4efff-e846-4e7e-b75c-b4a994301013 >Thread-293::INFO::2013-03-01 12:53:04,251::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-293::DEBUG::2013-03-01 12:53:04,251::task::1146::TaskManager.Task::(prepare) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::Prepare: 1 jobs exist, move to acquiring >Thread-293::DEBUG::2013-03-01 12:53:04,252::task::568::TaskManager.Task::(_updateState) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::moving from state preparing -> state acquiring >Thread-293::DEBUG::2013-03-01 12:53:04,252::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >Thread-293::DEBUG::2013-03-01 12:53:04,258::task::568::TaskManager.Task::(_updateState) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::moving from state acquiring -> state queued >Thread-293::DEBUG::2013-03-01 12:53:04,259::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >Thread-293::DEBUG::2013-03-01 12:53:04,264::taskManager::50::TaskManager::(_queueTask) queuing task: d7b4efff-e846-4e7e-b75c-b4a994301013 >c261e8ca-c11c-4e02-893d-4ee09209b7f0::DEBUG::2013-03-01 12:53:04,265::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-293::DEBUG::2013-03-01 12:53:04,265::taskManager::56::TaskManager::(_queueTask) task queued: d7b4efff-e846-4e7e-b75c-b4a994301013 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,266::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: d7b4efff-e846-4e7e-b75c-b4a994301013 running: <bound method Task.commit of <storage.task.Task instance at 0x178f4d0>> with: None >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,267::task::1159::TaskManager.Task::(commit) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::committing task: d7b4efff-e846-4e7e-b75c-b4a994301013 >Thread-293::DEBUG::2013-03-01 12:53:04,267::task::1148::TaskManager.Task::(prepare) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::returning >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,268::task::568::TaskManager.Task::(_updateState) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::moving from state queued -> state running >Thread-293::DEBUG::2013-03-01 12:53:04,269::task::957::TaskManager.Task::(_decref) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::ref 1 aborting False >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,272::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,279::task::872::TaskManager.Task::(_runJobs) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'e7934077-6752-4445-a00a-1f2551119ade', 12582912, 4, 2, 2, '641da936-3f96-4831-a341-cd57756ebef7', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,279::task::304::TaskManager.Task::(run) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'e7934077-6752-4445-a00a-1f2551119ade', 12582912, 4, 2, 2, '641da936-3f96-4831-a341-cd57756ebef7', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,279::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`71079dc3-527a-4449-beca-e40725d7b3b4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,280::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' for lock type 'exclusive' >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,280::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,281::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,516::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,522::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,522::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image e7934077-6752-4445-a00a-1f2551119ade does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,522::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free. Now locking as 'exclusive' (1 active user) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,522::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`71079dc3-527a-4449-beca-e40725d7b3b4`::Granted request >d7b4efff-e846-4e7e-b75c-b4a994301013::INFO::2013-03-01 12:53:04,523::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade for image's volumes >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,524::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,531::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,531::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:53:04,577::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:53:04,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348054 s, 29.4 MB/s\n'; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,721::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,726::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::WARNING::2013-03-01 12:53:04,726::lvm::593::Storage.LVM::(getLv) lv: 641da936-3f96-4831-a341-cd57756ebef7 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >d7b4efff-e846-4e7e-b75c-b4a994301013::INFO::2013-03-01 12:53:04,727::volume::457::Storage.Volume::(create) Creating volume 641da936-3f96-4831-a341-cd57756ebef7 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,727::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,735::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:04,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 641da936-3f96-4831-a341-cd57756ebef7 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:53:06,669::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:53:06,745::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304748 s, 33.6 MB/s\n'; <rc> = 0 >Thread-295::DEBUG::2013-03-01 12:53:07,235::task::568::TaskManager.Task::(_updateState) Task=`174629d0-ff44-497d-af74-12fe5e864ab8`::moving from state init -> state preparing >Thread-295::INFO::2013-03-01 12:53:08,512::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-295::INFO::2013-03-01 12:53:08,521::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00850319862366', 'lastCheck': '4.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.341247081757', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-295::DEBUG::2013-03-01 12:53:08,526::task::1151::TaskManager.Task::(prepare) Task=`174629d0-ff44-497d-af74-12fe5e864ab8`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00850319862366', 'lastCheck': '4.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.341247081757', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-295::DEBUG::2013-03-01 12:53:08,530::task::568::TaskManager.Task::(_updateState) Task=`174629d0-ff44-497d-af74-12fe5e864ab8`::moving from state preparing -> state finished >Thread-295::DEBUG::2013-03-01 12:53:08,534::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-295::DEBUG::2013-03-01 12:53:08,538::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-295::DEBUG::2013-03-01 12:53:08,543::task::957::TaskManager.Task::(_decref) Task=`174629d0-ff44-497d-af74-12fe5e864ab8`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:53:08,761::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,417::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,440::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,460::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,478::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::INFO::2013-03-01 12:53:09,503::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 with size = 12582912 sectors >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,528::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 6291456K' (cwd None) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:09,979::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:10,014::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:10,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-297::DEBUG::2013-03-01 12:53:10,934::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-297::DEBUG::2013-03-01 12:53:10,966::task::568::TaskManager.Task::(_updateState) Task=`89b248d9-bf8d-442b-803a-f481edbd0518`::moving from state init -> state preparing >Thread-297::INFO::2013-03-01 12:53:10,982::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-297::DEBUG::2013-03-01 12:53:10,993::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-297::DEBUG::2013-03-01 12:53:10,994::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b4efff-e846-4e7e-b75c-b4a994301013 >Thread-297::DEBUG::2013-03-01 12:53:10,995::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'} >Thread-297::DEBUG::2013-03-01 12:53:10,996::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}} >Thread-297::INFO::2013-03-01 12:53:10,997::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}}} >Thread-297::DEBUG::2013-03-01 12:53:10,998::task::1151::TaskManager.Task::(prepare) Task=`89b248d9-bf8d-442b-803a-f481edbd0518`::finished: {'allTasksStatus': {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}}} >Thread-297::DEBUG::2013-03-01 12:53:10,999::task::568::TaskManager.Task::(_updateState) Task=`89b248d9-bf8d-442b-803a-f481edbd0518`::moving from state preparing -> state finished >Thread-297::DEBUG::2013-03-01 12:53:11,000::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-297::DEBUG::2013-03-01 12:53:11,001::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-297::DEBUG::2013-03-01 12:53:11,002::task::957::TaskManager.Task::(_decref) Task=`89b248d9-bf8d-442b-803a-f481edbd0518`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:53:11,009::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.10602 s, 926 kB/s\n'; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:11,113::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:11,119::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::WARNING::2013-03-01 12:53:11,119::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:11,119::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:11,120::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_e7934077-6752-4445-a00a-1f2551119ade a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >Thread-105::DEBUG::2013-03-01 12:53:12,498::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Dummy-173::DEBUG::2013-03-01 12:53:13,022::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-299::DEBUG::2013-03-01 12:53:13,768::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-255::DEBUG::2013-03-01 12:53:13,911::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:53:34,467::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-299::DEBUG::2013-03-01 12:53:34,477::task::568::TaskManager.Task::(_updateState) Task=`0b0414af-9551-4219-965c-e6c2f6572602`::moving from state init -> state preparing >Thread-299::INFO::2013-03-01 12:53:34,495::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-299::INFO::2013-03-01 12:53:34,500::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-299::DEBUG::2013-03-01 12:53:34,503::task::1151::TaskManager.Task::(prepare) Task=`0b0414af-9551-4219-965c-e6c2f6572602`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-299::DEBUG::2013-03-01 12:53:34,505::task::568::TaskManager.Task::(_updateState) Task=`0b0414af-9551-4219-965c-e6c2f6572602`::moving from state preparing -> state finished >Thread-299::DEBUG::2013-03-01 12:53:34,507::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-299::DEBUG::2013-03-01 12:53:34,509::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-255::DEBUG::2013-03-01 12:53:34,510::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00029118 s, 14.1 MB/s\n'; <rc> = 0 >Thread-299::DEBUG::2013-03-01 12:53:34,512::task::957::TaskManager.Task::(_decref) Task=`0b0414af-9551-4219-965c-e6c2f6572602`::ref 0 aborting False >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:34,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:34,523::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-300::DEBUG::2013-03-01 12:53:34,543::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-300::DEBUG::2013-03-01 12:53:34,544::task::568::TaskManager.Task::(_updateState) Task=`23c2828d-a347-486c-9318-688ef9e7402b`::moving from state init -> state preparing >Thread-300::INFO::2013-03-01 12:53:34,545::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-300::DEBUG::2013-03-01 12:53:34,547::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2d287256-ba91-4884-8171-5a846f5dc755`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-300::DEBUG::2013-03-01 12:53:34,548::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-300::DEBUG::2013-03-01 12:53:34,550::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-300::DEBUG::2013-03-01 12:53:34,550::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2d287256-ba91-4884-8171-5a846f5dc755`::Granted request >Thread-300::DEBUG::2013-03-01 12:53:34,553::task::794::TaskManager.Task::(resourceAcquired) Task=`23c2828d-a347-486c-9318-688ef9e7402b`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-300::DEBUG::2013-03-01 12:53:34,554::task::957::TaskManager.Task::(_decref) Task=`23c2828d-a347-486c-9318-688ef9e7402b`::ref 1 aborting False >Thread-300::DEBUG::2013-03-01 12:53:34,557::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Dummy-173::DEBUG::2013-03-01 12:53:34,601::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0876216 s, 11.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:53:36,618::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:44,514::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:45,254::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000274804 s, 14.9 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:53:45,278::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:53:45,281::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:53:45,284::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-300::DEBUG::2013-03-01 12:53:45,284::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:45,297::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-300::DEBUG::2013-03-01 12:53:45,309::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:53:45,321::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287401 s, 14.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:53:45,377::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474288 s, 21.6 MB/s\n'; <rc> = 0 >Thread-300::DEBUG::2013-03-01 12:53:46,114::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-300::DEBUG::2013-03-01 12:53:46,115::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:46,117::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-300::INFO::2013-03-01 12:53:46,119::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:46,119::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-300::DEBUG::2013-03-01 12:53:46,120::task::1151::TaskManager.Task::(prepare) Task=`23c2828d-a347-486c-9318-688ef9e7402b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-300::DEBUG::2013-03-01 12:53:46,121::task::568::TaskManager.Task::(_updateState) Task=`23c2828d-a347-486c-9318-688ef9e7402b`::moving from state preparing -> state finished >Thread-300::DEBUG::2013-03-01 12:53:46,122::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-300::DEBUG::2013-03-01 12:53:46,123::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2013-03-01 12:53:46,124::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:53:46,125::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >Thread-300::DEBUG::2013-03-01 12:53:46,133::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-300::DEBUG::2013-03-01 12:53:46,133::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-300::DEBUG::2013-03-01 12:53:46,134::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-300::DEBUG::2013-03-01 12:53:46,134::task::957::TaskManager.Task::(_decref) Task=`23c2828d-a347-486c-9318-688ef9e7402b`::ref 0 aborting False >Thread-302::DEBUG::2013-03-01 12:53:46,180::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-302::DEBUG::2013-03-01 12:53:46,180::task::568::TaskManager.Task::(_updateState) Task=`3a0c3bee-9d65-435a-be7d-aa255e7d4287`::moving from state init -> state preparing >Thread-302::INFO::2013-03-01 12:53:46,181::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-302::DEBUG::2013-03-01 12:53:46,181::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-302::DEBUG::2013-03-01 12:53:46,181::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b4efff-e846-4e7e-b75c-b4a994301013 >Thread-302::DEBUG::2013-03-01 12:53:46,181::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'} >Thread-302::DEBUG::2013-03-01 12:53:46,181::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}} >Thread-302::INFO::2013-03-01 12:53:46,182::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}}} >Thread-302::DEBUG::2013-03-01 12:53:46,182::task::1151::TaskManager.Task::(prepare) Task=`3a0c3bee-9d65-435a-be7d-aa255e7d4287`::finished: {'allTasksStatus': {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}}} >Thread-302::DEBUG::2013-03-01 12:53:46,182::task::568::TaskManager.Task::(_updateState) Task=`3a0c3bee-9d65-435a-be7d-aa255e7d4287`::moving from state preparing -> state finished >Thread-302::DEBUG::2013-03-01 12:53:46,182::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-302::DEBUG::2013-03-01 12:53:46,182::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-302::DEBUG::2013-03-01 12:53:46,183::task::957::TaskManager.Task::(_decref) Task=`3a0c3bee-9d65-435a-be7d-aa255e7d4287`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:53:47,390::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 12:53:55,257::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:53:55,346::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-304::DEBUG::2013-03-01 12:53:56,182::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-105::DEBUG::2013-03-01 12:54:09,827::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-304::DEBUG::2013-03-01 12:54:09,831::task::568::TaskManager.Task::(_updateState) Task=`7441f116-f941-48d1-88e5-2a5da69085b6`::moving from state init -> state preparing >Thread-105::DEBUG::2013-03-01 12:54:09,833::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-304::INFO::2013-03-01 12:54:09,835::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:09,851::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:54:09,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000252469 s, 16.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:54:09,857::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000283953 s, 7.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:54:09,873::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000283953 s, 7.2 MB/s'], size: 2048 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:09,874::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:09,876::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:09,879::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::WARNING::2013-03-01 12:54:09,878::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-105::DEBUG::2013-03-01 12:54:09,883::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-105::DEBUG::2013-03-01 12:54:09,884::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:09,886::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:09,888::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:09,891::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:09,892::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:09,896::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:09,949::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0951652 s, 10.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:54:10,286::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:54:10,289::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:54:10,289::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-105::WARNING::2013-03-01 12:54:10,290::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-105::WARNING::2013-03-01 12:54:10,291::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-105::WARNING::2013-03-01 12:54:10,291::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-304::INFO::2013-03-01 12:54:10,294::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-304::DEBUG::2013-03-01 12:54:10,296::task::1151::TaskManager.Task::(prepare) Task=`7441f116-f941-48d1-88e5-2a5da69085b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,297::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >Thread-304::DEBUG::2013-03-01 12:54:10,298::task::568::TaskManager.Task::(_updateState) Task=`7441f116-f941-48d1-88e5-2a5da69085b6`::moving from state preparing -> state finished >Thread-304::DEBUG::2013-03-01 12:54:10,300::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-105::DEBUG::2013-03-01 12:54:10,301::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-304::DEBUG::2013-03-01 12:54:10,303::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-304::DEBUG::2013-03-01 12:54:10,315::task::957::TaskManager.Task::(_decref) Task=`7441f116-f941-48d1-88e5-2a5da69085b6`::ref 0 aborting False >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,333::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=641da936-3f96-4831-a341-cd57756ebef7 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 4) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,339::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >Thread-305::DEBUG::2013-03-01 12:54:10,348::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-305::DEBUG::2013-03-01 12:54:10,349::task::568::TaskManager.Task::(_updateState) Task=`a12bbc24-abc5-4f4c-9d04-f2a919ed31f3`::moving from state init -> state preparing >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,351::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' >Thread-305::INFO::2013-03-01 12:54:10,351::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,354::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' (0 active users) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,355::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free, finding out if anyone is waiting for it. >Thread-305::DEBUG::2013-03-01 12:54:10,355::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`98c2cc8d-edff-4efe-a2cd-03095431d988`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,356::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade', Clearing records. >Thread-305::DEBUG::2013-03-01 12:54:10,357::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-305::DEBUG::2013-03-01 12:54:10,359::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,359::task::568::TaskManager.Task::(_updateState) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::moving from state running -> state finished >Thread-305::DEBUG::2013-03-01 12:54:10,359::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`98c2cc8d-edff-4efe-a2cd-03095431d988`::Granted request >Thread-305::DEBUG::2013-03-01 12:54:10,361::task::794::TaskManager.Task::(resourceAcquired) Task=`a12bbc24-abc5-4f4c-9d04-f2a919ed31f3`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,361::task::719::TaskManager.Task::(_save) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d7b4efff-e846-4e7e-b75c-b4a994301013.temp >Thread-305::DEBUG::2013-03-01 12:54:10,362::task::957::TaskManager.Task::(_decref) Task=`a12bbc24-abc5-4f4c-9d04-f2a919ed31f3`::ref 1 aborting False >Thread-305::INFO::2013-03-01 12:54:10,367::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-305::DEBUG::2013-03-01 12:54:10,368::task::1151::TaskManager.Task::(prepare) Task=`a12bbc24-abc5-4f4c-9d04-f2a919ed31f3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-305::DEBUG::2013-03-01 12:54:10,369::task::568::TaskManager.Task::(_updateState) Task=`a12bbc24-abc5-4f4c-9d04-f2a919ed31f3`::moving from state preparing -> state finished >Thread-305::DEBUG::2013-03-01 12:54:10,369::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-305::DEBUG::2013-03-01 12:54:10,370::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-305::DEBUG::2013-03-01 12:54:10,371::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-305::DEBUG::2013-03-01 12:54:10,371::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-305::DEBUG::2013-03-01 12:54:10,372::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-305::DEBUG::2013-03-01 12:54:10,373::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-305::DEBUG::2013-03-01 12:54:10,374::task::957::TaskManager.Task::(_decref) Task=`a12bbc24-abc5-4f4c-9d04-f2a919ed31f3`::ref 0 aborting False >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,381::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,381::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,382::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,382::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,382::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,382::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,382::task::880::TaskManager.Task::(_runJobs) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::Task.run: exit - success: result {'uuid': '641da936-3f96-4831-a341-cd57756ebef7'} >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,383::task::957::TaskManager.Task::(_decref) Task=`d7b4efff-e846-4e7e-b75c-b4a994301013`::ref 0 aborting False >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:10,383::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-306::DEBUG::2013-03-01 12:54:10,417::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-306::DEBUG::2013-03-01 12:54:10,418::task::568::TaskManager.Task::(_updateState) Task=`15d91989-8036-4afe-8ecb-3291131d04f9`::moving from state init -> state preparing >Thread-306::INFO::2013-03-01 12:54:10,418::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-306::DEBUG::2013-03-01 12:54:10,418::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-306::DEBUG::2013-03-01 12:54:10,418::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d7b4efff-e846-4e7e-b75c-b4a994301013 >Thread-306::DEBUG::2013-03-01 12:54:10,419::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'} >Thread-306::DEBUG::2013-03-01 12:54:10,419::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}} >Thread-306::INFO::2013-03-01 12:54:10,419::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}}} >Thread-306::DEBUG::2013-03-01 12:54:10,420::task::1151::TaskManager.Task::(prepare) Task=`15d91989-8036-4afe-8ecb-3291131d04f9`::finished: {'allTasksStatus': {'d7b4efff-e846-4e7e-b75c-b4a994301013': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd7b4efff-e846-4e7e-b75c-b4a994301013'}}} >Thread-306::DEBUG::2013-03-01 12:54:10,420::task::568::TaskManager.Task::(_updateState) Task=`15d91989-8036-4afe-8ecb-3291131d04f9`::moving from state preparing -> state finished >Thread-306::DEBUG::2013-03-01 12:54:10,420::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2013-03-01 12:54:10,421::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2013-03-01 12:54:10,421::task::957::TaskManager.Task::(_decref) Task=`15d91989-8036-4afe-8ecb-3291131d04f9`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 12:54:10,507::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:54:10,508::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-307::DEBUG::2013-03-01 12:54:10,521::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-307::DEBUG::2013-03-01 12:54:10,524::task::568::TaskManager.Task::(_updateState) Task=`58cf4957-50e4-4681-9f8e-c245655650e2`::moving from state init -> state preparing >Thread-307::INFO::2013-03-01 12:54:10,527::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='641da936-3f96-4831-a341-cd57756ebef7', options=None) >Thread-307::DEBUG::2013-03-01 12:54:10,530::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`45c4ce53-07ee-4060-91a2-d98d9755a188`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-105::DEBUG::2013-03-01 12:54:10,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000414494 s, 9.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:54:11,963::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 12:54:19,876::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-307::DEBUG::2013-03-01 12:54:33,340::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-307::DEBUG::2013-03-01 12:54:33,363::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-307::DEBUG::2013-03-01 12:54:33,366::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`45c4ce53-07ee-4060-91a2-d98d9755a188`::Granted request >Thread-307::DEBUG::2013-03-01 12:54:33,372::task::794::TaskManager.Task::(resourceAcquired) Task=`58cf4957-50e4-4681-9f8e-c245655650e2`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-307::DEBUG::2013-03-01 12:54:33,374::task::957::TaskManager.Task::(_decref) Task=`58cf4957-50e4-4681-9f8e-c245655650e2`::ref 1 aborting False >Thread-255::DEBUG::2013-03-01 12:54:33,378::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00033133 s, 12.4 MB/s\n'; <rc> = 0 >Thread-307::DEBUG::2013-03-01 12:54:33,381::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-307::DEBUG::2013-03-01 12:54:33,390::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:33,462::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0751741 s, 13.6 MB/s\n'; <rc> = 0 >Thread-307::DEBUG::2013-03-01 12:54:33,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-307::DEBUG::2013-03-01 12:54:33,593::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-307::INFO::2013-03-01 12:54:33,593::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade volUUID = 641da936-3f96-4831-a341-cd57756ebef7 >Thread-307::DEBUG::2013-03-01 12:54:33,594::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-307::DEBUG::2013-03-01 12:54:33,602::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000279131 s, 1.8 MB/s\n'; <rc> = 0 >Thread-307::DEBUG::2013-03-01 12:54:33,602::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000279131 s, 1.8 MB/s'], size: 512 >Thread-307::DEBUG::2013-03-01 12:54:33,603::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-307::DEBUG::2013-03-01 12:54:33,611::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000312273 s, 1.6 MB/s\n'; <rc> = 0 >Thread-307::DEBUG::2013-03-01 12:54:33,611::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000312273 s, 1.6 MB/s'], size: 512 >Thread-307::DEBUG::2013-03-01 12:54:33,611::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-307::DEBUG::2013-03-01 12:54:33,612::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-307::DEBUG::2013-03-01 12:54:33,801::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-307::DEBUG::2013-03-01 12:54:33,808::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-307::INFO::2013-03-01 12:54:33,808::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-307::INFO::2013-03-01 12:54:33,808::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-307::DEBUG::2013-03-01 12:54:33,809::task::1151::TaskManager.Task::(prepare) Task=`58cf4957-50e4-4681-9f8e-c245655650e2`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-307::DEBUG::2013-03-01 12:54:33,809::task::568::TaskManager.Task::(_updateState) Task=`58cf4957-50e4-4681-9f8e-c245655650e2`::moving from state preparing -> state finished >Thread-307::DEBUG::2013-03-01 12:54:33,809::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-307::DEBUG::2013-03-01 12:54:33,809::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2013-03-01 12:54:33,810::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-307::DEBUG::2013-03-01 12:54:33,810::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-307::DEBUG::2013-03-01 12:54:33,810::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-307::DEBUG::2013-03-01 12:54:33,810::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-307::DEBUG::2013-03-01 12:54:33,811::task::957::TaskManager.Task::(_decref) Task=`58cf4957-50e4-4681-9f8e-c245655650e2`::ref 0 aborting False >Thread-309::DEBUG::2013-03-01 12:54:33,853::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-309::DEBUG::2013-03-01 12:54:33,853::task::568::TaskManager.Task::(_updateState) Task=`a59f34a5-68fd-4d72-98c0-b391d5e774df`::moving from state init -> state preparing >Thread-309::INFO::2013-03-01 12:54:33,854::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-309::INFO::2013-03-01 12:54:33,854::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-309::DEBUG::2013-03-01 12:54:33,854::task::1151::TaskManager.Task::(prepare) Task=`a59f34a5-68fd-4d72-98c0-b391d5e774df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-309::DEBUG::2013-03-01 12:54:33,854::task::568::TaskManager.Task::(_updateState) Task=`a59f34a5-68fd-4d72-98c0-b391d5e774df`::moving from state preparing -> state finished >Thread-309::DEBUG::2013-03-01 12:54:33,854::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-309::DEBUG::2013-03-01 12:54:33,855::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-309::DEBUG::2013-03-01 12:54:33,855::task::957::TaskManager.Task::(_decref) Task=`a59f34a5-68fd-4d72-98c0-b391d5e774df`::ref 0 aborting False >Thread-310::DEBUG::2013-03-01 12:54:33,896::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-310::DEBUG::2013-03-01 12:54:33,896::task::568::TaskManager.Task::(_updateState) Task=`9eaab876-bc4c-4d3e-a7fc-9282339ca2dd`::moving from state init -> state preparing >Thread-310::INFO::2013-03-01 12:54:33,896::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-310::DEBUG::2013-03-01 12:54:33,897::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`11971109-4724-4ddf-b760-a8e157d00368`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-310::DEBUG::2013-03-01 12:54:33,897::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-310::DEBUG::2013-03-01 12:54:33,897::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-310::DEBUG::2013-03-01 12:54:33,897::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`11971109-4724-4ddf-b760-a8e157d00368`::Granted request >Thread-310::DEBUG::2013-03-01 12:54:33,898::task::794::TaskManager.Task::(resourceAcquired) Task=`9eaab876-bc4c-4d3e-a7fc-9282339ca2dd`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-310::DEBUG::2013-03-01 12:54:33,898::task::957::TaskManager.Task::(_decref) Task=`9eaab876-bc4c-4d3e-a7fc-9282339ca2dd`::ref 1 aborting False >Thread-310::INFO::2013-03-01 12:54:33,899::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-310::DEBUG::2013-03-01 12:54:33,899::task::1151::TaskManager.Task::(prepare) Task=`9eaab876-bc4c-4d3e-a7fc-9282339ca2dd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-310::DEBUG::2013-03-01 12:54:33,900::task::568::TaskManager.Task::(_updateState) Task=`9eaab876-bc4c-4d3e-a7fc-9282339ca2dd`::moving from state preparing -> state finished >Thread-310::DEBUG::2013-03-01 12:54:33,900::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-310::DEBUG::2013-03-01 12:54:33,900::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2013-03-01 12:54:33,900::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-310::DEBUG::2013-03-01 12:54:33,900::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-310::DEBUG::2013-03-01 12:54:33,901::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-310::DEBUG::2013-03-01 12:54:33,901::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-310::DEBUG::2013-03-01 12:54:33,901::task::957::TaskManager.Task::(_decref) Task=`9eaab876-bc4c-4d3e-a7fc-9282339ca2dd`::ref 0 aborting False >Thread-311::DEBUG::2013-03-01 12:54:33,941::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-311::DEBUG::2013-03-01 12:54:33,942::task::568::TaskManager.Task::(_updateState) Task=`c2088bd1-0d61-4f2b-8d2b-dae1088cb4ef`::moving from state init -> state preparing >Thread-311::INFO::2013-03-01 12:54:33,942::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='d7b4efff-e846-4e7e-b75c-b4a994301013', spUUID=None, options=None) >Thread-311::DEBUG::2013-03-01 12:54:33,942::taskManager::161::TaskManager::(clearTask) Entry. taskID: d7b4efff-e846-4e7e-b75c-b4a994301013 >Thread-311::DEBUG::2013-03-01 12:54:33,944::taskManager::166::TaskManager::(clearTask) Return. >Thread-311::INFO::2013-03-01 12:54:33,944::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-311::DEBUG::2013-03-01 12:54:33,944::task::1151::TaskManager.Task::(prepare) Task=`c2088bd1-0d61-4f2b-8d2b-dae1088cb4ef`::finished: None >Thread-311::DEBUG::2013-03-01 12:54:33,944::task::568::TaskManager.Task::(_updateState) Task=`c2088bd1-0d61-4f2b-8d2b-dae1088cb4ef`::moving from state preparing -> state finished >Thread-311::DEBUG::2013-03-01 12:54:33,944::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-311::DEBUG::2013-03-01 12:54:33,944::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-311::DEBUG::2013-03-01 12:54:33,945::task::957::TaskManager.Task::(_decref) Task=`c2088bd1-0d61-4f2b-8d2b-dae1088cb4ef`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:54:35,475::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:35,586::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578153 s, 17.7 MB/s\n'; <rc> = 0 >Thread-312::DEBUG::2013-03-01 12:54:36,411::task::568::TaskManager.Task::(_updateState) Task=`52c3e6df-c89a-498e-b1c0-767d5cb94470`::moving from state init -> state preparing >Thread-312::INFO::2013-03-01 12:54:36,411::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-312::INFO::2013-03-01 12:54:36,412::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '13.5048179626', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '22.8332550526', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-312::DEBUG::2013-03-01 12:54:36,412::task::1151::TaskManager.Task::(prepare) Task=`52c3e6df-c89a-498e-b1c0-767d5cb94470`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '13.5048179626', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '22.8332550526', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-312::DEBUG::2013-03-01 12:54:36,412::task::568::TaskManager.Task::(_updateState) Task=`52c3e6df-c89a-498e-b1c0-767d5cb94470`::moving from state preparing -> state finished >Thread-312::DEBUG::2013-03-01 12:54:36,412::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-312::DEBUG::2013-03-01 12:54:36,412::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-312::DEBUG::2013-03-01 12:54:36,413::task::957::TaskManager.Task::(_decref) Task=`52c3e6df-c89a-498e-b1c0-767d5cb94470`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:54:37,600::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:37,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304324 s, 33.6 MB/s\n'; <rc> = 0 >Thread-314::DEBUG::2013-03-01 12:54:38,799::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-314::DEBUG::2013-03-01 12:54:39,171::task::568::TaskManager.Task::(_updateState) Task=`40eeda65-8003-4599-8c1e-e0689a05a06c`::moving from state init -> state preparing >Thread-314::INFO::2013-03-01 12:54:39,171::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='641da936-3f96-4831-a341-cd57756ebef7', options=None) >Thread-314::DEBUG::2013-03-01 12:54:39,172::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`8cc25316-54b7-4760-8902-0036ebafa843`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-314::DEBUG::2013-03-01 12:54:39,172::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-314::DEBUG::2013-03-01 12:54:39,173::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-314::DEBUG::2013-03-01 12:54:39,173::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`8cc25316-54b7-4760-8902-0036ebafa843`::Granted request >Thread-314::DEBUG::2013-03-01 12:54:39,173::task::794::TaskManager.Task::(resourceAcquired) Task=`40eeda65-8003-4599-8c1e-e0689a05a06c`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-314::DEBUG::2013-03-01 12:54:39,174::task::957::TaskManager.Task::(_decref) Task=`40eeda65-8003-4599-8c1e-e0689a05a06c`::ref 1 aborting False >Thread-314::INFO::2013-03-01 12:54:39,174::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade volUUID = 641da936-3f96-4831-a341-cd57756ebef7 >Thread-314::DEBUG::2013-03-01 12:54:39,175::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-314::DEBUG::2013-03-01 12:54:39,185::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000341042 s, 1.5 MB/s\n'; <rc> = 0 >Thread-314::DEBUG::2013-03-01 12:54:39,186::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000341042 s, 1.5 MB/s'], size: 512 >Thread-314::DEBUG::2013-03-01 12:54:39,187::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-314::DEBUG::2013-03-01 12:54:39,196::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000484192 s, 1.1 MB/s\n'; <rc> = 0 >Thread-314::DEBUG::2013-03-01 12:54:39,196::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000484192 s, 1.1 MB/s'], size: 512 >Thread-314::DEBUG::2013-03-01 12:54:39,197::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-314::DEBUG::2013-03-01 12:54:39,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-314::DEBUG::2013-03-01 12:54:39,409::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-314::DEBUG::2013-03-01 12:54:39,416::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-314::INFO::2013-03-01 12:54:39,416::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-314::INFO::2013-03-01 12:54:39,417::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-314::DEBUG::2013-03-01 12:54:39,417::task::1151::TaskManager.Task::(prepare) Task=`40eeda65-8003-4599-8c1e-e0689a05a06c`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-314::DEBUG::2013-03-01 12:54:39,417::task::568::TaskManager.Task::(_updateState) Task=`40eeda65-8003-4599-8c1e-e0689a05a06c`::moving from state preparing -> state finished >Thread-314::DEBUG::2013-03-01 12:54:39,417::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-314::DEBUG::2013-03-01 12:54:39,418::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-314::DEBUG::2013-03-01 12:54:39,418::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-314::DEBUG::2013-03-01 12:54:39,418::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-314::DEBUG::2013-03-01 12:54:39,418::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-314::DEBUG::2013-03-01 12:54:39,418::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-314::DEBUG::2013-03-01 12:54:39,419::task::957::TaskManager.Task::(_decref) Task=`40eeda65-8003-4599-8c1e-e0689a05a06c`::ref 0 aborting False >Thread-315::DEBUG::2013-03-01 12:54:39,644::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-315::DEBUG::2013-03-01 12:54:39,645::task::568::TaskManager.Task::(_updateState) Task=`2cb3c6cd-249f-4222-a04d-1e21cf5f51e0`::moving from state init -> state preparing >Thread-315::INFO::2013-03-01 12:54:39,645::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='641da936-3f96-4831-a341-cd57756ebef7', options=None) >Thread-315::DEBUG::2013-03-01 12:54:39,646::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`abb68038-11b4-4ce3-9468-865842d2dcb8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-315::DEBUG::2013-03-01 12:54:39,646::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-315::DEBUG::2013-03-01 12:54:39,647::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-315::DEBUG::2013-03-01 12:54:39,647::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`abb68038-11b4-4ce3-9468-865842d2dcb8`::Granted request >Thread-315::DEBUG::2013-03-01 12:54:39,648::task::794::TaskManager.Task::(resourceAcquired) Task=`2cb3c6cd-249f-4222-a04d-1e21cf5f51e0`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-315::DEBUG::2013-03-01 12:54:39,648::task::957::TaskManager.Task::(_decref) Task=`2cb3c6cd-249f-4222-a04d-1e21cf5f51e0`::ref 1 aborting False >Thread-315::INFO::2013-03-01 12:54:39,649::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade volUUID = 641da936-3f96-4831-a341-cd57756ebef7 >Thread-315::DEBUG::2013-03-01 12:54:39,649::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-315::DEBUG::2013-03-01 12:54:39,657::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00032292 s, 1.6 MB/s\n'; <rc> = 0 >Thread-315::DEBUG::2013-03-01 12:54:39,658::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00032292 s, 1.6 MB/s'], size: 512 >Thread-315::DEBUG::2013-03-01 12:54:39,658::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-315::DEBUG::2013-03-01 12:54:39,666::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000251713 s, 2.0 MB/s\n'; <rc> = 0 >Thread-315::DEBUG::2013-03-01 12:54:39,667::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000251713 s, 2.0 MB/s'], size: 512 >Thread-315::DEBUG::2013-03-01 12:54:39,667::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-315::DEBUG::2013-03-01 12:54:39,668::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:39,687::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:39,780::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452582 s, 22.6 MB/s\n'; <rc> = 0 >Thread-315::DEBUG::2013-03-01 12:54:39,876::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-315::DEBUG::2013-03-01 12:54:39,882::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-315::INFO::2013-03-01 12:54:39,882::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-315::INFO::2013-03-01 12:54:39,883::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-315::DEBUG::2013-03-01 12:54:39,883::task::1151::TaskManager.Task::(prepare) Task=`2cb3c6cd-249f-4222-a04d-1e21cf5f51e0`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135250', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135250', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '641da936-3f96-4831-a341-cd57756ebef7', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-315::DEBUG::2013-03-01 12:54:39,883::task::568::TaskManager.Task::(_updateState) Task=`2cb3c6cd-249f-4222-a04d-1e21cf5f51e0`::moving from state preparing -> state finished >Thread-315::DEBUG::2013-03-01 12:54:39,883::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-315::DEBUG::2013-03-01 12:54:39,884::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-315::DEBUG::2013-03-01 12:54:39,884::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-315::DEBUG::2013-03-01 12:54:39,884::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-315::DEBUG::2013-03-01 12:54:39,884::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-315::DEBUG::2013-03-01 12:54:39,885::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-315::DEBUG::2013-03-01 12:54:39,885::task::957::TaskManager.Task::(_decref) Task=`2cb3c6cd-249f-4222-a04d-1e21cf5f51e0`::ref 0 aborting False >Thread-317::DEBUG::2013-03-01 12:54:39,918::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-317::DEBUG::2013-03-01 12:54:39,919::task::568::TaskManager.Task::(_updateState) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::moving from state init -> state preparing >Thread-317::INFO::2013-03-01 12:54:39,919::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', desc='', srcImgUUID='e7934077-6752-4445-a00a-1f2551119ade', srcVolUUID='641da936-3f96-4831-a341-cd57756ebef7') >Thread-317::INFO::2013-03-01 12:54:39,920::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-317::DEBUG::2013-03-01 12:54:39,921::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-317::DEBUG::2013-03-01 12:54:40,119::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-317::DEBUG::2013-03-01 12:54:40,120::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-317::DEBUG::2013-03-01 12:54:40,120::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-317::DEBUG::2013-03-01 12:54:40,121::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-317::DEBUG::2013-03-01 12:54:40,121::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-317::DEBUG::2013-03-01 12:54:40,121::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-317::DEBUG::2013-03-01 12:54:40,122::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-317::DEBUG::2013-03-01 12:54:40,341::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-317::DEBUG::2013-03-01 12:54:40,343::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-317::DEBUG::2013-03-01 12:54:40,344::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-317::DEBUG::2013-03-01 12:54:40,346::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5adcc4b5-03d4-419a-a434-99e965ee1341`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-317::DEBUG::2013-03-01 12:54:40,346::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-317::DEBUG::2013-03-01 12:54:40,347::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-317::DEBUG::2013-03-01 12:54:40,347::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5adcc4b5-03d4-419a-a434-99e965ee1341`::Granted request >Thread-317::DEBUG::2013-03-01 12:54:40,349::task::794::TaskManager.Task::(resourceAcquired) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-317::DEBUG::2013-03-01 12:54:40,349::task::957::TaskManager.Task::(_decref) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::ref 1 aborting False >Thread-317::DEBUG::2013-03-01 12:54:40,352::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >Thread-317::DEBUG::2013-03-01 12:54:40,360::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 >Thread-317::INFO::2013-03-01 12:54:40,361::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-317::DEBUG::2013-03-01 12:54:40,361::task::1146::TaskManager.Task::(prepare) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::Prepare: 1 jobs exist, move to acquiring >Thread-317::DEBUG::2013-03-01 12:54:40,361::task::568::TaskManager.Task::(_updateState) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::moving from state preparing -> state acquiring >Thread-317::DEBUG::2013-03-01 12:54:40,362::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >Thread-317::DEBUG::2013-03-01 12:54:40,371::task::568::TaskManager.Task::(_updateState) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::moving from state acquiring -> state queued >Thread-317::DEBUG::2013-03-01 12:54:40,372::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >Thread-317::DEBUG::2013-03-01 12:54:40,380::taskManager::50::TaskManager::(_queueTask) queuing task: 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 >d7b4efff-e846-4e7e-b75c-b4a994301013::DEBUG::2013-03-01 12:54:40,381::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,381::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c012e368>> with: None >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,381::task::1159::TaskManager.Task::(commit) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::committing task: 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,382::task::568::TaskManager.Task::(_updateState) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::moving from state queued -> state running >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,383::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >Thread-317::DEBUG::2013-03-01 12:54:40,384::taskManager::56::TaskManager::(_queueTask) task queued: 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 >Thread-317::DEBUG::2013-03-01 12:54:40,384::task::1148::TaskManager.Task::(prepare) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::returning >Thread-317::DEBUG::2013-03-01 12:54:40,385::task::957::TaskManager.Task::(_decref) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::ref 1 aborting False >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,393::task::872::TaskManager.Task::(_runJobs) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'e7934077-6752-4445-a00a-1f2551119ade', 12582912, 4, 2, 2, '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7') kwargs: {}) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,393::task::304::TaskManager.Task::(run) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'e7934077-6752-4445-a00a-1f2551119ade', 12582912, 4, 2, 2, '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7') kwargs: {}) callback None >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,394::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`9ff9e76b-e463-4e61-bab3-c5f04da18a79`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,395::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' for lock type 'exclusive' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,395::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,397::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,600::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,606::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,607::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,615::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297921 s, 1.7 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,616::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297921 s, 1.7 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,616::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,624::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299032 s, 1.7 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,625::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299032 s, 1.7 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::INFO::2013-03-01 12:54:40,625::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec1183d0>] >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,625::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`bed4f004-34f5-4567-82ad-f13d2e33e356`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,626::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'exclusive' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,626::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'exclusive' (1 active user) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,626::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`bed4f004-34f5-4567-82ad-f13d2e33e356`::Granted request >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,627::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free. Now locking as 'exclusive' (1 active user) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,627::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`9ff9e76b-e463-4e61-bab3-c5f04da18a79`::Granted request >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,628::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,628::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,819::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::WARNING::2013-03-01 12:54:40,819::lvm::593::Storage.LVM::(getLv) lv: 07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,821::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,831::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000310175 s, 1.7 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,831::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000310175 s, 1.7 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,832::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,841::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031786 s, 1.6 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,842::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031786 s, 1.6 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::INFO::2013-03-01 12:54:40,842::volume::457::Storage.Volume::(create) Creating volume 07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,843::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,852::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:40,888::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:41,798::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:43,113::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.416192 s, 2.5 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:54:43,407::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:54:43,418::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:54:43,462::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000263794 s, 15.5 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:54:43,903::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000362822 s, 11.3 MB/s\n'; <rc> = 0 >Thread-319::DEBUG::2013-03-01 12:54:43,940::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-319::DEBUG::2013-03-01 12:54:43,941::task::568::TaskManager.Task::(_updateState) Task=`d2a3f7e8-909e-4b9e-9b9e-ab5131fbe2e6`::moving from state init -> state preparing >Thread-319::INFO::2013-03-01 12:54:43,941::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-319::INFO::2013-03-01 12:54:43,941::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-319::DEBUG::2013-03-01 12:54:43,942::task::1151::TaskManager.Task::(prepare) Task=`d2a3f7e8-909e-4b9e-9b9e-ab5131fbe2e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-319::DEBUG::2013-03-01 12:54:43,942::task::568::TaskManager.Task::(_updateState) Task=`d2a3f7e8-909e-4b9e-9b9e-ab5131fbe2e6`::moving from state preparing -> state finished >Thread-319::DEBUG::2013-03-01 12:54:43,942::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-319::DEBUG::2013-03-01 12:54:43,942::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-319::DEBUG::2013-03-01 12:54:43,942::task::957::TaskManager.Task::(_decref) Task=`d2a3f7e8-909e-4b9e-9b9e-ab5131fbe2e6`::ref 0 aborting False >Thread-320::DEBUG::2013-03-01 12:54:43,967::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-320::DEBUG::2013-03-01 12:54:43,968::task::568::TaskManager.Task::(_updateState) Task=`d3d1c2ad-d1ae-4278-b152-7e70d3b0042d`::moving from state init -> state preparing >Thread-320::INFO::2013-03-01 12:54:43,968::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-320::DEBUG::2013-03-01 12:54:43,968::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`70023088-db28-4bc3-ad01-e0e964184e11`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-320::DEBUG::2013-03-01 12:54:43,968::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-320::DEBUG::2013-03-01 12:54:43,969::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-320::DEBUG::2013-03-01 12:54:43,969::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`70023088-db28-4bc3-ad01-e0e964184e11`::Granted request >Thread-320::DEBUG::2013-03-01 12:54:43,969::task::794::TaskManager.Task::(resourceAcquired) Task=`d3d1c2ad-d1ae-4278-b152-7e70d3b0042d`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-320::DEBUG::2013-03-01 12:54:43,970::task::957::TaskManager.Task::(_decref) Task=`d3d1c2ad-d1ae-4278-b152-7e70d3b0042d`::ref 1 aborting False >Thread-320::INFO::2013-03-01 12:54:43,971::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-320::DEBUG::2013-03-01 12:54:43,971::task::1151::TaskManager.Task::(prepare) Task=`d3d1c2ad-d1ae-4278-b152-7e70d3b0042d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-320::DEBUG::2013-03-01 12:54:43,971::task::568::TaskManager.Task::(_updateState) Task=`d3d1c2ad-d1ae-4278-b152-7e70d3b0042d`::moving from state preparing -> state finished >Thread-320::DEBUG::2013-03-01 12:54:43,971::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-320::DEBUG::2013-03-01 12:54:43,971::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-320::DEBUG::2013-03-01 12:54:43,972::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-320::DEBUG::2013-03-01 12:54:43,972::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-320::DEBUG::2013-03-01 12:54:43,972::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-320::DEBUG::2013-03-01 12:54:43,972::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-320::DEBUG::2013-03-01 12:54:43,973::task::957::TaskManager.Task::(_decref) Task=`d3d1c2ad-d1ae-4278-b152-7e70d3b0042d`::ref 0 aborting False >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,824::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,825::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,826::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,826::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,826::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::INFO::2013-03-01 12:54:44,827::blockVolume::182::Storage.Volume::(_create) Request to create snapshot e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 of volume e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,828::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,838::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,848::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299333 s, 1.7 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,849::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299333 s, 1.7 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,849::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,859::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297473 s, 1.7 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,859::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297473 s, 1.7 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::INFO::2013-03-01 12:54:44,861::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,862::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,870::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000295427 s, 1.7 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,870::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000295427 s, 1.7 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,871::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`9ec8bd00-3096-411f-91bf-f4287e7ecc8b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,871::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:44,872::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:45,287::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:45,367::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346553 s, 29.5 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,294::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,295::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,301::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,302::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,302::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`9ec8bd00-3096-411f-91bf-f4287e7ecc8b`::Granted request >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,303::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,304::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,504::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,513::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,514::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,514::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,524::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319932 s, 1.6 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,525::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319932 s, 1.6 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,536::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311468 s, 1.6 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,537::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311468 s, 1.6 MB/s'], size: 512 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,538::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,552::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::INFO::2013-03-01 12:54:46,553::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 justme False >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,553::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,553::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,554::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,555::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,816::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,816::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,817::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,817::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,818::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:46,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,034::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,041::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,041::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,042::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,248::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,255::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::WARNING::2013-03-01 12:54:47,255::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,257::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 5 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,257::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_e7934077-6752-4445-a00a-1f2551119ade --addtag MD_5 --addtag PU_641da936-3f96-4831-a341-cd57756ebef7 a558fc2a-a4a3-4118-9b81-d1d601eaa295/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:47,382::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,478::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,480::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Dummy-173::DEBUG::2013-03-01 12:54:47,484::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039125 s, 26.2 MB/s\n'; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,487::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,492::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (cwd None) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,756::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,756::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,757::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,766::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 5) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,772::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,778::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,778::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' (0 active users) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,779::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free, finding out if anyone is waiting for it. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,779::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,779::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,780::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,780::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,780::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade', Clearing records. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,780::task::568::TaskManager.Task::(_updateState) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::moving from state running -> state finished >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,781::task::719::TaskManager.Task::(_save) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9a4d643b-5c11-4434-a9bc-fd7ce8f41b56.temp >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,787::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,788::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,788::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,788::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,788::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,789::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,789::task::880::TaskManager.Task::(_runJobs) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::Task.run: exit - success: result {'uuid': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97'} >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,789::task::957::TaskManager.Task::(_decref) Task=`9a4d643b-5c11-4434-a9bc-fd7ce8f41b56`::ref 0 aborting False >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:54:47,789::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:54:49,511::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:49,606::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433514 s, 23.6 MB/s\n'; <rc> = 0 >Thread-323::DEBUG::2013-03-01 12:54:50,466::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-323::DEBUG::2013-03-01 12:54:50,885::task::568::TaskManager.Task::(_updateState) Task=`be0b2acf-c46b-494d-9e84-e2c081fe0dfa`::moving from state init -> state preparing >Thread-323::INFO::2013-03-01 12:54:50,886::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-323::DEBUG::2013-03-01 12:54:50,886::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-323::DEBUG::2013-03-01 12:54:50,886::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 >Thread-323::DEBUG::2013-03-01 12:54:50,886::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a4d643b-5c11-4434-a9bc-fd7ce8f41b56'} >Thread-323::DEBUG::2013-03-01 12:54:50,886::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a4d643b-5c11-4434-a9bc-fd7ce8f41b56': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a4d643b-5c11-4434-a9bc-fd7ce8f41b56'}} >Thread-323::INFO::2013-03-01 12:54:50,887::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a4d643b-5c11-4434-a9bc-fd7ce8f41b56': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a4d643b-5c11-4434-a9bc-fd7ce8f41b56'}}} >Thread-323::DEBUG::2013-03-01 12:54:50,887::task::1151::TaskManager.Task::(prepare) Task=`be0b2acf-c46b-494d-9e84-e2c081fe0dfa`::finished: {'allTasksStatus': {'9a4d643b-5c11-4434-a9bc-fd7ce8f41b56': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a4d643b-5c11-4434-a9bc-fd7ce8f41b56'}}} >Thread-323::DEBUG::2013-03-01 12:54:50,887::task::568::TaskManager.Task::(_updateState) Task=`be0b2acf-c46b-494d-9e84-e2c081fe0dfa`::moving from state preparing -> state finished >Thread-323::DEBUG::2013-03-01 12:54:50,888::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2013-03-01 12:54:50,888::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2013-03-01 12:54:50,888::task::957::TaskManager.Task::(_decref) Task=`be0b2acf-c46b-494d-9e84-e2c081fe0dfa`::ref 0 aborting False >Thread-324::DEBUG::2013-03-01 12:54:50,971::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-324::DEBUG::2013-03-01 12:54:50,972::task::568::TaskManager.Task::(_updateState) Task=`7e849345-e549-4841-bbc9-ad0ebe9592df`::moving from state init -> state preparing >Thread-324::INFO::2013-03-01 12:54:50,972::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', options=None) >Thread-324::DEBUG::2013-03-01 12:54:50,972::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`83a8a7a1-bf64-4376-bfde-4cde53a89cb1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-324::DEBUG::2013-03-01 12:54:50,973::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-324::DEBUG::2013-03-01 12:54:50,973::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-324::DEBUG::2013-03-01 12:54:50,973::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`83a8a7a1-bf64-4376-bfde-4cde53a89cb1`::Granted request >Thread-324::DEBUG::2013-03-01 12:54:50,974::task::794::TaskManager.Task::(resourceAcquired) Task=`7e849345-e549-4841-bbc9-ad0ebe9592df`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-324::DEBUG::2013-03-01 12:54:50,974::task::957::TaskManager.Task::(_decref) Task=`7e849345-e549-4841-bbc9-ad0ebe9592df`::ref 1 aborting False >Thread-324::DEBUG::2013-03-01 12:54:50,975::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 12:54:50,975::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:54:51,623::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-325::DEBUG::2013-03-01 12:54:52,002::task::568::TaskManager.Task::(_updateState) Task=`ad972f64-57f8-4071-be8f-cbd609a20b90`::moving from state init -> state preparing >Thread-255::DEBUG::2013-03-01 12:54:53,901::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:54:53,910::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-325::INFO::2013-03-01 12:55:23,302::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-325::INFO::2013-03-01 12:55:23,316::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.509536981583', 'lastCheck': '39.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.505439996719', 'lastCheck': '39.4', 'code': 0, 'valid': True}} >Thread-325::DEBUG::2013-03-01 12:55:23,320::task::1151::TaskManager.Task::(prepare) Task=`ad972f64-57f8-4071-be8f-cbd609a20b90`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.509536981583', 'lastCheck': '39.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.505439996719', 'lastCheck': '39.4', 'code': 0, 'valid': True}} >Thread-325::DEBUG::2013-03-01 12:55:23,324::task::568::TaskManager.Task::(_updateState) Task=`ad972f64-57f8-4071-be8f-cbd609a20b90`::moving from state preparing -> state finished >Thread-324::DEBUG::2013-03-01 12:55:23,324::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 12:55:23,327::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-105::DEBUG::2013-03-01 12:55:23,330::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-325::DEBUG::2013-03-01 12:55:23,330::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-255::DEBUG::2013-03-01 12:55:23,341::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000324131 s, 12.6 MB/s\n'; <rc> = 0 >Thread-325::DEBUG::2013-03-01 12:55:23,343::task::957::TaskManager.Task::(_decref) Task=`ad972f64-57f8-4071-be8f-cbd609a20b90`::ref 0 aborting False >Thread-324::INFO::2013-03-01 12:55:23,372::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade volUUID = 07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 >Thread-324::DEBUG::2013-03-01 12:55:23,375::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-324::DEBUG::2013-03-01 12:55:23,397::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000292258 s, 1.8 MB/s\n'; <rc> = 0 >Thread-324::DEBUG::2013-03-01 12:55:23,399::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000292258 s, 1.8 MB/s'], size: 512 >Thread-324::DEBUG::2013-03-01 12:55:23,404::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-324::DEBUG::2013-03-01 12:55:23,421::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319437 s, 1.6 MB/s\n'; <rc> = 0 >Thread-324::DEBUG::2013-03-01 12:55:23,422::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319437 s, 1.6 MB/s'], size: 512 >Thread-324::DEBUG::2013-03-01 12:55:23,424::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-324::DEBUG::2013-03-01 12:55:23,429::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:55:23,498::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160938 s, 6.4 MB/s\n'; <rc> = 0 >Thread-324::DEBUG::2013-03-01 12:55:23,621::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-324::INFO::2013-03-01 12:55:23,628::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '641da936-3f96-4831-a341-cd57756ebef7', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135287', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135287', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-324::INFO::2013-03-01 12:55:23,628::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '641da936-3f96-4831-a341-cd57756ebef7', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135287', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135287', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-324::DEBUG::2013-03-01 12:55:23,629::task::1151::TaskManager.Task::(prepare) Task=`7e849345-e549-4841-bbc9-ad0ebe9592df`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '641da936-3f96-4831-a341-cd57756ebef7', 'format': 'COW', 'image': 'e7934077-6752-4445-a00a-1f2551119ade', 'ctime': '1362135287', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135287', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-324::DEBUG::2013-03-01 12:55:23,629::task::568::TaskManager.Task::(_updateState) Task=`7e849345-e549-4841-bbc9-ad0ebe9592df`::moving from state preparing -> state finished >Thread-324::DEBUG::2013-03-01 12:55:23,629::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-324::DEBUG::2013-03-01 12:55:23,629::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-324::DEBUG::2013-03-01 12:55:23,630::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-324::DEBUG::2013-03-01 12:55:23,630::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-324::DEBUG::2013-03-01 12:55:23,631::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-324::DEBUG::2013-03-01 12:55:23,631::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-324::DEBUG::2013-03-01 12:55:23,631::task::957::TaskManager.Task::(_decref) Task=`7e849345-e549-4841-bbc9-ad0ebe9592df`::ref 0 aborting False >Thread-327::DEBUG::2013-03-01 12:55:23,679::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-327::DEBUG::2013-03-01 12:55:23,680::task::568::TaskManager.Task::(_updateState) Task=`298c0018-a459-4b3a-8641-23a336c0cfeb`::moving from state init -> state preparing >Thread-327::INFO::2013-03-01 12:55:23,681::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-327::INFO::2013-03-01 12:55:23,681::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-327::DEBUG::2013-03-01 12:55:23,681::task::1151::TaskManager.Task::(prepare) Task=`298c0018-a459-4b3a-8641-23a336c0cfeb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-327::DEBUG::2013-03-01 12:55:23,682::task::568::TaskManager.Task::(_updateState) Task=`298c0018-a459-4b3a-8641-23a336c0cfeb`::moving from state preparing -> state finished >Thread-327::DEBUG::2013-03-01 12:55:23,682::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-327::DEBUG::2013-03-01 12:55:23,682::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-327::DEBUG::2013-03-01 12:55:23,683::task::957::TaskManager.Task::(_decref) Task=`298c0018-a459-4b3a-8641-23a336c0cfeb`::ref 0 aborting False >Thread-328::DEBUG::2013-03-01 12:55:23,718::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-328::DEBUG::2013-03-01 12:55:23,719::task::568::TaskManager.Task::(_updateState) Task=`55650a88-2479-46e5-bf09-6185ea62c37c`::moving from state init -> state preparing >Thread-328::INFO::2013-03-01 12:55:23,719::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-328::DEBUG::2013-03-01 12:55:23,719::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`d48e6410-1c40-467e-889d-c7bf1e541c4f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-328::DEBUG::2013-03-01 12:55:23,720::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-328::DEBUG::2013-03-01 12:55:23,720::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-328::DEBUG::2013-03-01 12:55:23,720::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`d48e6410-1c40-467e-889d-c7bf1e541c4f`::Granted request >Thread-328::DEBUG::2013-03-01 12:55:23,721::task::794::TaskManager.Task::(resourceAcquired) Task=`55650a88-2479-46e5-bf09-6185ea62c37c`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-328::DEBUG::2013-03-01 12:55:23,721::task::957::TaskManager.Task::(_decref) Task=`55650a88-2479-46e5-bf09-6185ea62c37c`::ref 1 aborting False >Thread-328::DEBUG::2013-03-01 12:55:23,721::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-328::DEBUG::2013-03-01 12:55:23,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:55:25,506::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:55:25,590::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036742 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:55:27,604::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:55:27,684::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330137 s, 31.0 MB/s\n'; <rc> = 0 >Thread-328::DEBUG::2013-03-01 12:55:28,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-328::INFO::2013-03-01 12:55:28,758::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-328::DEBUG::2013-03-01 12:55:28,758::task::1151::TaskManager.Task::(prepare) Task=`55650a88-2479-46e5-bf09-6185ea62c37c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '48049946624', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-328::DEBUG::2013-03-01 12:55:28,759::task::568::TaskManager.Task::(_updateState) Task=`55650a88-2479-46e5-bf09-6185ea62c37c`::moving from state preparing -> state finished >Thread-328::DEBUG::2013-03-01 12:55:28,759::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-328::DEBUG::2013-03-01 12:55:28,759::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-328::DEBUG::2013-03-01 12:55:28,760::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-328::DEBUG::2013-03-01 12:55:28,760::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-328::DEBUG::2013-03-01 12:55:28,761::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-328::DEBUG::2013-03-01 12:55:28,761::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-328::DEBUG::2013-03-01 12:55:28,761::task::957::TaskManager.Task::(_decref) Task=`55650a88-2479-46e5-bf09-6185ea62c37c`::ref 0 aborting False >Thread-330::DEBUG::2013-03-01 12:55:28,807::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-330::DEBUG::2013-03-01 12:55:28,807::task::568::TaskManager.Task::(_updateState) Task=`499b8feb-b6fa-425d-91ca-d1fd66015972`::moving from state init -> state preparing >Thread-330::INFO::2013-03-01 12:55:28,808::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='9a4d643b-5c11-4434-a9bc-fd7ce8f41b56', spUUID=None, options=None) >Thread-330::DEBUG::2013-03-01 12:55:28,808::taskManager::161::TaskManager::(clearTask) Entry. taskID: 9a4d643b-5c11-4434-a9bc-fd7ce8f41b56 >Thread-330::DEBUG::2013-03-01 12:55:28,810::taskManager::166::TaskManager::(clearTask) Return. >Thread-330::INFO::2013-03-01 12:55:28,810::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-330::DEBUG::2013-03-01 12:55:28,810::task::1151::TaskManager.Task::(prepare) Task=`499b8feb-b6fa-425d-91ca-d1fd66015972`::finished: None >Thread-330::DEBUG::2013-03-01 12:55:28,810::task::568::TaskManager.Task::(_updateState) Task=`499b8feb-b6fa-425d-91ca-d1fd66015972`::moving from state preparing -> state finished >Thread-330::DEBUG::2013-03-01 12:55:28,811::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-330::DEBUG::2013-03-01 12:55:28,811::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-330::DEBUG::2013-03-01 12:55:28,811::task::957::TaskManager.Task::(_decref) Task=`499b8feb-b6fa-425d-91ca-d1fd66015972`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 12:55:28,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:55:28,856::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:55:28,857::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:55:28,866::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000420045 s, 9.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:55:29,697::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:55:29,785::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283651 s, 36.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:55:31,805::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 12:55:33,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:55:34,557::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-105::DEBUG::2013-03-01 12:55:38,871::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:01,358::task::568::TaskManager.Task::(_updateState) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::moving from state init -> state preparing >Thread-333::INFO::2013-03-01 12:56:01,364::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='e7934077-6752-4445-a00a-1f2551119ade', srcVolUUID='641da936-3f96-4831-a341-cd57756ebef7', dstImgUUID='7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', dstVolUUID='bbf96708-e473-4fa7-aa32-4a6415528e14', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-333::INFO::2013-03-01 12:56:01,369::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-255::DEBUG::2013-03-01 12:56:01,376::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000293421 s, 14.0 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:01,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:01,401::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000361266 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:01,508::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126164 s, 8.1 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:01,617::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:01,617::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,623::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,623::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,623::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,623::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,624::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:01,826::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:01,827::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,827::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-333::DEBUG::2013-03-01 12:56:01,828::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:01,829::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,011::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,019::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-333::INFO::2013-03-01 12:56:02,020::image::458::Storage.Image::(isLegal) image e7934077-6752-4445-a00a-1f2551119ade in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', '641da936-3f96-4831-a341-cd57756ebef7'] >Thread-333::DEBUG::2013-03-01 12:56:02,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,029::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000322223 s, 1.6 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,029::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000322223 s, 1.6 MB/s'], size: 512 >Thread-333::DEBUG::2013-03-01 12:56:02,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,038::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000384936 s, 1.3 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,038::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000384936 s, 1.3 MB/s'], size: 512 >Thread-333::DEBUG::2013-03-01 12:56:02,039::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,046::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000305684 s, 1.7 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,047::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000305684 s, 1.7 MB/s'], size: 512 >Thread-333::DEBUG::2013-03-01 12:56:02,047::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,055::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000353775 s, 1.4 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,056::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000353775 s, 1.4 MB/s'], size: 512 >Thread-333::DEBUG::2013-03-01 12:56:02,056::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:02,057::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,236::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,243::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-333::DEBUG::2013-03-01 12:56:02,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,252::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000321421 s, 1.6 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,252::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000321421 s, 1.6 MB/s'], size: 512 >Thread-333::DEBUG::2013-03-01 12:56:02,253::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-333::DEBUG::2013-03-01 12:56:02,261::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000293401 s, 1.7 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2013-03-01 12:56:02,262::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000293401 s, 1.7 MB/s'], size: 512 >Thread-333::INFO::2013-03-01 12:56:02,262::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec132e90>, <storage.blockVolume.BlockVolume object at 0x7f15e00c2c10>] >Thread-333::DEBUG::2013-03-01 12:56:02,263::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`297bd147-b0ee-4359-b125-2f0e2c94ccc2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-333::DEBUG::2013-03-01 12:56:02,263::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-333::DEBUG::2013-03-01 12:56:02,263::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-333::DEBUG::2013-03-01 12:56:02,263::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`297bd147-b0ee-4359-b125-2f0e2c94ccc2`::Granted request >Thread-333::DEBUG::2013-03-01 12:56:02,264::task::794::TaskManager.Task::(resourceAcquired) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-333::DEBUG::2013-03-01 12:56:02,264::task::957::TaskManager.Task::(_decref) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::ref 1 aborting False >Thread-333::DEBUG::2013-03-01 12:56:02,265::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >Thread-333::DEBUG::2013-03-01 12:56:02,270::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e for task 84446d15-a7a9-4363-84b5-e3312a48a061 >Thread-333::INFO::2013-03-01 12:56:02,271::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-333::DEBUG::2013-03-01 12:56:02,271::task::1146::TaskManager.Task::(prepare) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::Prepare: 1 jobs exist, move to acquiring >Thread-333::DEBUG::2013-03-01 12:56:02,271::task::568::TaskManager.Task::(_updateState) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::moving from state preparing -> state acquiring >Thread-333::DEBUG::2013-03-01 12:56:02,271::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >Thread-333::DEBUG::2013-03-01 12:56:02,277::task::568::TaskManager.Task::(_updateState) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::moving from state acquiring -> state queued >Thread-333::DEBUG::2013-03-01 12:56:02,277::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >Thread-333::DEBUG::2013-03-01 12:56:02,283::taskManager::50::TaskManager::(_queueTask) queuing task: 84446d15-a7a9-4363-84b5-e3312a48a061 >Thread-333::DEBUG::2013-03-01 12:56:02,283::taskManager::56::TaskManager::(_queueTask) task queued: 84446d15-a7a9-4363-84b5-e3312a48a061 >9a4d643b-5c11-4434-a9bc-fd7ce8f41b56::DEBUG::2013-03-01 12:56:02,283::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-333::DEBUG::2013-03-01 12:56:02,284::task::1148::TaskManager.Task::(prepare) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::returning >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,284::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 84446d15-a7a9-4363-84b5-e3312a48a061 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c026c4d0>> with: None >Thread-333::DEBUG::2013-03-01 12:56:02,285::task::957::TaskManager.Task::(_decref) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::ref 0 aborting False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,285::task::1159::TaskManager.Task::(commit) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::committing task: 84446d15-a7a9-4363-84b5-e3312a48a061 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,287::task::568::TaskManager.Task::(_updateState) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::moving from state queued -> state running >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,288::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,294::task::872::TaskManager.Task::(_runJobs) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::Task.run: running job 0: copyImage_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7', '7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', 'bbf96708-e473-4fa7-aa32-4a6415528e14', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,294::task::304::TaskManager.Task::(run) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::Job.run: running copyImage_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7', '7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', 'bbf96708-e473-4fa7-aa32-4a6415528e14', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,296::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`5cbc9b9c-e9fe-4722-aceb-337123a6202f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,297::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' for lock type 'shared' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,297::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,298::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-334::DEBUG::2013-03-01 12:56:02,320::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-334::DEBUG::2013-03-01 12:56:02,321::task::568::TaskManager.Task::(_updateState) Task=`c7d4809a-1549-4c6a-a039-68d000bbdf48`::moving from state init -> state preparing >Thread-334::INFO::2013-03-01 12:56:02,322::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-334::INFO::2013-03-01 12:56:02,322::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-334::DEBUG::2013-03-01 12:56:02,322::task::1151::TaskManager.Task::(prepare) Task=`c7d4809a-1549-4c6a-a039-68d000bbdf48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-334::DEBUG::2013-03-01 12:56:02,323::task::568::TaskManager.Task::(_updateState) Task=`c7d4809a-1549-4c6a-a039-68d000bbdf48`::moving from state preparing -> state finished >Thread-334::DEBUG::2013-03-01 12:56:02,323::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-334::DEBUG::2013-03-01 12:56:02,323::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-334::DEBUG::2013-03-01 12:56:02,324::task::957::TaskManager.Task::(_decref) Task=`c7d4809a-1549-4c6a-a039-68d000bbdf48`::ref 0 aborting False >Thread-335::DEBUG::2013-03-01 12:56:02,393::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-335::DEBUG::2013-03-01 12:56:02,393::task::568::TaskManager.Task::(_updateState) Task=`db0c26f4-9c0d-4250-a7d4-c6b579fa4119`::moving from state init -> state preparing >Thread-335::INFO::2013-03-01 12:56:02,393::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-335::DEBUG::2013-03-01 12:56:02,394::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`76632158-f4b2-4a5c-863f-f1ce0c1020e0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-335::DEBUG::2013-03-01 12:56:02,394::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-335::DEBUG::2013-03-01 12:56:02,395::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-335::DEBUG::2013-03-01 12:56:02,395::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`76632158-f4b2-4a5c-863f-f1ce0c1020e0`::Granted request >Thread-335::DEBUG::2013-03-01 12:56:02,396::task::794::TaskManager.Task::(resourceAcquired) Task=`db0c26f4-9c0d-4250-a7d4-c6b579fa4119`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-335::DEBUG::2013-03-01 12:56:02,396::task::957::TaskManager.Task::(_decref) Task=`db0c26f4-9c0d-4250-a7d4-c6b579fa4119`::ref 1 aborting False >Thread-335::INFO::2013-03-01 12:56:02,398::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '46976204800', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-335::DEBUG::2013-03-01 12:56:02,398::task::1151::TaskManager.Task::(prepare) Task=`db0c26f4-9c0d-4250-a7d4-c6b579fa4119`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '46976204800', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-335::DEBUG::2013-03-01 12:56:02,398::task::568::TaskManager.Task::(_updateState) Task=`db0c26f4-9c0d-4250-a7d4-c6b579fa4119`::moving from state preparing -> state finished >Thread-335::DEBUG::2013-03-01 12:56:02,398::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-335::DEBUG::2013-03-01 12:56:02,399::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-335::DEBUG::2013-03-01 12:56:02,399::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-335::DEBUG::2013-03-01 12:56:02,399::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-335::DEBUG::2013-03-01 12:56:02,400::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-335::DEBUG::2013-03-01 12:56:02,400::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-335::DEBUG::2013-03-01 12:56:02,400::task::957::TaskManager.Task::(_decref) Task=`db0c26f4-9c0d-4250-a7d4-c6b579fa4119`::ref 0 aborting False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,542::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,551::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,562::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000304524 s, 1.7 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,563::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000304524 s, 1.7 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,574::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000350897 s, 1.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,574::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000350897 s, 1.5 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:02,575::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15e00c0110>, <storage.blockVolume.BlockVolume object at 0x7f15e00c0490>] >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,576::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97`ReqID=`17d7ed52-683b-4c10-b8a9-d84af933f36d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,576::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' for lock type 'shared' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,576::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' is free. Now locking as 'shared' (1 active user) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,576::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97`ReqID=`17d7ed52-683b-4c10-b8a9-d84af933f36d`::Granted request >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,577::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`6a340f10-22c2-4b92-a20b-0e0c29c0b85c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,578::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,578::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,578::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`6a340f10-22c2-4b92-a20b-0e0c29c0b85c`::Granted request >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,579::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free. Now locking as 'shared' (1 active user) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,579::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`5cbc9b9c-e9fe-4722-aceb-337123a6202f`::Granted request >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,580::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e`ReqID=`069c92de-199c-434b-bc4e-fc2c629b9ef4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,580::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' for lock type 'exclusive' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,581::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,827::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,835::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,836::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,836::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' is free. Now locking as 'exclusive' (1 active user) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,836::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e`ReqID=`069c92de-199c-434b-bc4e-fc2c629b9ef4`::Granted request >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:02,837::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=e7934077-6752-4445-a00a-1f2551119ade srcVolUUID=641da936-3f96-4831-a341-cd57756ebef7 dstImgUUID=7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e dstVolUUID=bbf96708-e473-4fa7-aa32-4a6415528e14 dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,838::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,847::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000331257 s, 1.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,847::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000331257 s, 1.5 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,857::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00030006 s, 1.7 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,858::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00030006 s, 1.7 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,868::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000288363 s, 1.8 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,868::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000288363 s, 1.8 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,869::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339347 s, 1.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,879::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339347 s, 1.5 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,880::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,890::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000325595 s, 1.6 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,890::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000325595 s, 1.6 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,891::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,900::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000305332 s, 1.7 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,901::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000305332 s, 1.7 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:02,901::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:e7934077-6752-4445-a00a-1f2551119ade:641da936-3f96-4831-a341-cd57756ebef7 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e:bbf96708-e473-4fa7-aa32-4a6415528e14 apparentsize 2097152 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,902::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:02,903::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,149::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,158::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:03,158::image::458::Storage.Image::(isLegal) image 7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:03,159::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e for image's volumes >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,160::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,169::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,170::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,417::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,425::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::WARNING::2013-03-01 12:56:03,425::lvm::593::Storage.LVM::(getLv) lv: bbf96708-e473-4fa7-aa32-4a6415528e14 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:03,427::volume::457::Storage.Volume::(create) Creating volume bbf96708-e473-4fa7-aa32-4a6415528e14 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,428::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,438::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:03,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name bbf96708-e473-4fa7-aa32-4a6415528e14 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:03,522::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:03,682::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399653 s, 25.6 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,148::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,149::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,149::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,150::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,150::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:05,151::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14 with size = 20480 sectors >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14 10240K' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,164::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,165::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,380::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,393::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::WARNING::2013-03-01 12:56:05,393::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,394::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 6 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,395::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_6 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,608::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,609::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,610::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,611::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:05,698::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:05,790::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0445836 s, 23.0 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,844::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,844::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,845::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,846::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,859::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=bbf96708-e473-4fa7-aa32-4a6415528e14 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 6) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,865::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,874::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:05,875::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,121::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,132::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:06,132::blockVolume::280::Storage.Volume::(extend) Request to extend LV bbf96708-e473-4fa7-aa32-4a6415528e14 of image 7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,133::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,366::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,422::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,423::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,433::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000317137 s, 1.6 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,433::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000317137 s, 1.6 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:06,434::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,435::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,444::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000376436 s, 1.4 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,445::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000376436 s, 1.4 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,446::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`e60fb7f2-d0aa-4133-8a58-43705f33a316`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,446::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:06,447::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >Thread-337::DEBUG::2013-03-01 12:56:07,398::task::568::TaskManager.Task::(_updateState) Task=`9c88028e-8361-493d-b8a5-1fc3758cda70`::moving from state init -> state preparing >Thread-337::INFO::2013-03-01 12:56:07,398::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-337::INFO::2013-03-01 12:56:07,399::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '28.0267288685', 'lastCheck': '6.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '22.532269001', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-337::DEBUG::2013-03-01 12:56:07,399::task::1151::TaskManager.Task::(prepare) Task=`9c88028e-8361-493d-b8a5-1fc3758cda70`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '28.0267288685', 'lastCheck': '6.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '22.532269001', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-337::DEBUG::2013-03-01 12:56:07,399::task::568::TaskManager.Task::(_updateState) Task=`9c88028e-8361-493d-b8a5-1fc3758cda70`::moving from state preparing -> state finished >Thread-337::DEBUG::2013-03-01 12:56:07,399::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-337::DEBUG::2013-03-01 12:56:07,399::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-337::DEBUG::2013-03-01 12:56:07,400::task::957::TaskManager.Task::(_decref) Task=`9c88028e-8361-493d-b8a5-1fc3758cda70`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:56:07,804::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:07,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347134 s, 29.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,325::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,325::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,325::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,326::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,326::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`e60fb7f2-d0aa-4133-8a58-43705f33a316`::Granted request >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,326::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,327::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,573::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,583::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:08,583::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,583::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,593::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339042 s, 1.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,593::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339042 s, 1.5 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,594::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,603::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327893 s, 1.6 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,604::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327893 s, 1.6 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,605::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14`ReqID=`2929300b-f97a-4a87-b5c8-42998b0cbd7c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,605::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14' for lock type 'exclusive' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:08,606::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:09,912::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-340::DEBUG::2013-03-01 12:56:10,931::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-255::DEBUG::2013-03-01 12:56:11,382::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:11,423::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-340::DEBUG::2013-03-01 12:56:14,043::task::568::TaskManager.Task::(_updateState) Task=`efef3c3d-579a-4053-a73c-165e879060bc`::moving from state init -> state preparing >Thread-340::INFO::2013-03-01 12:56:14,055::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-340::DEBUG::2013-03-01 12:56:14,058::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-340::DEBUG::2013-03-01 12:56:14,060::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 84446d15-a7a9-4363-84b5-e3312a48a061 >Thread-340::DEBUG::2013-03-01 12:56:14,063::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'} >Thread-340::DEBUG::2013-03-01 12:56:14,065::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'84446d15-a7a9-4363-84b5-e3312a48a061': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'}} >Thread-105::DEBUG::2013-03-01 12:56:14,066::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-340::INFO::2013-03-01 12:56:14,075::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'84446d15-a7a9-4363-84b5-e3312a48a061': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'}}} >Thread-255::DEBUG::2013-03-01 12:56:14,078::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267632 s, 15.3 MB/s\n'; <rc> = 0 >Thread-340::DEBUG::2013-03-01 12:56:14,079::task::1151::TaskManager.Task::(prepare) Task=`efef3c3d-579a-4053-a73c-165e879060bc`::finished: {'allTasksStatus': {'84446d15-a7a9-4363-84b5-e3312a48a061': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'}}} >Thread-340::DEBUG::2013-03-01 12:56:14,082::task::568::TaskManager.Task::(_updateState) Task=`efef3c3d-579a-4053-a73c-165e879060bc`::moving from state preparing -> state finished >Thread-340::DEBUG::2013-03-01 12:56:14,083::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-340::DEBUG::2013-03-01 12:56:14,084::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2013-03-01 12:56:14,086::task::957::TaskManager.Task::(_decref) Task=`efef3c3d-579a-4053-a73c-165e879060bc`::ref 0 aborting False >Thread-342::DEBUG::2013-03-01 12:56:14,118::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-342::DEBUG::2013-03-01 12:56:14,121::task::568::TaskManager.Task::(_updateState) Task=`0d742bbe-d3a6-4de8-a25e-06f0056fe4a2`::moving from state init -> state preparing >Thread-342::INFO::2013-03-01 12:56:14,122::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-342::INFO::2013-03-01 12:56:14,124::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-342::DEBUG::2013-03-01 12:56:14,125::task::1151::TaskManager.Task::(prepare) Task=`0d742bbe-d3a6-4de8-a25e-06f0056fe4a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-342::DEBUG::2013-03-01 12:56:14,126::task::568::TaskManager.Task::(_updateState) Task=`0d742bbe-d3a6-4de8-a25e-06f0056fe4a2`::moving from state preparing -> state finished >Thread-342::DEBUG::2013-03-01 12:56:14,127::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-342::DEBUG::2013-03-01 12:56:14,127::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-342::DEBUG::2013-03-01 12:56:14,129::task::957::TaskManager.Task::(_decref) Task=`0d742bbe-d3a6-4de8-a25e-06f0056fe4a2`::ref 0 aborting False >Thread-343::DEBUG::2013-03-01 12:56:14,161::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-343::DEBUG::2013-03-01 12:56:14,163::task::568::TaskManager.Task::(_updateState) Task=`bfa4c65b-62c2-4e0c-b626-b5de682d82ba`::moving from state init -> state preparing >Thread-343::INFO::2013-03-01 12:56:14,164::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-343::DEBUG::2013-03-01 12:56:14,165::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`87a28b80-5a83-4390-9edb-02db3601035e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-343::DEBUG::2013-03-01 12:56:14,166::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-343::DEBUG::2013-03-01 12:56:14,167::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-343::DEBUG::2013-03-01 12:56:14,168::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`87a28b80-5a83-4390-9edb-02db3601035e`::Granted request >Thread-343::DEBUG::2013-03-01 12:56:14,170::task::794::TaskManager.Task::(resourceAcquired) Task=`bfa4c65b-62c2-4e0c-b626-b5de682d82ba`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-343::DEBUG::2013-03-01 12:56:14,170::task::957::TaskManager.Task::(_decref) Task=`bfa4c65b-62c2-4e0c-b626-b5de682d82ba`::ref 1 aborting False >Thread-343::DEBUG::2013-03-01 12:56:14,172::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-343::DEBUG::2013-03-01 12:56:14,175::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:14,202::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0969209 s, 10.6 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:56:15,296::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:56:15,298::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:15,310::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000375869 s, 10.9 MB/s\n'; <rc> = 0 >Thread-343::DEBUG::2013-03-01 12:56:15,339::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-343::DEBUG::2013-03-01 12:56:15,341::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-343::INFO::2013-03-01 12:56:15,342::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-343::DEBUG::2013-03-01 12:56:15,342::task::1151::TaskManager.Task::(prepare) Task=`bfa4c65b-62c2-4e0c-b626-b5de682d82ba`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-343::DEBUG::2013-03-01 12:56:15,343::task::568::TaskManager.Task::(_updateState) Task=`bfa4c65b-62c2-4e0c-b626-b5de682d82ba`::moving from state preparing -> state finished >Thread-343::DEBUG::2013-03-01 12:56:15,343::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-343::DEBUG::2013-03-01 12:56:15,343::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-343::DEBUG::2013-03-01 12:56:15,344::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-343::DEBUG::2013-03-01 12:56:15,344::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-343::DEBUG::2013-03-01 12:56:15,344::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-343::DEBUG::2013-03-01 12:56:15,344::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-343::DEBUG::2013-03-01 12:56:15,345::task::957::TaskManager.Task::(_decref) Task=`bfa4c65b-62c2-4e0c-b626-b5de682d82ba`::ref 0 aborting False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,729::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,729::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,729::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,730::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14' is free. Now locking as 'exclusive' (1 active user) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,730::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14`ReqID=`2929300b-f97a-4a87-b5c8-42998b0cbd7c`::Granted request >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,730::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,929::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,939::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,939::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,949::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000358332 s, 1.4 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,949::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000358332 s, 1.4 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,951::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,961::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000334792 s, 1.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,962::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000334792 s, 1.5 MB/s'], size: 512 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,962::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14 (qcow2) START >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,963::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:15,972::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >Dummy-173::DEBUG::2013-03-01 12:56:16,216::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:16,293::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315204 s, 32.5 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,585::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,585::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14 DONE >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:17,585::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:641da936-3f96-4831-a341-cd57756ebef7 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:bbf96708-e473-4fa7-aa32-4a6415528e14 >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:17,585::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 justme False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,586::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,586::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,586::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,587::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,792::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,792::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,793::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,793::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,793::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,794::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,990::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,998::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::INFO::2013-03-01 12:56:17,998::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14 justme False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,998::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,998::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,998::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:17,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,209::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,210::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,210::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,210::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bbf96708-e473-4fa7-aa32-4a6415528e14', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,211::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,211::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:18,307::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:18,394::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415425 s, 24.6 MB/s\n'; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,435::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,444::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,445::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,445::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,445::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,445::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,446::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,446::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,447::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,447::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,447::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,448::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,448::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,448::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,448::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,449::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,449::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,449::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,450::task::568::TaskManager.Task::(_updateState) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::moving from state running -> state finished >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,451::task::719::TaskManager.Task::(_save) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/84446d15-a7a9-4363-84b5-e3312a48a061.temp >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,462::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,462::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,463::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,463::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,463::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,463::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,464::task::880::TaskManager.Task::(_runJobs) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::Task.run: exit - success: result {'uuid': 'bbf96708-e473-4fa7-aa32-4a6415528e14'} >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,464::task::957::TaskManager.Task::(_decref) Task=`84446d15-a7a9-4363-84b5-e3312a48a061`::ref 0 aborting False >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:56:18,464::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:56:20,408::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:20,506::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452213 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:22,520::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:22,624::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392006 s, 26.1 MB/s\n'; <rc> = 0 >Thread-346::DEBUG::2013-03-01 12:56:22,692::task::568::TaskManager.Task::(_updateState) Task=`20f35693-3204-4a8a-beec-aedf006bcdd2`::moving from state init -> state preparing >Thread-346::INFO::2013-03-01 12:56:22,693::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-346::INFO::2013-03-01 12:56:22,693::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '2.6985449791', 'lastCheck': '8.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0124089717865', 'lastCheck': '7.4', 'code': 0, 'valid': True}} >Thread-346::DEBUG::2013-03-01 12:56:22,693::task::1151::TaskManager.Task::(prepare) Task=`20f35693-3204-4a8a-beec-aedf006bcdd2`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '2.6985449791', 'lastCheck': '8.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0124089717865', 'lastCheck': '7.4', 'code': 0, 'valid': True}} >Thread-346::DEBUG::2013-03-01 12:56:22,694::task::568::TaskManager.Task::(_updateState) Task=`20f35693-3204-4a8a-beec-aedf006bcdd2`::moving from state preparing -> state finished >Thread-346::DEBUG::2013-03-01 12:56:22,694::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-346::DEBUG::2013-03-01 12:56:22,694::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-346::DEBUG::2013-03-01 12:56:22,694::task::957::TaskManager.Task::(_decref) Task=`20f35693-3204-4a8a-beec-aedf006bcdd2`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:56:24,086::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:24,095::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000439298 s, 9.3 MB/s\n'; <rc> = 0 >Thread-348::DEBUG::2013-03-01 12:56:24,120::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-348::DEBUG::2013-03-01 12:56:24,121::task::568::TaskManager.Task::(_updateState) Task=`8918c586-cf14-4ee7-b751-022c52303d8f`::moving from state init -> state preparing >Thread-348::INFO::2013-03-01 12:56:24,121::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-348::DEBUG::2013-03-01 12:56:24,121::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-348::DEBUG::2013-03-01 12:56:24,121::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 84446d15-a7a9-4363-84b5-e3312a48a061 >Thread-348::DEBUG::2013-03-01 12:56:24,122::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'} >Thread-348::DEBUG::2013-03-01 12:56:24,122::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'84446d15-a7a9-4363-84b5-e3312a48a061': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'}} >Thread-348::INFO::2013-03-01 12:56:24,122::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'84446d15-a7a9-4363-84b5-e3312a48a061': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'}}} >Thread-348::DEBUG::2013-03-01 12:56:24,123::task::1151::TaskManager.Task::(prepare) Task=`8918c586-cf14-4ee7-b751-022c52303d8f`::finished: {'allTasksStatus': {'84446d15-a7a9-4363-84b5-e3312a48a061': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84446d15-a7a9-4363-84b5-e3312a48a061'}}} >Thread-348::DEBUG::2013-03-01 12:56:24,123::task::568::TaskManager.Task::(_updateState) Task=`8918c586-cf14-4ee7-b751-022c52303d8f`::moving from state preparing -> state finished >Thread-348::DEBUG::2013-03-01 12:56:24,123::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-348::DEBUG::2013-03-01 12:56:24,123::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-348::DEBUG::2013-03-01 12:56:24,124::task::957::TaskManager.Task::(_decref) Task=`8918c586-cf14-4ee7-b751-022c52303d8f`::ref 0 aborting False >Thread-349::DEBUG::2013-03-01 12:56:24,226::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-349::DEBUG::2013-03-01 12:56:24,227::task::568::TaskManager.Task::(_updateState) Task=`04df511a-832d-4783-9cff-1b5cb529dc20`::moving from state init -> state preparing >Thread-349::INFO::2013-03-01 12:56:24,227::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', volUUID='bbf96708-e473-4fa7-aa32-4a6415528e14', options=None) >Thread-349::DEBUG::2013-03-01 12:56:24,228::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`4f7be959-cf47-4273-9833-ad86e99feea5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-349::DEBUG::2013-03-01 12:56:24,228::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-349::DEBUG::2013-03-01 12:56:24,229::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-349::DEBUG::2013-03-01 12:56:24,229::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`4f7be959-cf47-4273-9833-ad86e99feea5`::Granted request >Thread-349::DEBUG::2013-03-01 12:56:24,230::task::794::TaskManager.Task::(resourceAcquired) Task=`04df511a-832d-4783-9cff-1b5cb529dc20`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-349::DEBUG::2013-03-01 12:56:24,230::task::957::TaskManager.Task::(_decref) Task=`04df511a-832d-4783-9cff-1b5cb529dc20`::ref 1 aborting False >Thread-349::INFO::2013-03-01 12:56:24,231::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e volUUID = bbf96708-e473-4fa7-aa32-4a6415528e14 >Thread-349::DEBUG::2013-03-01 12:56:24,231::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-349::DEBUG::2013-03-01 12:56:24,241::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000365364 s, 1.4 MB/s\n'; <rc> = 0 >Thread-349::DEBUG::2013-03-01 12:56:24,241::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000365364 s, 1.4 MB/s'], size: 512 >Thread-349::DEBUG::2013-03-01 12:56:24,242::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-349::DEBUG::2013-03-01 12:56:24,252::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000367111 s, 1.4 MB/s\n'; <rc> = 0 >Thread-349::DEBUG::2013-03-01 12:56:24,253::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000367111 s, 1.4 MB/s'], size: 512 >Thread-349::DEBUG::2013-03-01 12:56:24,253::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-349::DEBUG::2013-03-01 12:56:24,254::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-349::DEBUG::2013-03-01 12:56:24,501::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-349::DEBUG::2013-03-01 12:56:24,511::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-349::INFO::2013-03-01 12:56:24,512::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', 'ctime': '1362135365', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135375', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bbf96708-e473-4fa7-aa32-4a6415528e14', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-349::INFO::2013-03-01 12:56:24,512::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', 'ctime': '1362135365', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135375', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bbf96708-e473-4fa7-aa32-4a6415528e14', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-349::DEBUG::2013-03-01 12:56:24,512::task::1151::TaskManager.Task::(prepare) Task=`04df511a-832d-4783-9cff-1b5cb529dc20`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', 'ctime': '1362135365', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135375', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bbf96708-e473-4fa7-aa32-4a6415528e14', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-349::DEBUG::2013-03-01 12:56:24,513::task::568::TaskManager.Task::(_updateState) Task=`04df511a-832d-4783-9cff-1b5cb529dc20`::moving from state preparing -> state finished >Thread-349::DEBUG::2013-03-01 12:56:24,513::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-349::DEBUG::2013-03-01 12:56:24,513::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-349::DEBUG::2013-03-01 12:56:24,514::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-349::DEBUG::2013-03-01 12:56:24,514::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-349::DEBUG::2013-03-01 12:56:24,514::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-349::DEBUG::2013-03-01 12:56:24,515::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-349::DEBUG::2013-03-01 12:56:24,515::task::957::TaskManager.Task::(_decref) Task=`04df511a-832d-4783-9cff-1b5cb529dc20`::ref 0 aborting False >Thread-350::DEBUG::2013-03-01 12:56:24,609::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-350::DEBUG::2013-03-01 12:56:24,609::task::568::TaskManager.Task::(_updateState) Task=`e21fda11-77b3-40e8-83ea-97551fc9053d`::moving from state init -> state preparing >Thread-350::INFO::2013-03-01 12:56:24,610::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='84446d15-a7a9-4363-84b5-e3312a48a061', spUUID=None, options=None) >Thread-350::DEBUG::2013-03-01 12:56:24,610::taskManager::161::TaskManager::(clearTask) Entry. taskID: 84446d15-a7a9-4363-84b5-e3312a48a061 >Thread-350::DEBUG::2013-03-01 12:56:24,611::taskManager::166::TaskManager::(clearTask) Return. >Thread-350::INFO::2013-03-01 12:56:24,612::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-350::DEBUG::2013-03-01 12:56:24,612::task::1151::TaskManager.Task::(prepare) Task=`e21fda11-77b3-40e8-83ea-97551fc9053d`::finished: None >Thread-350::DEBUG::2013-03-01 12:56:24,612::task::568::TaskManager.Task::(_updateState) Task=`e21fda11-77b3-40e8-83ea-97551fc9053d`::moving from state preparing -> state finished >Thread-350::DEBUG::2013-03-01 12:56:24,613::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-350::DEBUG::2013-03-01 12:56:24,613::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-350::DEBUG::2013-03-01 12:56:24,613::task::957::TaskManager.Task::(_decref) Task=`e21fda11-77b3-40e8-83ea-97551fc9053d`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:56:24,644::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:24,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468021 s, 21.9 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:56:25,317::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:25,328::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000385104 s, 10.6 MB/s\n'; <rc> = 0 >Thread-351::DEBUG::2013-03-01 12:56:25,435::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-351::DEBUG::2013-03-01 12:56:25,436::task::568::TaskManager.Task::(_updateState) Task=`efe04405-cdbc-4ee2-9001-5deeef453d45`::moving from state init -> state preparing >Thread-351::INFO::2013-03-01 12:56:25,462::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-351::INFO::2013-03-01 12:56:25,462::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-351::DEBUG::2013-03-01 12:56:25,463::task::1151::TaskManager.Task::(prepare) Task=`efe04405-cdbc-4ee2-9001-5deeef453d45`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-351::DEBUG::2013-03-01 12:56:25,463::task::568::TaskManager.Task::(_updateState) Task=`efe04405-cdbc-4ee2-9001-5deeef453d45`::moving from state preparing -> state finished >Thread-351::DEBUG::2013-03-01 12:56:25,463::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-351::DEBUG::2013-03-01 12:56:25,464::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-351::DEBUG::2013-03-01 12:56:25,464::task::957::TaskManager.Task::(_decref) Task=`efe04405-cdbc-4ee2-9001-5deeef453d45`::ref 0 aborting False >Thread-352::DEBUG::2013-03-01 12:56:25,489::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-352::DEBUG::2013-03-01 12:56:25,490::task::568::TaskManager.Task::(_updateState) Task=`828bcfd9-4d35-4e16-b2a4-bc9f9e0e1865`::moving from state init -> state preparing >Thread-352::INFO::2013-03-01 12:56:25,490::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-352::DEBUG::2013-03-01 12:56:25,491::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`a4d0889c-beff-44c9-977f-3883c18df759`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-352::DEBUG::2013-03-01 12:56:25,491::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-352::DEBUG::2013-03-01 12:56:25,492::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-352::DEBUG::2013-03-01 12:56:25,492::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`a4d0889c-beff-44c9-977f-3883c18df759`::Granted request >Thread-352::DEBUG::2013-03-01 12:56:25,493::task::794::TaskManager.Task::(resourceAcquired) Task=`828bcfd9-4d35-4e16-b2a4-bc9f9e0e1865`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-352::DEBUG::2013-03-01 12:56:25,493::task::957::TaskManager.Task::(_decref) Task=`828bcfd9-4d35-4e16-b2a4-bc9f9e0e1865`::ref 1 aborting False >Thread-352::INFO::2013-03-01 12:56:25,494::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-352::DEBUG::2013-03-01 12:56:25,495::task::1151::TaskManager.Task::(prepare) Task=`828bcfd9-4d35-4e16-b2a4-bc9f9e0e1865`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-352::DEBUG::2013-03-01 12:56:25,495::task::568::TaskManager.Task::(_updateState) Task=`828bcfd9-4d35-4e16-b2a4-bc9f9e0e1865`::moving from state preparing -> state finished >Thread-352::DEBUG::2013-03-01 12:56:25,495::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-352::DEBUG::2013-03-01 12:56:25,496::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-352::DEBUG::2013-03-01 12:56:25,496::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-352::DEBUG::2013-03-01 12:56:25,496::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-352::DEBUG::2013-03-01 12:56:25,497::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-352::DEBUG::2013-03-01 12:56:25,497::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-352::DEBUG::2013-03-01 12:56:25,497::task::957::TaskManager.Task::(_decref) Task=`828bcfd9-4d35-4e16-b2a4-bc9f9e0e1865`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:56:26,774::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:26,875::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392523 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:28,894::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:29,005::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459051 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:31,025::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:31,119::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366036 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:33,138::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:33,230::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381194 s, 26.9 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:56:34,097::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-255::DEBUG::2013-03-01 12:56:34,098::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-255::DEBUG::2013-03-01 12:56:34,098::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:34,108::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000450637 s, 4.5 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:56:34,108::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000450637 s, 4.5 MB/s'], size: 2048 >Thread-255::DEBUG::2013-03-01 12:56:34,108::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-255::WARNING::2013-03-01 12:56:34,109::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-255::DEBUG::2013-03-01 12:56:34,110::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-255::DEBUG::2013-03-01 12:56:34,111::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:56:34,111::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:56:34,111::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:56:34,112::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:56:34,112::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 12:56:34,113::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:34,354::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:56:34,356::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 12:56:34,356::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-255::WARNING::2013-03-01 12:56:34,357::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-255::WARNING::2013-03-01 12:56:34,358::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-255::WARNING::2013-03-01 12:56:34,358::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-255::DEBUG::2013-03-01 12:56:34,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:34,600::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:56:34,600::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:34,610::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268138 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:35,243::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:35,329::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036771 s, 27.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:56:35,336::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:35,361::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00293625 s, 1.4 MB/s\n'; <rc> = 0 >Thread-357::DEBUG::2013-03-01 12:56:35,576::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-357::DEBUG::2013-03-01 12:56:35,577::task::568::TaskManager.Task::(_updateState) Task=`15aea928-dec7-4e41-b803-0b710b0d2be0`::moving from state init -> state preparing >Thread-357::INFO::2013-03-01 12:56:35,577::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-357::INFO::2013-03-01 12:56:35,578::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-357::DEBUG::2013-03-01 12:56:35,578::task::1151::TaskManager.Task::(prepare) Task=`15aea928-dec7-4e41-b803-0b710b0d2be0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-357::DEBUG::2013-03-01 12:56:35,578::task::568::TaskManager.Task::(_updateState) Task=`15aea928-dec7-4e41-b803-0b710b0d2be0`::moving from state preparing -> state finished >Thread-357::DEBUG::2013-03-01 12:56:35,578::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-357::DEBUG::2013-03-01 12:56:35,578::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-357::DEBUG::2013-03-01 12:56:35,579::task::957::TaskManager.Task::(_decref) Task=`15aea928-dec7-4e41-b803-0b710b0d2be0`::ref 0 aborting False >Thread-358::DEBUG::2013-03-01 12:56:35,629::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-358::DEBUG::2013-03-01 12:56:35,629::task::568::TaskManager.Task::(_updateState) Task=`7c899ec1-c90d-42a0-8a72-e6708d173f17`::moving from state init -> state preparing >Thread-358::INFO::2013-03-01 12:56:35,630::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-358::DEBUG::2013-03-01 12:56:35,630::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b235928b-9eb3-43a8-b269-ff79ddd37f0c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-358::DEBUG::2013-03-01 12:56:35,630::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-358::DEBUG::2013-03-01 12:56:35,631::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-358::DEBUG::2013-03-01 12:56:35,631::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b235928b-9eb3-43a8-b269-ff79ddd37f0c`::Granted request >Thread-358::DEBUG::2013-03-01 12:56:35,632::task::794::TaskManager.Task::(resourceAcquired) Task=`7c899ec1-c90d-42a0-8a72-e6708d173f17`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-358::DEBUG::2013-03-01 12:56:35,632::task::957::TaskManager.Task::(_decref) Task=`7c899ec1-c90d-42a0-8a72-e6708d173f17`::ref 1 aborting False >Thread-358::INFO::2013-03-01 12:56:35,633::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-358::DEBUG::2013-03-01 12:56:35,633::task::1151::TaskManager.Task::(prepare) Task=`7c899ec1-c90d-42a0-8a72-e6708d173f17`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-358::DEBUG::2013-03-01 12:56:35,634::task::568::TaskManager.Task::(_updateState) Task=`7c899ec1-c90d-42a0-8a72-e6708d173f17`::moving from state preparing -> state finished >Thread-358::DEBUG::2013-03-01 12:56:35,634::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-358::DEBUG::2013-03-01 12:56:35,634::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-358::DEBUG::2013-03-01 12:56:35,634::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-358::DEBUG::2013-03-01 12:56:35,635::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-358::DEBUG::2013-03-01 12:56:35,635::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-358::DEBUG::2013-03-01 12:56:35,635::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-358::DEBUG::2013-03-01 12:56:35,635::task::957::TaskManager.Task::(_decref) Task=`7c899ec1-c90d-42a0-8a72-e6708d173f17`::ref 0 aborting False >Thread-359::DEBUG::2013-03-01 12:56:36,085::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-359::DEBUG::2013-03-01 12:56:36,086::task::568::TaskManager.Task::(_updateState) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::moving from state init -> state preparing >Thread-359::INFO::2013-03-01 12:56:36,086::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='e7934077-6752-4445-a00a-1f2551119ade', srcVolUUID='641da936-3f96-4831-a341-cd57756ebef7', dstImgUUID='959739c8-3e0f-4536-a08c-0f07f76012d4', dstVolUUID='dd47427d-525c-48f4-b2c7-22ca377c8c2c', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-359::INFO::2013-03-01 12:56:36,086::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-359::DEBUG::2013-03-01 12:56:36,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,274::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,279::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,280::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,280::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,280::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,281::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,525::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,526::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,527::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-359::DEBUG::2013-03-01 12:56:36,528::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,529::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,716::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,725::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-359::INFO::2013-03-01 12:56:36,725::image::458::Storage.Image::(isLegal) image e7934077-6752-4445-a00a-1f2551119ade in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', '641da936-3f96-4831-a341-cd57756ebef7'] >Thread-359::DEBUG::2013-03-01 12:56:36,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,736::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000305788 s, 1.7 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,736::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000305788 s, 1.7 MB/s'], size: 512 >Thread-359::DEBUG::2013-03-01 12:56:36,737::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,746::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000302378 s, 1.7 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,747::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000302378 s, 1.7 MB/s'], size: 512 >Thread-359::DEBUG::2013-03-01 12:56:36,748::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,757::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297613 s, 1.7 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,758::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297613 s, 1.7 MB/s'], size: 512 >Thread-359::DEBUG::2013-03-01 12:56:36,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,767::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000290083 s, 1.8 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,768::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000290083 s, 1.8 MB/s'], size: 512 >Thread-359::DEBUG::2013-03-01 12:56:36,769::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,770::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,959::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,968::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-359::DEBUG::2013-03-01 12:56:36,969::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,979::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299728 s, 1.7 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,980::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299728 s, 1.7 MB/s'], size: 512 >Thread-359::DEBUG::2013-03-01 12:56:36,981::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-359::DEBUG::2013-03-01 12:56:36,990::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00045842 s, 1.1 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 12:56:36,991::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00045842 s, 1.1 MB/s'], size: 512 >Thread-359::INFO::2013-03-01 12:56:36,991::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec18bd90>, <storage.blockVolume.BlockVolume object at 0x7f15ec1a7950>] >Thread-359::DEBUG::2013-03-01 12:56:36,992::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`0c15e512-d78d-48b9-9c80-d930700c8f3b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-359::DEBUG::2013-03-01 12:56:36,992::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-359::DEBUG::2013-03-01 12:56:36,993::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-359::DEBUG::2013-03-01 12:56:36,993::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`0c15e512-d78d-48b9-9c80-d930700c8f3b`::Granted request >Thread-359::DEBUG::2013-03-01 12:56:36,994::task::794::TaskManager.Task::(resourceAcquired) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-359::DEBUG::2013-03-01 12:56:36,994::task::957::TaskManager.Task::(_decref) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::ref 1 aborting False >Thread-359::DEBUG::2013-03-01 12:56:36,996::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >Thread-359::DEBUG::2013-03-01 12:56:37,003::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_959739c8-3e0f-4536-a08c-0f07f76012d4 for task 269d8563-1c33-4a96-8b83-ea783b7979ec >Thread-359::INFO::2013-03-01 12:56:37,003::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-359::DEBUG::2013-03-01 12:56:37,003::task::1146::TaskManager.Task::(prepare) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::Prepare: 1 jobs exist, move to acquiring >Thread-359::DEBUG::2013-03-01 12:56:37,003::task::568::TaskManager.Task::(_updateState) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::moving from state preparing -> state acquiring >Thread-359::DEBUG::2013-03-01 12:56:37,004::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >Thread-359::DEBUG::2013-03-01 12:56:37,012::task::568::TaskManager.Task::(_updateState) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::moving from state acquiring -> state queued >Thread-359::DEBUG::2013-03-01 12:56:37,012::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >Thread-359::DEBUG::2013-03-01 12:56:37,020::taskManager::50::TaskManager::(_queueTask) queuing task: 269d8563-1c33-4a96-8b83-ea783b7979ec >Thread-359::DEBUG::2013-03-01 12:56:37,020::taskManager::56::TaskManager::(_queueTask) task queued: 269d8563-1c33-4a96-8b83-ea783b7979ec >Thread-5::DEBUG::2013-03-01 12:56:37,020::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-359::DEBUG::2013-03-01 12:56:37,021::task::1148::TaskManager.Task::(prepare) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::returning >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,022::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 269d8563-1c33-4a96-8b83-ea783b7979ec running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c0150878>> with: None >Thread-359::DEBUG::2013-03-01 12:56:37,022::task::957::TaskManager.Task::(_decref) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::ref 0 aborting False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,023::task::1159::TaskManager.Task::(commit) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::committing task: 269d8563-1c33-4a96-8b83-ea783b7979ec >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,025::task::568::TaskManager.Task::(_updateState) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::moving from state queued -> state running >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,028::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,034::task::872::TaskManager.Task::(_runJobs) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::Task.run: running job 0: copyImage_959739c8-3e0f-4536-a08c-0f07f76012d4: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7', '959739c8-3e0f-4536-a08c-0f07f76012d4', 'dd47427d-525c-48f4-b2c7-22ca377c8c2c', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,034::task::304::TaskManager.Task::(run) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::Job.run: running copyImage_959739c8-3e0f-4536-a08c-0f07f76012d4: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7', '959739c8-3e0f-4536-a08c-0f07f76012d4', 'dd47427d-525c-48f4-b2c7-22ca377c8c2c', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,035::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`8f647464-4c2a-450e-ba0f-0c1ea497104c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,035::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' for lock type 'shared' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,036::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,037::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,281::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,293::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,294::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,304::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000303058 s, 1.7 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,305::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000303058 s, 1.7 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,315::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000303335 s, 1.7 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,316::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000303335 s, 1.7 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:37,316::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec1a7a50>, <storage.blockVolume.BlockVolume object at 0x7f15ec132850>] >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,317::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97`ReqID=`beedb9f8-9b6f-4374-a75f-605d9bb1b316`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,317::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' for lock type 'shared' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,318::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' is free. Now locking as 'shared' (1 active user) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,318::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97`ReqID=`beedb9f8-9b6f-4374-a75f-605d9bb1b316`::Granted request >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,319::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`cb1fa1e0-8833-4145-aa6f-4b9f727c1c72`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,319::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,320::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,320::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`cb1fa1e0-8833-4145-aa6f-4b9f727c1c72`::Granted request >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,320::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free. Now locking as 'shared' (1 active user) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,321::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`8f647464-4c2a-450e-ba0f-0c1ea497104c`::Granted request >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,322::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4`ReqID=`deb685e8-94d2-4c2d-8af9-199b1c395838`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,322::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4' for lock type 'exclusive' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,323::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,324::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:37,382::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:37,475::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419472 s, 24.4 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,537::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,545::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,545::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 959739c8-3e0f-4536-a08c-0f07f76012d4 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,545::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4' is free. Now locking as 'exclusive' (1 active user) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,546::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4`ReqID=`deb685e8-94d2-4c2d-8af9-199b1c395838`::Granted request >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:37,546::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=e7934077-6752-4445-a00a-1f2551119ade srcVolUUID=641da936-3f96-4831-a341-cd57756ebef7 dstImgUUID=959739c8-3e0f-4536-a08c-0f07f76012d4 dstVolUUID=dd47427d-525c-48f4-b2c7-22ca377c8c2c dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,547::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,555::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000282472 s, 1.8 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,555::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000282472 s, 1.8 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,556::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,563::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297849 s, 1.7 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,564::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297849 s, 1.7 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,572::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000277159 s, 1.8 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,572::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000277159 s, 1.8 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,573::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000275191 s, 1.9 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,581::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000275191 s, 1.9 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,589::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000285669 s, 1.8 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,590::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000285669 s, 1.8 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,590::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,599::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000306986 s, 1.7 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,600::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000306986 s, 1.7 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:37,600::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:e7934077-6752-4445-a00a-1f2551119ade:641da936-3f96-4831-a341-cd57756ebef7 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:959739c8-3e0f-4536-a08c-0f07f76012d4:dd47427d-525c-48f4-b2c7-22ca377c8c2c apparentsize 2097152 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,601::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,602::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,813::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,826::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:37,826::image::458::Storage.Image::(isLegal) image 959739c8-3e0f-4536-a08c-0f07f76012d4 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:37,827::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4 for image's volumes >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,828::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,837::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:37,838::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-360::DEBUG::2013-03-01 12:56:38,008::task::568::TaskManager.Task::(_updateState) Task=`4f3942b8-458f-4a34-9d92-dae92839a8fa`::moving from state init -> state preparing >Thread-360::INFO::2013-03-01 12:56:38,008::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-360::INFO::2013-03-01 12:56:38,009::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104100704193', 'lastCheck': '3.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.027468919754', 'lastCheck': '2.6', 'code': 0, 'valid': True}} >Thread-360::DEBUG::2013-03-01 12:56:38,009::task::1151::TaskManager.Task::(prepare) Task=`4f3942b8-458f-4a34-9d92-dae92839a8fa`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104100704193', 'lastCheck': '3.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.027468919754', 'lastCheck': '2.6', 'code': 0, 'valid': True}} >Thread-360::DEBUG::2013-03-01 12:56:38,009::task::568::TaskManager.Task::(_updateState) Task=`4f3942b8-458f-4a34-9d92-dae92839a8fa`::moving from state preparing -> state finished >Thread-360::DEBUG::2013-03-01 12:56:38,010::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-360::DEBUG::2013-03-01 12:56:38,010::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-360::DEBUG::2013-03-01 12:56:38,010::task::957::TaskManager.Task::(_decref) Task=`4f3942b8-458f-4a34-9d92-dae92839a8fa`::ref 0 aborting False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:38,087::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:38,099::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::WARNING::2013-03-01 12:56:38,099::lvm::593::Storage.LVM::(getLv) lv: dd47427d-525c-48f4-b2c7-22ca377c8c2c not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:38,100::volume::457::Storage.Volume::(create) Creating volume dd47427d-525c-48f4-b2c7-22ca377c8c2c >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:38,101::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:38,110::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:38,121::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name dd47427d-525c-48f4-b2c7-22ca377c8c2c a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:39,489::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:39,574::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037237 s, 27.5 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,743::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,744::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,744::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,745::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:39,746::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c with size = 20480 sectors >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,747::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c 10240K' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,759::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,759::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:39,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,003::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,016::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::WARNING::2013-03-01 12:56:40,016::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,017::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,018::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_7 --addtag IU_959739c8-3e0f-4536-a08c-0f07f76012d4 --addtag PU_00000000-0000-0000-0000-000000000000 a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,276::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,276::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,277::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,483::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,484::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,484::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,485::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,498::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=dd47427d-525c-48f4-b2c7-22ca377c8c2c sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,505::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,515::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,516::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,725::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:40,725::blockVolume::280::Storage.Volume::(extend) Request to extend LV dd47427d-525c-48f4-b2c7-22ca377c8c2c of image 959739c8-3e0f-4536-a08c-0f07f76012d4 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,937::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,940::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,951::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0003342 s, 1.5 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,952::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0003342 s, 1.5 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:40,953::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,953::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,963::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00030835 s, 1.7 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,964::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00030835 s, 1.7 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,965::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`0454f20c-53ad-48ec-b231-e763ef06af6f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,965::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:40,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:41,588::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:41,666::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319009 s, 32.1 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,588::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,589::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,589::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,589::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,590::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`0454f20c-53ad-48ec-b231-e763ef06af6f`::Granted request >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,590::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,591::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,834::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,847::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:42,847::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,858::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000338564 s, 1.5 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,858::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000338564 s, 1.5 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,859::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327428 s, 1.6 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,869::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327428 s, 1.6 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,870::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c`ReqID=`efb09ea8-de94-4bd5-9afa-2db68cd99ceb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,871::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c' for lock type 'exclusive' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:42,872::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:43,680::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:43,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325509 s, 31.5 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2013-03-01 12:56:44,163::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-363::DEBUG::2013-03-01 12:56:44,164::task::568::TaskManager.Task::(_updateState) Task=`bbe00c63-eb68-4f4c-905e-3211b11be6f3`::moving from state init -> state preparing >Thread-363::INFO::2013-03-01 12:56:44,164::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-363::DEBUG::2013-03-01 12:56:44,165::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-363::DEBUG::2013-03-01 12:56:44,165::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 269d8563-1c33-4a96-8b83-ea783b7979ec >Thread-363::DEBUG::2013-03-01 12:56:44,165::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'} >Thread-363::DEBUG::2013-03-01 12:56:44,165::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'269d8563-1c33-4a96-8b83-ea783b7979ec': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'}} >Thread-363::INFO::2013-03-01 12:56:44,166::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'269d8563-1c33-4a96-8b83-ea783b7979ec': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'}}} >Thread-363::DEBUG::2013-03-01 12:56:44,166::task::1151::TaskManager.Task::(prepare) Task=`bbe00c63-eb68-4f4c-905e-3211b11be6f3`::finished: {'allTasksStatus': {'269d8563-1c33-4a96-8b83-ea783b7979ec': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'}}} >Thread-363::DEBUG::2013-03-01 12:56:44,166::task::568::TaskManager.Task::(_updateState) Task=`bbe00c63-eb68-4f4c-905e-3211b11be6f3`::moving from state preparing -> state finished >Thread-363::DEBUG::2013-03-01 12:56:44,166::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-363::DEBUG::2013-03-01 12:56:44,167::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-363::DEBUG::2013-03-01 12:56:44,167::task::957::TaskManager.Task::(_decref) Task=`bbe00c63-eb68-4f4c-905e-3211b11be6f3`::ref 0 aborting False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,519::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,519::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,520::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,520::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c' is free. Now locking as 'exclusive' (1 active user) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,520::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c`ReqID=`efb09ea8-de94-4bd5-9afa-2db68cd99ceb`::Granted request >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,521::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:44,612::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:44,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000442734 s, 9.3 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,769::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,779::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,780::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,790::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000320372 s, 1.6 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,791::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000320372 s, 1.6 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,792::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,802::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0003495 s, 1.5 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,803::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0003495 s, 1.5 MB/s'], size: 512 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,803::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c (qcow2) START >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,804::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:44,813::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >Thread-105::DEBUG::2013-03-01 12:56:45,376::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:56:45,377::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:45,683::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:56:45,685::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:56:45,685::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:45,697::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00039575 s, 10.3 MB/s\n'; <rc> = 0 >Thread-365::DEBUG::2013-03-01 12:56:45,728::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-365::DEBUG::2013-03-01 12:56:45,728::task::568::TaskManager.Task::(_updateState) Task=`f1593dd2-7a83-43f4-8c99-9d94f86f66e5`::moving from state init -> state preparing >Thread-365::INFO::2013-03-01 12:56:45,729::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-365::INFO::2013-03-01 12:56:45,729::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-365::DEBUG::2013-03-01 12:56:45,730::task::1151::TaskManager.Task::(prepare) Task=`f1593dd2-7a83-43f4-8c99-9d94f86f66e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-365::DEBUG::2013-03-01 12:56:45,730::task::568::TaskManager.Task::(_updateState) Task=`f1593dd2-7a83-43f4-8c99-9d94f86f66e5`::moving from state preparing -> state finished >Thread-365::DEBUG::2013-03-01 12:56:45,730::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-365::DEBUG::2013-03-01 12:56:45,731::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-365::DEBUG::2013-03-01 12:56:45,731::task::957::TaskManager.Task::(_decref) Task=`f1593dd2-7a83-43f4-8c99-9d94f86f66e5`::ref 0 aborting False >Thread-366::DEBUG::2013-03-01 12:56:45,756::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-366::DEBUG::2013-03-01 12:56:45,757::task::568::TaskManager.Task::(_updateState) Task=`1f613e63-1e4c-4502-8742-3c907f69be46`::moving from state init -> state preparing >Thread-366::INFO::2013-03-01 12:56:45,757::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-366::DEBUG::2013-03-01 12:56:45,758::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7769f4b7-0843-4a43-a12a-3fc1f33b4e65`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-366::DEBUG::2013-03-01 12:56:45,758::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-366::DEBUG::2013-03-01 12:56:45,760::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-366::DEBUG::2013-03-01 12:56:45,760::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7769f4b7-0843-4a43-a12a-3fc1f33b4e65`::Granted request >Thread-366::DEBUG::2013-03-01 12:56:45,761::task::794::TaskManager.Task::(resourceAcquired) Task=`1f613e63-1e4c-4502-8742-3c907f69be46`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-366::DEBUG::2013-03-01 12:56:45,761::task::957::TaskManager.Task::(_decref) Task=`1f613e63-1e4c-4502-8742-3c907f69be46`::ref 1 aborting False >Thread-366::INFO::2013-03-01 12:56:45,763::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-366::DEBUG::2013-03-01 12:56:45,763::task::1151::TaskManager.Task::(prepare) Task=`1f613e63-1e4c-4502-8742-3c907f69be46`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-366::DEBUG::2013-03-01 12:56:45,764::task::568::TaskManager.Task::(_updateState) Task=`1f613e63-1e4c-4502-8742-3c907f69be46`::moving from state preparing -> state finished >Thread-366::DEBUG::2013-03-01 12:56:45,764::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-366::DEBUG::2013-03-01 12:56:45,765::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-366::DEBUG::2013-03-01 12:56:45,765::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-366::DEBUG::2013-03-01 12:56:45,765::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-366::DEBUG::2013-03-01 12:56:45,766::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-366::DEBUG::2013-03-01 12:56:45,766::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-366::DEBUG::2013-03-01 12:56:45,766::task::957::TaskManager.Task::(_decref) Task=`1f613e63-1e4c-4502-8742-3c907f69be46`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:56:45,771::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:45,849::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326777 s, 31.3 MB/s\n'; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,449::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,449::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c DONE >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:46,449::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:641da936-3f96-4831-a341-cd57756ebef7 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:dd47427d-525c-48f4-b2c7-22ca377c8c2c >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:46,449::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 justme False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,449::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,450::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,450::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,451::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,708::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,708::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,709::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,709::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,709::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,710::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,954::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,966::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::INFO::2013-03-01 12:56:46,967::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c justme False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,967::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,967::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,968::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:46,969::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,215::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,216::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,216::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,217::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.dd47427d-525c-48f4-b2c7-22ca377c8c2c', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,217::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,218::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,457::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,470::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,470::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,471::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,471::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,471::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.959739c8-3e0f-4536-a08c-0f07f76012d4', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,472::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,472::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,472::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,473::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,473::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,473::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,473::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,474::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,474::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,474::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,475::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,475::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,475::task::568::TaskManager.Task::(_updateState) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::moving from state running -> state finished >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,476::task::719::TaskManager.Task::(_save) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/269d8563-1c33-4a96-8b83-ea783b7979ec.temp >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,488::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,488::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,489::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,489::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,489::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,489::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,490::task::880::TaskManager.Task::(_runJobs) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::Task.run: exit - success: result {'uuid': 'dd47427d-525c-48f4-b2c7-22ca377c8c2c'} >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,490::task::957::TaskManager.Task::(_decref) Task=`269d8563-1c33-4a96-8b83-ea783b7979ec`::ref 0 aborting False >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:56:47,490::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:56:47,863::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:47,946::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372032 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:49,959::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:50,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463239 s, 22.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:52,095::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:52,199::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387323 s, 26.4 MB/s\n'; <rc> = 0 >Thread-369::DEBUG::2013-03-01 12:56:53,411::task::568::TaskManager.Task::(_updateState) Task=`25ad34f5-d4bd-46db-a270-b427efd0894c`::moving from state init -> state preparing >Thread-369::INFO::2013-03-01 12:56:53,411::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-369::INFO::2013-03-01 12:56:53,412::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106160640717', 'lastCheck': '8.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0117681026459', 'lastCheck': '7.7', 'code': 0, 'valid': True}} >Thread-369::DEBUG::2013-03-01 12:56:53,412::task::1151::TaskManager.Task::(prepare) Task=`25ad34f5-d4bd-46db-a270-b427efd0894c`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106160640717', 'lastCheck': '8.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0117681026459', 'lastCheck': '7.7', 'code': 0, 'valid': True}} >Thread-369::DEBUG::2013-03-01 12:56:53,412::task::568::TaskManager.Task::(_updateState) Task=`25ad34f5-d4bd-46db-a270-b427efd0894c`::moving from state preparing -> state finished >Thread-369::DEBUG::2013-03-01 12:56:53,413::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-369::DEBUG::2013-03-01 12:56:53,413::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-369::DEBUG::2013-03-01 12:56:53,413::task::957::TaskManager.Task::(_decref) Task=`25ad34f5-d4bd-46db-a270-b427efd0894c`::ref 0 aborting False >Thread-371::DEBUG::2013-03-01 12:56:54,197::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-371::DEBUG::2013-03-01 12:56:54,197::task::568::TaskManager.Task::(_updateState) Task=`bf737f7d-de4b-4e87-99ed-a4bc4e1a717c`::moving from state init -> state preparing >Thread-371::INFO::2013-03-01 12:56:54,197::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-371::DEBUG::2013-03-01 12:56:54,198::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-371::DEBUG::2013-03-01 12:56:54,198::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 269d8563-1c33-4a96-8b83-ea783b7979ec >Thread-371::DEBUG::2013-03-01 12:56:54,198::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'} >Thread-371::DEBUG::2013-03-01 12:56:54,198::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'269d8563-1c33-4a96-8b83-ea783b7979ec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'}} >Thread-371::INFO::2013-03-01 12:56:54,199::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'269d8563-1c33-4a96-8b83-ea783b7979ec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'}}} >Thread-371::DEBUG::2013-03-01 12:56:54,199::task::1151::TaskManager.Task::(prepare) Task=`bf737f7d-de4b-4e87-99ed-a4bc4e1a717c`::finished: {'allTasksStatus': {'269d8563-1c33-4a96-8b83-ea783b7979ec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '269d8563-1c33-4a96-8b83-ea783b7979ec'}}} >Thread-371::DEBUG::2013-03-01 12:56:54,199::task::568::TaskManager.Task::(_updateState) Task=`bf737f7d-de4b-4e87-99ed-a4bc4e1a717c`::moving from state preparing -> state finished >Thread-371::DEBUG::2013-03-01 12:56:54,199::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-371::DEBUG::2013-03-01 12:56:54,200::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-371::DEBUG::2013-03-01 12:56:54,200::task::957::TaskManager.Task::(_decref) Task=`bf737f7d-de4b-4e87-99ed-a4bc4e1a717c`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:56:54,219::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-372::DEBUG::2013-03-01 12:56:54,287::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-372::DEBUG::2013-03-01 12:56:54,291::task::568::TaskManager.Task::(_updateState) Task=`a1386e1b-bf49-4cf8-bb70-373e15391dbd`::moving from state init -> state preparing >Thread-372::INFO::2013-03-01 12:56:54,294::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='959739c8-3e0f-4536-a08c-0f07f76012d4', volUUID='dd47427d-525c-48f4-b2c7-22ca377c8c2c', options=None) >Thread-372::DEBUG::2013-03-01 12:56:54,299::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`25b38063-6c52-4960-a308-c383eb260efc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-372::DEBUG::2013-03-01 12:56:54,301::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-372::DEBUG::2013-03-01 12:56:54,305::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-372::DEBUG::2013-03-01 12:56:54,307::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`25b38063-6c52-4960-a308-c383eb260efc`::Granted request >Thread-372::DEBUG::2013-03-01 12:56:54,312::task::794::TaskManager.Task::(resourceAcquired) Task=`a1386e1b-bf49-4cf8-bb70-373e15391dbd`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-372::DEBUG::2013-03-01 12:56:54,315::task::957::TaskManager.Task::(_decref) Task=`a1386e1b-bf49-4cf8-bb70-373e15391dbd`::ref 1 aborting False >Thread-372::INFO::2013-03-01 12:56:54,319::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=959739c8-3e0f-4536-a08c-0f07f76012d4 volUUID = dd47427d-525c-48f4-b2c7-22ca377c8c2c >Thread-372::DEBUG::2013-03-01 12:56:54,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-372::DEBUG::2013-03-01 12:56:54,348::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000323418 s, 1.6 MB/s\n'; <rc> = 0 >Thread-372::DEBUG::2013-03-01 12:56:54,350::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000323418 s, 1.6 MB/s'], size: 512 >Thread-372::DEBUG::2013-03-01 12:56:54,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-372::DEBUG::2013-03-01 12:56:54,383::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000326659 s, 1.6 MB/s\n'; <rc> = 0 >Thread-372::DEBUG::2013-03-01 12:56:54,385::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000326659 s, 1.6 MB/s'], size: 512 >Thread-372::DEBUG::2013-03-01 12:56:54,389::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-372::DEBUG::2013-03-01 12:56:54,399::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:54,436::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401849 s, 25.5 MB/s\n'; <rc> = 0 >Thread-372::DEBUG::2013-03-01 12:56:54,584::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2013-03-01 12:56:54,597::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-372::INFO::2013-03-01 12:56:54,598::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '959739c8-3e0f-4536-a08c-0f07f76012d4', 'ctime': '1362135400', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135404', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'dd47427d-525c-48f4-b2c7-22ca377c8c2c', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-372::INFO::2013-03-01 12:56:54,598::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '959739c8-3e0f-4536-a08c-0f07f76012d4', 'ctime': '1362135400', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135404', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'dd47427d-525c-48f4-b2c7-22ca377c8c2c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-372::DEBUG::2013-03-01 12:56:54,599::task::1151::TaskManager.Task::(prepare) Task=`a1386e1b-bf49-4cf8-bb70-373e15391dbd`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '959739c8-3e0f-4536-a08c-0f07f76012d4', 'ctime': '1362135400', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135404', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'dd47427d-525c-48f4-b2c7-22ca377c8c2c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-372::DEBUG::2013-03-01 12:56:54,599::task::568::TaskManager.Task::(_updateState) Task=`a1386e1b-bf49-4cf8-bb70-373e15391dbd`::moving from state preparing -> state finished >Thread-372::DEBUG::2013-03-01 12:56:54,599::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-372::DEBUG::2013-03-01 12:56:54,600::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-372::DEBUG::2013-03-01 12:56:54,600::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-372::DEBUG::2013-03-01 12:56:54,601::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-372::DEBUG::2013-03-01 12:56:54,601::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-372::DEBUG::2013-03-01 12:56:54,601::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-372::DEBUG::2013-03-01 12:56:54,601::task::957::TaskManager.Task::(_decref) Task=`a1386e1b-bf49-4cf8-bb70-373e15391dbd`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:56:54,624::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:56:54,633::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292938 s, 14.0 MB/s\n'; <rc> = 0 >Thread-373::DEBUG::2013-03-01 12:56:54,671::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-373::DEBUG::2013-03-01 12:56:54,671::task::568::TaskManager.Task::(_updateState) Task=`2446128e-e0f8-4aef-9d35-9341d1b6f69c`::moving from state init -> state preparing >Thread-373::INFO::2013-03-01 12:56:54,672::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='269d8563-1c33-4a96-8b83-ea783b7979ec', spUUID=None, options=None) >Thread-373::DEBUG::2013-03-01 12:56:54,672::taskManager::161::TaskManager::(clearTask) Entry. taskID: 269d8563-1c33-4a96-8b83-ea783b7979ec >Thread-373::DEBUG::2013-03-01 12:56:54,673::taskManager::166::TaskManager::(clearTask) Return. >Thread-373::INFO::2013-03-01 12:56:54,674::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-373::DEBUG::2013-03-01 12:56:54,674::task::1151::TaskManager.Task::(prepare) Task=`2446128e-e0f8-4aef-9d35-9341d1b6f69c`::finished: None >Thread-373::DEBUG::2013-03-01 12:56:54,674::task::568::TaskManager.Task::(_updateState) Task=`2446128e-e0f8-4aef-9d35-9341d1b6f69c`::moving from state preparing -> state finished >Thread-373::DEBUG::2013-03-01 12:56:54,674::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-373::DEBUG::2013-03-01 12:56:54,675::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-373::DEBUG::2013-03-01 12:56:54,675::task::957::TaskManager.Task::(_decref) Task=`2446128e-e0f8-4aef-9d35-9341d1b6f69c`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 12:56:55,701::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:56:55,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000394468 s, 10.4 MB/s\n'; <rc> = 0 >Thread-374::DEBUG::2013-03-01 12:56:55,810::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-374::DEBUG::2013-03-01 12:56:55,811::task::568::TaskManager.Task::(_updateState) Task=`cbeec4ec-1bfc-41ac-a8a4-84553d61c3ed`::moving from state init -> state preparing >Thread-374::INFO::2013-03-01 12:56:55,811::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-374::INFO::2013-03-01 12:56:55,812::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-374::DEBUG::2013-03-01 12:56:55,812::task::1151::TaskManager.Task::(prepare) Task=`cbeec4ec-1bfc-41ac-a8a4-84553d61c3ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-374::DEBUG::2013-03-01 12:56:55,812::task::568::TaskManager.Task::(_updateState) Task=`cbeec4ec-1bfc-41ac-a8a4-84553d61c3ed`::moving from state preparing -> state finished >Thread-374::DEBUG::2013-03-01 12:56:55,813::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-374::DEBUG::2013-03-01 12:56:55,813::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-374::DEBUG::2013-03-01 12:56:55,813::task::957::TaskManager.Task::(_decref) Task=`cbeec4ec-1bfc-41ac-a8a4-84553d61c3ed`::ref 0 aborting False >Thread-375::DEBUG::2013-03-01 12:56:55,845::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-375::DEBUG::2013-03-01 12:56:55,846::task::568::TaskManager.Task::(_updateState) Task=`893a3f87-0d70-495d-8a2f-4d4fed060664`::moving from state init -> state preparing >Thread-375::INFO::2013-03-01 12:56:55,846::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-375::DEBUG::2013-03-01 12:56:55,847::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9716036e-60b8-4180-892b-81bbee116d34`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-375::DEBUG::2013-03-01 12:56:55,847::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-375::DEBUG::2013-03-01 12:56:55,848::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-375::DEBUG::2013-03-01 12:56:55,848::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9716036e-60b8-4180-892b-81bbee116d34`::Granted request >Thread-375::DEBUG::2013-03-01 12:56:55,848::task::794::TaskManager.Task::(resourceAcquired) Task=`893a3f87-0d70-495d-8a2f-4d4fed060664`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-375::DEBUG::2013-03-01 12:56:55,849::task::957::TaskManager.Task::(_decref) Task=`893a3f87-0d70-495d-8a2f-4d4fed060664`::ref 1 aborting False >Thread-375::INFO::2013-03-01 12:56:55,850::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-375::DEBUG::2013-03-01 12:56:55,850::task::1151::TaskManager.Task::(prepare) Task=`893a3f87-0d70-495d-8a2f-4d4fed060664`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-375::DEBUG::2013-03-01 12:56:55,851::task::568::TaskManager.Task::(_updateState) Task=`893a3f87-0d70-495d-8a2f-4d4fed060664`::moving from state preparing -> state finished >Thread-375::DEBUG::2013-03-01 12:56:55,851::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-375::DEBUG::2013-03-01 12:56:55,851::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-375::DEBUG::2013-03-01 12:56:55,852::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-375::DEBUG::2013-03-01 12:56:55,852::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-375::DEBUG::2013-03-01 12:56:55,852::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-375::DEBUG::2013-03-01 12:56:55,853::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-375::DEBUG::2013-03-01 12:56:55,853::task::957::TaskManager.Task::(_decref) Task=`893a3f87-0d70-495d-8a2f-4d4fed060664`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:56:56,450::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:56,569::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480679 s, 21.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:56:58,580::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:56:58,684::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384149 s, 26.7 MB/s\n'; <rc> = 0 >Thread-377::DEBUG::2013-03-01 12:56:59,325::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-377::DEBUG::2013-03-01 12:56:59,326::task::568::TaskManager.Task::(_updateState) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::moving from state init -> state preparing >Thread-377::INFO::2013-03-01 12:56:59,327::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='959739c8-3e0f-4536-a08c-0f07f76012d4', postZero='false', force='false') >Thread-377::INFO::2013-03-01 12:56:59,327::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-377::DEBUG::2013-03-01 12:56:59,328::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-377::DEBUG::2013-03-01 12:56:59,576::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-377::DEBUG::2013-03-01 12:56:59,576::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-377::DEBUG::2013-03-01 12:56:59,577::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-377::DEBUG::2013-03-01 12:56:59,577::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-377::DEBUG::2013-03-01 12:56:59,578::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-377::DEBUG::2013-03-01 12:56:59,578::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-377::DEBUG::2013-03-01 12:56:59,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:00,710::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-377::DEBUG::2013-03-01 12:57:00,965::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-377::DEBUG::2013-03-01 12:57:01,023::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-377::DEBUG::2013-03-01 12:57:01,047::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-377::DEBUG::2013-03-01 12:57:01,110::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.959739c8-3e0f-4536-a08c-0f07f76012d4`ReqID=`119f9749-f502-4fa3-a4df-e143591b66bd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-377::DEBUG::2013-03-01 12:57:01,123::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4' for lock type 'exclusive' >Thread-377::DEBUG::2013-03-01 12:57:01,146::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4' is free. Now locking as 'exclusive' (1 active user) >Thread-377::DEBUG::2013-03-01 12:57:01,159::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.959739c8-3e0f-4536-a08c-0f07f76012d4`ReqID=`119f9749-f502-4fa3-a4df-e143591b66bd`::Granted request >Thread-377::DEBUG::2013-03-01 12:57:01,189::task::794::TaskManager.Task::(resourceAcquired) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_resourcesAcquired: Storage.959739c8-3e0f-4536-a08c-0f07f76012d4 (exclusive) >Thread-377::DEBUG::2013-03-01 12:57:01,204::task::957::TaskManager.Task::(_decref) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::ref 1 aborting False >Thread-377::DEBUG::2013-03-01 12:57:01,226::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9cbd45e8-652f-483a-8f89-718c318aa12d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-377::DEBUG::2013-03-01 12:57:01,237::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-377::DEBUG::2013-03-01 12:57:01,251::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-377::DEBUG::2013-03-01 12:57:01,263::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9cbd45e8-652f-483a-8f89-718c318aa12d`::Granted request >Thread-377::DEBUG::2013-03-01 12:57:01,289::task::794::TaskManager.Task::(resourceAcquired) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-377::DEBUG::2013-03-01 12:57:01,301::task::957::TaskManager.Task::(_decref) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::ref 1 aborting False >Thread-377::DEBUG::2013-03-01 12:57:01,324::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-377::DEBUG::2013-03-01 12:57:01,370::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:02,803::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.14354 s, 895 kB/s\n'; <rc> = 0 >Thread-377::DEBUG::2013-03-01 12:57:03,196::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-377::DEBUG::2013-03-01 12:57:03,205::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-377::DEBUG::2013-03-01 12:57:03,206::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/dd47427d-525c-48f4-b2c7-22ca377c8c2c' (cwd None) >Thread-377::DEBUG::2013-03-01 12:57:03,437::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-377::DEBUG::2013-03-01 12:57:03,438::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-377::DEBUG::2013-03-01 12:57:03,439::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-377::DEBUG::2013-03-01 12:57:03,439::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4/dd47427d-525c-48f4-b2c7-22ca377c8c2c'] >Thread-377::DEBUG::2013-03-01 12:57:03,439::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/959739c8-3e0f-4536-a08c-0f07f76012d4 >Thread-377::DEBUG::2013-03-01 12:57:03,441::task::719::TaskManager.Task::(_save) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1.temp >Thread-377::DEBUG::2013-03-01 12:57:03,447::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_959739c8-3e0f-4536-a08c-0f07f76012d4 for task 7950aabb-e44f-4305-a659-e36a1147bdd1 >Thread-377::INFO::2013-03-01 12:57:03,448::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-377::DEBUG::2013-03-01 12:57:03,448::task::1146::TaskManager.Task::(prepare) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::Prepare: 1 jobs exist, move to acquiring >Thread-377::DEBUG::2013-03-01 12:57:03,448::task::568::TaskManager.Task::(_updateState) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::moving from state preparing -> state acquiring >Thread-377::DEBUG::2013-03-01 12:57:03,449::task::719::TaskManager.Task::(_save) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1.temp >Thread-377::DEBUG::2013-03-01 12:57:03,456::task::568::TaskManager.Task::(_updateState) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::moving from state acquiring -> state queued >Thread-377::DEBUG::2013-03-01 12:57:03,457::task::719::TaskManager.Task::(_save) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1.temp >Thread-377::DEBUG::2013-03-01 12:57:03,465::taskManager::50::TaskManager::(_queueTask) queuing task: 7950aabb-e44f-4305-a659-e36a1147bdd1 >84446d15-a7a9-4363-84b5-e3312a48a061::DEBUG::2013-03-01 12:57:03,465::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-377::DEBUG::2013-03-01 12:57:03,465::taskManager::56::TaskManager::(_queueTask) task queued: 7950aabb-e44f-4305-a659-e36a1147bdd1 >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,467::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 7950aabb-e44f-4305-a659-e36a1147bdd1 running: <bound method Task.commit of <storage.task.Task instance at 0x163df38>> with: None >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,468::task::1159::TaskManager.Task::(commit) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::committing task: 7950aabb-e44f-4305-a659-e36a1147bdd1 >Thread-377::DEBUG::2013-03-01 12:57:03,468::task::1148::TaskManager.Task::(prepare) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::returning >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,470::task::568::TaskManager.Task::(_updateState) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::moving from state queued -> state running >Thread-377::DEBUG::2013-03-01 12:57:03,471::task::957::TaskManager.Task::(_decref) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::ref 1 aborting False >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,476::task::719::TaskManager.Task::(_save) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1.temp >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,485::task::872::TaskManager.Task::(_runJobs) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::Task.run: running job 0: deleteImage_959739c8-3e0f-4536-a08c-0f07f76012d4: <function <lambda> at 0x7f15ec1ab320> (args: () kwargs: {}) >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,486::task::304::TaskManager.Task::(run) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::Job.run: running deleteImage_959739c8-3e0f-4536-a08c-0f07f76012d4: <function <lambda> at 0x7f15ec1ab320> (args: () kwargs: {}) callback None >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,486::task::568::TaskManager.Task::(_updateState) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::moving from state running -> state finished >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,487::task::719::TaskManager.Task::(_save) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7950aabb-e44f-4305-a659-e36a1147bdd1.temp >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,495::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4': < ResourceRef 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4', isValid: 'True' obj: 'None'>} >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,495::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,495::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,496::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,496::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,496::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,497::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4' >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,497::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4' (0 active users) >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,497::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4' is free, finding out if anyone is waiting for it. >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,498::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.959739c8-3e0f-4536-a08c-0f07f76012d4', Clearing records. >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,498::task::880::TaskManager.Task::(_runJobs) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::Task.run: exit - success: result True >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,498::task::957::TaskManager.Task::(_decref) Task=`7950aabb-e44f-4305-a659-e36a1147bdd1`::ref 0 aborting False >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:57:03,499::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-380::DEBUG::2013-03-01 12:57:04,242::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-380::DEBUG::2013-03-01 12:57:04,242::task::568::TaskManager.Task::(_updateState) Task=`cad9a784-b0fd-416a-bf7c-a466ddf1a175`::moving from state init -> state preparing >Thread-380::INFO::2013-03-01 12:57:04,243::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-380::DEBUG::2013-03-01 12:57:04,243::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-380::DEBUG::2013-03-01 12:57:04,243::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7950aabb-e44f-4305-a659-e36a1147bdd1 >Thread-380::DEBUG::2013-03-01 12:57:04,244::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7950aabb-e44f-4305-a659-e36a1147bdd1'} >Thread-380::DEBUG::2013-03-01 12:57:04,244::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7950aabb-e44f-4305-a659-e36a1147bdd1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7950aabb-e44f-4305-a659-e36a1147bdd1'}} >Thread-380::INFO::2013-03-01 12:57:04,244::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7950aabb-e44f-4305-a659-e36a1147bdd1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7950aabb-e44f-4305-a659-e36a1147bdd1'}}} >Thread-380::DEBUG::2013-03-01 12:57:04,244::task::1151::TaskManager.Task::(prepare) Task=`cad9a784-b0fd-416a-bf7c-a466ddf1a175`::finished: {'allTasksStatus': {'7950aabb-e44f-4305-a659-e36a1147bdd1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7950aabb-e44f-4305-a659-e36a1147bdd1'}}} >Thread-380::DEBUG::2013-03-01 12:57:04,245::task::568::TaskManager.Task::(_updateState) Task=`cad9a784-b0fd-416a-bf7c-a466ddf1a175`::moving from state preparing -> state finished >Thread-380::DEBUG::2013-03-01 12:57:04,245::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-380::DEBUG::2013-03-01 12:57:04,245::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-380::DEBUG::2013-03-01 12:57:04,246::task::957::TaskManager.Task::(_decref) Task=`cad9a784-b0fd-416a-bf7c-a466ddf1a175`::ref 0 aborting False >Thread-381::DEBUG::2013-03-01 12:57:04,334::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-381::DEBUG::2013-03-01 12:57:04,335::task::568::TaskManager.Task::(_updateState) Task=`f1a6e766-f240-4d25-9a09-64fac417767d`::moving from state init -> state preparing >Thread-381::INFO::2013-03-01 12:57:04,335::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='7950aabb-e44f-4305-a659-e36a1147bdd1', spUUID=None, options=None) >Thread-381::DEBUG::2013-03-01 12:57:04,335::taskManager::161::TaskManager::(clearTask) Entry. taskID: 7950aabb-e44f-4305-a659-e36a1147bdd1 >Thread-381::DEBUG::2013-03-01 12:57:04,336::taskManager::166::TaskManager::(clearTask) Return. >Thread-381::INFO::2013-03-01 12:57:04,337::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-381::DEBUG::2013-03-01 12:57:04,337::task::1151::TaskManager.Task::(prepare) Task=`f1a6e766-f240-4d25-9a09-64fac417767d`::finished: None >Thread-381::DEBUG::2013-03-01 12:57:04,337::task::568::TaskManager.Task::(_updateState) Task=`f1a6e766-f240-4d25-9a09-64fac417767d`::moving from state preparing -> state finished >Thread-381::DEBUG::2013-03-01 12:57:04,337::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-381::DEBUG::2013-03-01 12:57:04,338::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-381::DEBUG::2013-03-01 12:57:04,338::task::957::TaskManager.Task::(_decref) Task=`f1a6e766-f240-4d25-9a09-64fac417767d`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:57:04,634::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:04,644::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00030842 s, 13.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:04,900::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:05,009::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460801 s, 22.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:05,719::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:57:05,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-383::DEBUG::2013-03-01 12:57:05,899::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-383::DEBUG::2013-03-01 12:57:05,900::task::568::TaskManager.Task::(_updateState) Task=`e775148d-2115-415b-bc15-2f1e3a0e135f`::moving from state init -> state preparing >Thread-383::INFO::2013-03-01 12:57:05,901::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-383::INFO::2013-03-01 12:57:05,901::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-383::DEBUG::2013-03-01 12:57:05,902::task::1151::TaskManager.Task::(prepare) Task=`e775148d-2115-415b-bc15-2f1e3a0e135f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-383::DEBUG::2013-03-01 12:57:05,902::task::568::TaskManager.Task::(_updateState) Task=`e775148d-2115-415b-bc15-2f1e3a0e135f`::moving from state preparing -> state finished >Thread-383::DEBUG::2013-03-01 12:57:05,902::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-383::DEBUG::2013-03-01 12:57:05,903::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-383::DEBUG::2013-03-01 12:57:05,903::task::957::TaskManager.Task::(_decref) Task=`e775148d-2115-415b-bc15-2f1e3a0e135f`::ref 0 aborting False >Thread-384::DEBUG::2013-03-01 12:57:05,932::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-384::DEBUG::2013-03-01 12:57:05,937::task::568::TaskManager.Task::(_updateState) Task=`e012eb37-3457-4dc6-8be7-239017aefbe1`::moving from state init -> state preparing >Thread-384::INFO::2013-03-01 12:57:05,937::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-384::DEBUG::2013-03-01 12:57:05,938::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`ab16b324-ad7b-4975-8a3e-d46af1265529`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-384::DEBUG::2013-03-01 12:57:05,938::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-384::DEBUG::2013-03-01 12:57:05,938::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-384::DEBUG::2013-03-01 12:57:05,939::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`ab16b324-ad7b-4975-8a3e-d46af1265529`::Granted request >Thread-384::DEBUG::2013-03-01 12:57:05,939::task::794::TaskManager.Task::(resourceAcquired) Task=`e012eb37-3457-4dc6-8be7-239017aefbe1`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-384::DEBUG::2013-03-01 12:57:05,939::task::957::TaskManager.Task::(_decref) Task=`e012eb37-3457-4dc6-8be7-239017aefbe1`::ref 1 aborting False >Thread-384::DEBUG::2013-03-01 12:57:05,940::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-384::DEBUG::2013-03-01 12:57:05,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:57:06,022::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:06,024::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:57:06,033::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000307854 s, 13.3 MB/s\n'; <rc> = 0 >Thread-384::DEBUG::2013-03-01 12:57:06,134::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-384::DEBUG::2013-03-01 12:57:06,136::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-384::INFO::2013-03-01 12:57:06,137::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-384::DEBUG::2013-03-01 12:57:06,138::task::1151::TaskManager.Task::(prepare) Task=`e012eb37-3457-4dc6-8be7-239017aefbe1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-384::DEBUG::2013-03-01 12:57:06,138::task::568::TaskManager.Task::(_updateState) Task=`e012eb37-3457-4dc6-8be7-239017aefbe1`::moving from state preparing -> state finished >Thread-384::DEBUG::2013-03-01 12:57:06,138::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-384::DEBUG::2013-03-01 12:57:06,138::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-384::DEBUG::2013-03-01 12:57:06,139::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-384::DEBUG::2013-03-01 12:57:06,139::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-384::DEBUG::2013-03-01 12:57:06,139::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-384::DEBUG::2013-03-01 12:57:06,139::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-384::DEBUG::2013-03-01 12:57:06,140::task::957::TaskManager.Task::(_decref) Task=`e012eb37-3457-4dc6-8be7-239017aefbe1`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:57:07,028::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:07,118::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0435073 s, 23.5 MB/s\n'; <rc> = 0 >Thread-385::DEBUG::2013-03-01 12:57:08,809::task::568::TaskManager.Task::(_updateState) Task=`2fe9e0b3-462c-4caf-9032-438155dc0a57`::moving from state init -> state preparing >Thread-385::INFO::2013-03-01 12:57:08,809::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-385::INFO::2013-03-01 12:57:08,809::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102770328522', 'lastCheck': '4.2', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0101170539856', 'lastCheck': '2.8', 'code': 0, 'valid': True}} >Thread-385::DEBUG::2013-03-01 12:57:08,810::task::1151::TaskManager.Task::(prepare) Task=`2fe9e0b3-462c-4caf-9032-438155dc0a57`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102770328522', 'lastCheck': '4.2', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0101170539856', 'lastCheck': '2.8', 'code': 0, 'valid': True}} >Thread-385::DEBUG::2013-03-01 12:57:08,810::task::568::TaskManager.Task::(_updateState) Task=`2fe9e0b3-462c-4caf-9032-438155dc0a57`::moving from state preparing -> state finished >Thread-385::DEBUG::2013-03-01 12:57:08,810::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-385::DEBUG::2013-03-01 12:57:08,811::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-385::DEBUG::2013-03-01 12:57:08,811::task::957::TaskManager.Task::(_decref) Task=`2fe9e0b3-462c-4caf-9032-438155dc0a57`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:57:09,131::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:09,238::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419917 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:11,257::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:11,345::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402702 s, 25.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:13,363::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:13,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414452 s, 24.7 MB/s\n'; <rc> = 0 >Thread-388::DEBUG::2013-03-01 12:57:14,508::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmCreate with ({'custom': {}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'cpuType': 'Westmere', 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '47857bd1-f279-4d16-9b4c-22d3ecc94bd0'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'ff0f079a-3661-444d-a396-2118320b95b2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'ide', 'format': 'cow', 'type': 'disk', 'volumeID': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade', 'specParams': {}, 'readonly': 'false', 'domainID': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'deviceId': 'e7934077-6752-4445-a00a-1f2551119ade', 'poolID': '41b11cc6-b020-47d9-b70e-c4fadcc621be', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:bc', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '6e824597-2e9b-4ecc-9f88-aef1cdc5fc97', 'device': 'bridge', 'type': 'interface'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '84b6e137-8325-4950-9d33-5e398518be35'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '34608156-eba6-47ab-8208-51d696e02abd'}], 'smp': '1', 'vmType': 'kvm', 'timeOffset': '0', 'memSize': 512, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smartcardEnable': 'false', 'vmName': 'vm_for_snapshot', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} >Thread-388::INFO::2013-03-01 12:57:14,508::API::625::vds::(_getNetworkIp) network None: using 0 >Thread-388::INFO::2013-03-01 12:57:14,509::clientIF::349::vds::(createVm) vmContainerLock acquired by vm bb607f4f-1442-4f4c-8f78-8dc0f9526e32 >Thread-388::DEBUG::2013-03-01 12:57:14,540::clientIF::363::vds::(createVm) Total desktops after creation of bb607f4f-1442-4f4c-8f78-8dc0f9526e32 is 1 >Thread-389::DEBUG::2013-03-01 12:57:14,540::vm::655::vm.Vm::(_startUnderlyingVm) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Start >Thread-388::DEBUG::2013-03-01 12:57:14,541::BindingXMLRPC::920::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.4.0', 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'pid': '0', 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '47857bd1-f279-4d16-9b4c-22d3ecc94bd0'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'ff0f079a-3661-444d-a396-2118320b95b2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'ide', 'format': 'cow', 'type': 'disk', 'volumeID': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade', 'specParams': {}, 'readonly': 'false', 'domainID': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'deviceId': 'e7934077-6752-4445-a00a-1f2551119ade', 'poolID': '41b11cc6-b020-47d9-b70e-c4fadcc621be', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:81:bc', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '6e824597-2e9b-4ecc-9f88-aef1cdc5fc97', 'device': 'bridge', 'type': 'interface'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '84b6e137-8325-4950-9d33-5e398518be35'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '34608156-eba6-47ab-8208-51d696e02abd'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 512, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm_for_snapshot', 'display': 'qxl', 'nice': '0'}} >Thread-389::DEBUG::2013-03-01 12:57:14,543::vm::659::vm.Vm::(_startUnderlyingVm) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::_ongoingCreations acquired >Thread-389::INFO::2013-03-01 12:57:14,545::libvirtvm::1434::vm.Vm::(_run) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::VM wrapper has started >Thread-389::DEBUG::2013-03-01 12:57:14,548::task::568::TaskManager.Task::(_updateState) Task=`112bd442-572b-4bd5-81f6-10ef525aa882`::moving from state init -> state preparing >Thread-389::INFO::2013-03-01 12:57:14,550::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', options=None) >Thread-389::INFO::2013-03-01 12:57:14,553::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-389::DEBUG::2013-03-01 12:57:14,553::task::1151::TaskManager.Task::(prepare) Task=`112bd442-572b-4bd5-81f6-10ef525aa882`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-389::DEBUG::2013-03-01 12:57:14,553::task::568::TaskManager.Task::(_updateState) Task=`112bd442-572b-4bd5-81f6-10ef525aa882`::moving from state preparing -> state finished >Thread-389::DEBUG::2013-03-01 12:57:14,554::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-389::DEBUG::2013-03-01 12:57:14,554::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-389::DEBUG::2013-03-01 12:57:14,554::task::957::TaskManager.Task::(_decref) Task=`112bd442-572b-4bd5-81f6-10ef525aa882`::ref 0 aborting False >Thread-389::INFO::2013-03-01 12:57:14,554::clientIF::331::vds::(prepareVolumePath) prepared volume path: >Thread-389::DEBUG::2013-03-01 12:57:14,555::task::568::TaskManager.Task::(_updateState) Task=`2cfc2710-6cdf-4b43-81e2-aa5efe84cd89`::moving from state init -> state preparing >Thread-389::INFO::2013-03-01 12:57:14,555::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97') >Thread-389::DEBUG::2013-03-01 12:57:14,556::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a3575a83-b520-41bd-9c99-de613e6e9f75`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-389::DEBUG::2013-03-01 12:57:14,556::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-389::DEBUG::2013-03-01 12:57:14,557::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-389::DEBUG::2013-03-01 12:57:14,557::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a3575a83-b520-41bd-9c99-de613e6e9f75`::Granted request >Thread-389::DEBUG::2013-03-01 12:57:14,558::task::794::TaskManager.Task::(resourceAcquired) Task=`2cfc2710-6cdf-4b43-81e2-aa5efe84cd89`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-389::DEBUG::2013-03-01 12:57:14,558::task::957::TaskManager.Task::(_decref) Task=`2cfc2710-6cdf-4b43-81e2-aa5efe84cd89`::ref 1 aborting False >Thread-389::DEBUG::2013-03-01 12:57:14,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-389::DEBUG::2013-03-01 12:57:14,569::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000405506 s, 1.3 MB/s\n'; <rc> = 0 >Thread-389::DEBUG::2013-03-01 12:57:14,569::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000405506 s, 1.3 MB/s'], size: 512 >Thread-389::DEBUG::2013-03-01 12:57:14,570::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-389::DEBUG::2013-03-01 12:57:14,580::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000394249 s, 1.3 MB/s\n'; <rc> = 0 >Thread-389::DEBUG::2013-03-01 12:57:14,580::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000394249 s, 1.3 MB/s'], size: 512 >Thread-389::INFO::2013-03-01 12:57:14,581::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15f802e350>, <storage.blockVolume.BlockVolume object at 0x7f15f802e310>] >Thread-389::DEBUG::2013-03-01 12:57:14,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 a558fc2a-a4a3-4118-9b81-d1d601eaa295/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:14,646::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:14,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000310987 s, 13.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:15,476::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:15,567::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437721 s, 23.4 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:16,038::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:57:16,053::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00038692 s, 10.6 MB/s\n'; <rc> = 0 >Thread-392::DEBUG::2013-03-01 12:57:16,179::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-392::DEBUG::2013-03-01 12:57:16,185::task::568::TaskManager.Task::(_updateState) Task=`8601a989-35a3-4bb7-b5e6-3d2f589526f2`::moving from state init -> state preparing >Thread-392::INFO::2013-03-01 12:57:16,185::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-392::INFO::2013-03-01 12:57:16,186::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-392::DEBUG::2013-03-01 12:57:16,186::task::1151::TaskManager.Task::(prepare) Task=`8601a989-35a3-4bb7-b5e6-3d2f589526f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-392::DEBUG::2013-03-01 12:57:16,186::task::568::TaskManager.Task::(_updateState) Task=`8601a989-35a3-4bb7-b5e6-3d2f589526f2`::moving from state preparing -> state finished >Thread-392::DEBUG::2013-03-01 12:57:16,186::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-392::DEBUG::2013-03-01 12:57:16,186::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-392::DEBUG::2013-03-01 12:57:16,187::task::957::TaskManager.Task::(_decref) Task=`8601a989-35a3-4bb7-b5e6-3d2f589526f2`::ref 0 aborting False >Thread-393::DEBUG::2013-03-01 12:57:16,220::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-393::DEBUG::2013-03-01 12:57:16,221::task::568::TaskManager.Task::(_updateState) Task=`21b129f6-8c2a-4c59-989e-aabfd74f9f3a`::moving from state init -> state preparing >Thread-393::INFO::2013-03-01 12:57:16,221::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-393::DEBUG::2013-03-01 12:57:16,222::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`73a5f3f0-b02a-4bb6-9063-c9f80fb9e34e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-393::DEBUG::2013-03-01 12:57:16,222::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-393::DEBUG::2013-03-01 12:57:16,223::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-393::DEBUG::2013-03-01 12:57:16,223::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`73a5f3f0-b02a-4bb6-9063-c9f80fb9e34e`::Granted request >Thread-393::DEBUG::2013-03-01 12:57:16,223::task::794::TaskManager.Task::(resourceAcquired) Task=`21b129f6-8c2a-4c59-989e-aabfd74f9f3a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-393::DEBUG::2013-03-01 12:57:16,224::task::957::TaskManager.Task::(_decref) Task=`21b129f6-8c2a-4c59-989e-aabfd74f9f3a`::ref 1 aborting False >Thread-393::INFO::2013-03-01 12:57:16,225::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-393::DEBUG::2013-03-01 12:57:16,226::task::1151::TaskManager.Task::(prepare) Task=`21b129f6-8c2a-4c59-989e-aabfd74f9f3a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-393::DEBUG::2013-03-01 12:57:16,226::task::568::TaskManager.Task::(_updateState) Task=`21b129f6-8c2a-4c59-989e-aabfd74f9f3a`::moving from state preparing -> state finished >Thread-393::DEBUG::2013-03-01 12:57:16,226::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-393::DEBUG::2013-03-01 12:57:16,226::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-393::DEBUG::2013-03-01 12:57:16,227::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-393::DEBUG::2013-03-01 12:57:16,227::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-393::DEBUG::2013-03-01 12:57:16,227::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-393::DEBUG::2013-03-01 12:57:16,227::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-393::DEBUG::2013-03-01 12:57:16,228::task::957::TaskManager.Task::(_decref) Task=`21b129f6-8c2a-4c59-989e-aabfd74f9f3a`::ref 0 aborting False >Thread-389::DEBUG::2013-03-01 12:57:16,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-389::DEBUG::2013-03-01 12:57:16,302::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-389::DEBUG::2013-03-01 12:57:16,302::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-389::INFO::2013-03-01 12:57:16,303::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'chain': [{'path': '/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7', 'domainID': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'volumeID': '641da936-3f96-4831-a341-cd57756ebef7', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}, {'path': '/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'domainID': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'volumeID': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}]} >Thread-389::DEBUG::2013-03-01 12:57:16,303::task::1151::TaskManager.Task::(prepare) Task=`2cfc2710-6cdf-4b43-81e2-aa5efe84cd89`::finished: {'path': '/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'chain': [{'path': '/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7', 'domainID': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'volumeID': '641da936-3f96-4831-a341-cd57756ebef7', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}, {'path': '/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'domainID': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'volumeID': '07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}]} >Thread-389::DEBUG::2013-03-01 12:57:16,303::task::568::TaskManager.Task::(_updateState) Task=`2cfc2710-6cdf-4b43-81e2-aa5efe84cd89`::moving from state preparing -> state finished >Thread-389::DEBUG::2013-03-01 12:57:16,303::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-389::DEBUG::2013-03-01 12:57:16,304::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-389::DEBUG::2013-03-01 12:57:16,304::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-389::DEBUG::2013-03-01 12:57:16,305::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-389::DEBUG::2013-03-01 12:57:16,305::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-389::DEBUG::2013-03-01 12:57:16,305::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-389::DEBUG::2013-03-01 12:57:16,306::task::957::TaskManager.Task::(_decref) Task=`2cfc2710-6cdf-4b43-81e2-aa5efe84cd89`::ref 0 aborting False >Thread-389::INFO::2013-03-01 12:57:16,306::clientIF::331::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 >Thread-389::DEBUG::2013-03-01 12:57:16,321::libvirtvm::1489::vm.Vm::(_run) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>vm_for_snapshot</name> > <uuid>bb607f4f-1442-4f4c-8f78-8dc0f9526e32</uuid> > <memory>524288</memory> > <currentMemory>524288</currentMemory> > <vcpu>1</vcpu> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/vm_for_snapshot.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/vm_for_snapshot.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <sound model="ich6"/> > <video> > <model heads="1" type="qxl" vram="65536"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:16:81:bc"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > </interface> > <memballoon model="virtio"/> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial></serial> > </disk> > <disk device="disk" snapshot="no" type="block"> > <source dev="/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97"/> > <target bus="ide" dev="hda"/> > <serial>e7934077-6752-4445-a00a-1f2551119ade</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.4.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.4.0.4.el6</entry> > <entry name="serial">70a2f218-c088-4421-a726-dce0602f06f0</entry> > <entry name="uuid">bb607f4f-1442-4f4c-8f78-8dc0f9526e32</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Westmere</model> > <topology cores="1" sockets="1" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2013-03-01 12:57:17,115::libvirtvm::3003::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::event Started detail 0 opaque None >Thread-389::DEBUG::2013-03-01 12:57:17,221::utils::346::vm.Vm::(start) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Start statistics collection >Thread-394::DEBUG::2013-03-01 12:57:17,221::utils::375::vm.Vm::(run) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Stats thread started >Thread-389::DEBUG::2013-03-01 12:57:17,225::vmChannels::144::vds::(register) Add fileno 17 to listener's channels. >Thread-389::WARNING::2013-03-01 12:57:17,227::libvirtvm::1851::vm.Vm::(_readPauseCode) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::_readPauseCode unsupported by libvirt vm >Thread-394::DEBUG::2013-03-01 12:57:17,228::task::568::TaskManager.Task::(_updateState) Task=`2e7b2533-f5dc-47c6-ad1c-5e01f6afbc7e`::moving from state init -> state preparing >Thread-394::INFO::2013-03-01 12:57:17,229::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', options=None) >Thread-394::INFO::2013-03-01 12:57:17,230::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-394::DEBUG::2013-03-01 12:57:17,230::task::1151::TaskManager.Task::(prepare) Task=`2e7b2533-f5dc-47c6-ad1c-5e01f6afbc7e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-394::DEBUG::2013-03-01 12:57:17,230::task::568::TaskManager.Task::(_updateState) Task=`2e7b2533-f5dc-47c6-ad1c-5e01f6afbc7e`::moving from state preparing -> state finished >Thread-394::DEBUG::2013-03-01 12:57:17,230::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-394::DEBUG::2013-03-01 12:57:17,231::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-394::DEBUG::2013-03-01 12:57:17,231::task::957::TaskManager.Task::(_decref) Task=`2e7b2533-f5dc-47c6-ad1c-5e01f6afbc7e`::ref 0 aborting False >Thread-389::DEBUG::2013-03-01 12:57:17,321::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >Thread-389::DEBUG::2013-03-01 12:57:17,371::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-389::DEBUG::2013-03-01 12:57:17,372::vm::676::vm.Vm::(_startUnderlyingVm) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::_ongoingCreations released >Dummy-173::DEBUG::2013-03-01 12:57:17,581::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:17,654::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267193 s, 38.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2013-03-01 12:57:17,743::vmChannels::71::vds::(_do_add_channels) fileno 17 was added to unconnected channels. >VM Channels Listener::DEBUG::2013-03-01 12:57:17,744::vmChannels::103::vds::(_handle_unconnected) Trying to connect fileno 17. >VM Channels Listener::DEBUG::2013-03-01 12:57:17,744::guestIF::120::vm.Vm::(_connect) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Attempting connection to /var/lib/libvirt/qemu/channels/vm_for_snapshot.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2013-03-01 12:57:17,746::guestIF::122::vm.Vm::(_connect) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Connected to /var/lib/libvirt/qemu/channels/vm_for_snapshot.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2013-03-01 12:57:17,746::vmChannels::106::vds::(_handle_unconnected) Connect fileno 17 was succeed. >Thread-396::DEBUG::2013-03-01 12:57:18,047::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-396::DEBUG::2013-03-01 12:57:18,047::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-396::DEBUG::2013-03-01 12:57:18,048::libvirtvm::249::vm.Vm::(_getNetworkStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Network stats not available >Thread-396::DEBUG::2013-03-01 12:57:18,048::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-396::DEBUG::2013-03-01 12:57:18,048::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-396::DEBUG::2013-03-01 12:57:18,049::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-396::DEBUG::2013-03-01 12:57:18,049::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-396::DEBUG::2013-03-01 12:57:18,049::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:16:81:bc', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.82', 'elapsedTime': '3', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:19,667::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:19,756::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442859 s, 23.1 MB/s\n'; <rc> = 0 >Thread-399::DEBUG::2013-03-01 12:57:21,227::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-399::DEBUG::2013-03-01 12:57:21,227::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-399::DEBUG::2013-03-01 12:57:21,227::libvirtvm::249::vm.Vm::(_getNetworkStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Network stats not available >Thread-399::DEBUG::2013-03-01 12:57:21,227::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-399::DEBUG::2013-03-01 12:57:21,228::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-399::DEBUG::2013-03-01 12:57:21,228::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-399::DEBUG::2013-03-01 12:57:21,228::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-399::DEBUG::2013-03-01 12:57:21,229::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:16:81:bc', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '1.85', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:21,770::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:21,839::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026211 s, 39.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:23,856::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-400::DEBUG::2013-03-01 12:57:24,386::task::568::TaskManager.Task::(_updateState) Task=`a6f974f9-e0b4-4ce1-b547-a71e1b1ef198`::moving from state init -> state preparing >Thread-400::INFO::2013-03-01 12:57:24,398::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-400::INFO::2013-03-01 12:57:24,406::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0101840496063', 'lastCheck': '9.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0158169269562', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-400::DEBUG::2013-03-01 12:57:24,414::task::1151::TaskManager.Task::(prepare) Task=`a6f974f9-e0b4-4ce1-b547-a71e1b1ef198`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0101840496063', 'lastCheck': '9.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0158169269562', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-400::DEBUG::2013-03-01 12:57:24,424::task::568::TaskManager.Task::(_updateState) Task=`a6f974f9-e0b4-4ce1-b547-a71e1b1ef198`::moving from state preparing -> state finished >Thread-400::DEBUG::2013-03-01 12:57:24,429::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-400::DEBUG::2013-03-01 12:57:24,437::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-400::DEBUG::2013-03-01 12:57:24,445::task::957::TaskManager.Task::(_decref) Task=`a6f974f9-e0b4-4ce1-b547-a71e1b1ef198`::ref 0 aborting False >Thread-401::DEBUG::2013-03-01 12:57:24,633::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-401::DEBUG::2013-03-01 12:57:24,638::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-401::DEBUG::2013-03-01 12:57:24,642::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-401::DEBUG::2013-03-01 12:57:24,646::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-401::DEBUG::2013-03-01 12:57:24,650::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-255::DEBUG::2013-03-01 12:57:24,676::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:24,989::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00451625 s, 907 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:25,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.995634 s, 1.0 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:26,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:57:26,072::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000354288 s, 11.6 MB/s\n'; <rc> = 0 >Thread-402::DEBUG::2013-03-01 12:57:26,274::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-402::DEBUG::2013-03-01 12:57:26,275::task::568::TaskManager.Task::(_updateState) Task=`d94b0b78-dabc-4512-b9ce-696dea4238fe`::moving from state init -> state preparing >Thread-402::INFO::2013-03-01 12:57:26,275::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-402::INFO::2013-03-01 12:57:26,275::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-402::DEBUG::2013-03-01 12:57:26,276::task::1151::TaskManager.Task::(prepare) Task=`d94b0b78-dabc-4512-b9ce-696dea4238fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-402::DEBUG::2013-03-01 12:57:26,276::task::568::TaskManager.Task::(_updateState) Task=`d94b0b78-dabc-4512-b9ce-696dea4238fe`::moving from state preparing -> state finished >Thread-402::DEBUG::2013-03-01 12:57:26,276::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-402::DEBUG::2013-03-01 12:57:26,276::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-402::DEBUG::2013-03-01 12:57:26,276::task::957::TaskManager.Task::(_decref) Task=`d94b0b78-dabc-4512-b9ce-696dea4238fe`::ref 0 aborting False >Thread-403::DEBUG::2013-03-01 12:57:26,301::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-403::DEBUG::2013-03-01 12:57:26,301::task::568::TaskManager.Task::(_updateState) Task=`081b46ef-75bf-407d-9035-e17afd1367c7`::moving from state init -> state preparing >Thread-403::INFO::2013-03-01 12:57:26,301::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-403::DEBUG::2013-03-01 12:57:26,302::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1fd90820-8bdc-450c-acb5-5d30aec88c8a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-403::DEBUG::2013-03-01 12:57:26,302::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-403::DEBUG::2013-03-01 12:57:26,302::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-403::DEBUG::2013-03-01 12:57:26,303::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1fd90820-8bdc-450c-acb5-5d30aec88c8a`::Granted request >Thread-403::DEBUG::2013-03-01 12:57:26,303::task::794::TaskManager.Task::(resourceAcquired) Task=`081b46ef-75bf-407d-9035-e17afd1367c7`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-403::DEBUG::2013-03-01 12:57:26,303::task::957::TaskManager.Task::(_decref) Task=`081b46ef-75bf-407d-9035-e17afd1367c7`::ref 1 aborting False >Thread-403::INFO::2013-03-01 12:57:26,304::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-403::DEBUG::2013-03-01 12:57:26,304::task::1151::TaskManager.Task::(prepare) Task=`081b46ef-75bf-407d-9035-e17afd1367c7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-403::DEBUG::2013-03-01 12:57:26,305::task::568::TaskManager.Task::(_updateState) Task=`081b46ef-75bf-407d-9035-e17afd1367c7`::moving from state preparing -> state finished >Thread-403::DEBUG::2013-03-01 12:57:26,305::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-403::DEBUG::2013-03-01 12:57:26,305::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-403::DEBUG::2013-03-01 12:57:26,305::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-403::DEBUG::2013-03-01 12:57:26,306::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-403::DEBUG::2013-03-01 12:57:26,306::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-403::DEBUG::2013-03-01 12:57:26,306::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-403::DEBUG::2013-03-01 12:57:26,306::task::957::TaskManager.Task::(_decref) Task=`081b46ef-75bf-407d-9035-e17afd1367c7`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:57:27,208::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:27,277::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261053 s, 39.2 MB/s\n'; <rc> = 0 >Thread-405::DEBUG::2013-03-01 12:57:27,850::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-405::DEBUG::2013-03-01 12:57:27,850::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-405::DEBUG::2013-03-01 12:57:27,850::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-405::DEBUG::2013-03-01 12:57:27,850::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-405::DEBUG::2013-03-01 12:57:27,851::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-405::DEBUG::2013-03-01 12:57:27,851::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-405::DEBUG::2013-03-01 12:57:27,851::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:29,291::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:29,368::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322692 s, 31.7 MB/s\n'; <rc> = 0 >Thread-407::DEBUG::2013-03-01 12:57:31,000::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-407::DEBUG::2013-03-01 12:57:31,004::libvirtvm::217::vm.Vm::(_getCpuStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-407::DEBUG::2013-03-01 12:57:31,008::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-407::DEBUG::2013-03-01 12:57:31,011::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-407::DEBUG::2013-03-01 12:57:31,014::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-407::DEBUG::2013-03-01 12:57:31,017::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-407::DEBUG::2013-03-01 12:57:31,022::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:31,383::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:32,753::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.45818 s, 2.2 MB/s\n'; <rc> = 0 >Thread-409::DEBUG::2013-03-01 12:57:34,098::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-409::DEBUG::2013-03-01 12:57:34,098::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-409::DEBUG::2013-03-01 12:57:34,098::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-409::DEBUG::2013-03-01 12:57:34,099::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-409::DEBUG::2013-03-01 12:57:34,099::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-409::DEBUG::2013-03-01 12:57:34,099::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '48.64', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '28.49', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:34,845::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:34,916::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265252 s, 38.6 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:57:35,129::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:35,137::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000398224 s, 10.3 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:36,077::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:57:36,089::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000413911 s, 9.9 MB/s\n'; <rc> = 0 >Thread-410::DEBUG::2013-03-01 12:57:36,541::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-410::DEBUG::2013-03-01 12:57:36,542::task::568::TaskManager.Task::(_updateState) Task=`e13be938-f2d9-4fa5-bc04-52bee0b858b1`::moving from state init -> state preparing >Thread-410::INFO::2013-03-01 12:57:36,542::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-410::INFO::2013-03-01 12:57:36,542::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-410::DEBUG::2013-03-01 12:57:36,542::task::1151::TaskManager.Task::(prepare) Task=`e13be938-f2d9-4fa5-bc04-52bee0b858b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-410::DEBUG::2013-03-01 12:57:36,543::task::568::TaskManager.Task::(_updateState) Task=`e13be938-f2d9-4fa5-bc04-52bee0b858b1`::moving from state preparing -> state finished >Thread-410::DEBUG::2013-03-01 12:57:36,543::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-410::DEBUG::2013-03-01 12:57:36,543::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-410::DEBUG::2013-03-01 12:57:36,543::task::957::TaskManager.Task::(_decref) Task=`e13be938-f2d9-4fa5-bc04-52bee0b858b1`::ref 0 aborting False >Thread-411::DEBUG::2013-03-01 12:57:36,568::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-411::DEBUG::2013-03-01 12:57:36,568::task::568::TaskManager.Task::(_updateState) Task=`ff355dc0-a82f-402a-98cf-6d9dd060903a`::moving from state init -> state preparing >Thread-411::INFO::2013-03-01 12:57:36,568::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-411::DEBUG::2013-03-01 12:57:36,569::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3bcedeb7-c9f6-4a5e-822e-ac0458c1b9e6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-411::DEBUG::2013-03-01 12:57:36,569::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-411::DEBUG::2013-03-01 12:57:36,569::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-411::DEBUG::2013-03-01 12:57:36,569::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3bcedeb7-c9f6-4a5e-822e-ac0458c1b9e6`::Granted request >Thread-411::DEBUG::2013-03-01 12:57:36,570::task::794::TaskManager.Task::(resourceAcquired) Task=`ff355dc0-a82f-402a-98cf-6d9dd060903a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-411::DEBUG::2013-03-01 12:57:36,570::task::957::TaskManager.Task::(_decref) Task=`ff355dc0-a82f-402a-98cf-6d9dd060903a`::ref 1 aborting False >Thread-411::INFO::2013-03-01 12:57:36,571::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-411::DEBUG::2013-03-01 12:57:36,571::task::1151::TaskManager.Task::(prepare) Task=`ff355dc0-a82f-402a-98cf-6d9dd060903a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-411::DEBUG::2013-03-01 12:57:36,572::task::568::TaskManager.Task::(_updateState) Task=`ff355dc0-a82f-402a-98cf-6d9dd060903a`::moving from state preparing -> state finished >Thread-411::DEBUG::2013-03-01 12:57:36,572::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-411::DEBUG::2013-03-01 12:57:36,572::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-411::DEBUG::2013-03-01 12:57:36,572::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-411::DEBUG::2013-03-01 12:57:36,573::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-411::DEBUG::2013-03-01 12:57:36,573::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-411::DEBUG::2013-03-01 12:57:36,573::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-411::DEBUG::2013-03-01 12:57:36,573::task::957::TaskManager.Task::(_decref) Task=`ff355dc0-a82f-402a-98cf-6d9dd060903a`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:57:36,933::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-413::DEBUG::2013-03-01 12:57:37,426::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-413::DEBUG::2013-03-01 12:57:37,460::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-413::DEBUG::2013-03-01 12:57:37,482::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-413::DEBUG::2013-03-01 12:57:37,501::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-413::DEBUG::2013-03-01 12:57:37,522::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-413::DEBUG::2013-03-01 12:57:37,555::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '48.64', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '1.73', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '28.49', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:38,640::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.89404 s, 1.1 MB/s\n'; <rc> = 0 >Thread-414::DEBUG::2013-03-01 12:57:40,698::task::568::TaskManager.Task::(_updateState) Task=`2f5feb2e-2f1b-4143-ad7c-0a683b8d36d8`::moving from state init -> state preparing >Thread-414::INFO::2013-03-01 12:57:40,698::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-414::INFO::2013-03-01 12:57:40,698::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00839591026306', 'lastCheck': '5.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0122158527374', 'lastCheck': '4.6', 'code': 0, 'valid': True}} >Thread-414::DEBUG::2013-03-01 12:57:40,698::task::1151::TaskManager.Task::(prepare) Task=`2f5feb2e-2f1b-4143-ad7c-0a683b8d36d8`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00839591026306', 'lastCheck': '5.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0122158527374', 'lastCheck': '4.6', 'code': 0, 'valid': True}} >Thread-414::DEBUG::2013-03-01 12:57:40,699::task::568::TaskManager.Task::(_updateState) Task=`2f5feb2e-2f1b-4143-ad7c-0a683b8d36d8`::moving from state preparing -> state finished >Thread-414::DEBUG::2013-03-01 12:57:40,699::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-414::DEBUG::2013-03-01 12:57:40,699::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-414::DEBUG::2013-03-01 12:57:40,699::task::957::TaskManager.Task::(_decref) Task=`2f5feb2e-2f1b-4143-ad7c-0a683b8d36d8`::ref 0 aborting False >Thread-415::DEBUG::2013-03-01 12:57:40,732::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-415::DEBUG::2013-03-01 12:57:40,733::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-415::DEBUG::2013-03-01 12:57:40,733::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-415::DEBUG::2013-03-01 12:57:40,733::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Dummy-173::DEBUG::2013-03-01 12:57:40,755::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:40,829::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291207 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:42,843::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:42,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256544 s, 39.9 MB/s\n'; <rc> = 0 >Thread-417::DEBUG::2013-03-01 12:57:43,875::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-417::DEBUG::2013-03-01 12:57:43,875::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-417::DEBUG::2013-03-01 12:57:43,875::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-417::DEBUG::2013-03-01 12:57:43,876::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-417::DEBUG::2013-03-01 12:57:43,876::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-417::DEBUG::2013-03-01 12:57:43,876::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '48.64', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.02', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '28.49', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:44,936::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:45,005::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258388 s, 39.6 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:57:45,138::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:45,147::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000301703 s, 13.6 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:46,095::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:57:46,105::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000361438 s, 11.3 MB/s\n'; <rc> = 0 >Thread-418::DEBUG::2013-03-01 12:57:46,614::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-418::DEBUG::2013-03-01 12:57:46,614::task::568::TaskManager.Task::(_updateState) Task=`6d6b4ee5-3baa-4cc4-9c9b-4b1a3703ba66`::moving from state init -> state preparing >Thread-418::INFO::2013-03-01 12:57:46,615::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-418::INFO::2013-03-01 12:57:46,615::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-418::DEBUG::2013-03-01 12:57:46,615::task::1151::TaskManager.Task::(prepare) Task=`6d6b4ee5-3baa-4cc4-9c9b-4b1a3703ba66`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-418::DEBUG::2013-03-01 12:57:46,615::task::568::TaskManager.Task::(_updateState) Task=`6d6b4ee5-3baa-4cc4-9c9b-4b1a3703ba66`::moving from state preparing -> state finished >Thread-418::DEBUG::2013-03-01 12:57:46,615::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-418::DEBUG::2013-03-01 12:57:46,616::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-418::DEBUG::2013-03-01 12:57:46,616::task::957::TaskManager.Task::(_decref) Task=`6d6b4ee5-3baa-4cc4-9c9b-4b1a3703ba66`::ref 0 aborting False >Thread-419::DEBUG::2013-03-01 12:57:46,640::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-419::DEBUG::2013-03-01 12:57:46,640::task::568::TaskManager.Task::(_updateState) Task=`d6b8521a-608f-4019-91c7-bdadc6674a60`::moving from state init -> state preparing >Thread-419::INFO::2013-03-01 12:57:46,640::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-419::DEBUG::2013-03-01 12:57:46,641::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3e495418-ce8a-4e19-9627-ce070f716477`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-419::DEBUG::2013-03-01 12:57:46,641::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-419::DEBUG::2013-03-01 12:57:46,641::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-419::DEBUG::2013-03-01 12:57:46,642::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3e495418-ce8a-4e19-9627-ce070f716477`::Granted request >Thread-419::DEBUG::2013-03-01 12:57:46,642::task::794::TaskManager.Task::(resourceAcquired) Task=`d6b8521a-608f-4019-91c7-bdadc6674a60`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-419::DEBUG::2013-03-01 12:57:46,642::task::957::TaskManager.Task::(_decref) Task=`d6b8521a-608f-4019-91c7-bdadc6674a60`::ref 1 aborting False >Thread-419::INFO::2013-03-01 12:57:46,643::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-419::DEBUG::2013-03-01 12:57:46,643::task::1151::TaskManager.Task::(prepare) Task=`d6b8521a-608f-4019-91c7-bdadc6674a60`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-419::DEBUG::2013-03-01 12:57:46,644::task::568::TaskManager.Task::(_updateState) Task=`d6b8521a-608f-4019-91c7-bdadc6674a60`::moving from state preparing -> state finished >Thread-419::DEBUG::2013-03-01 12:57:46,644::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-419::DEBUG::2013-03-01 12:57:46,644::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-419::DEBUG::2013-03-01 12:57:46,644::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-419::DEBUG::2013-03-01 12:57:46,645::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-419::DEBUG::2013-03-01 12:57:46,645::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-419::DEBUG::2013-03-01 12:57:46,645::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-419::DEBUG::2013-03-01 12:57:46,645::task::957::TaskManager.Task::(_decref) Task=`d6b8521a-608f-4019-91c7-bdadc6674a60`::ref 0 aborting False >Thread-421::DEBUG::2013-03-01 12:57:46,939::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-421::DEBUG::2013-03-01 12:57:46,939::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-421::DEBUG::2013-03-01 12:57:46,939::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-421::DEBUG::2013-03-01 12:57:46,940::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-421::DEBUG::2013-03-01 12:57:46,940::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-421::DEBUG::2013-03-01 12:57:46,940::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '48.64', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '1.08', 'elapsedTime': '32', 'vmType': 'kvm', 'cpuSys': '28.49', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:47,019::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:47,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312177 s, 32.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2013-03-01 12:57:47,897::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Dummy-173::DEBUG::2013-03-01 12:57:49,106::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:49,176::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264662 s, 38.7 MB/s\n'; <rc> = 0 >Thread-423::DEBUG::2013-03-01 12:57:50,015::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-423::DEBUG::2013-03-01 12:57:50,016::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-423::DEBUG::2013-03-01 12:57:50,016::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-423::DEBUG::2013-03-01 12:57:50,016::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-423::DEBUG::2013-03-01 12:57:50,016::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-423::DEBUG::2013-03-01 12:57:50,017::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '76.02', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.09', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '26.01', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:51,190::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:51,264::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298062 s, 34.4 MB/s\n'; <rc> = 0 >Thread-425::DEBUG::2013-03-01 12:57:53,080::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-425::DEBUG::2013-03-01 12:57:53,081::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-425::DEBUG::2013-03-01 12:57:53,081::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-425::DEBUG::2013-03-01 12:57:53,081::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-425::DEBUG::2013-03-01 12:57:53,082::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-425::DEBUG::2013-03-01 12:57:53,082::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '76.02', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '26.01', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:53,277::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:53,370::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04641 s, 22.1 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:57:55,149::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:57:55,159::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000494523 s, 8.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:57:55,384::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:55,465::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362891 s, 28.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:57:56,109::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-426::DEBUG::2013-03-01 12:57:56,124::task::568::TaskManager.Task::(_updateState) Task=`03746065-a2ef-4d25-b7a4-a0c532704fd2`::moving from state init -> state preparing >Thread-426::INFO::2013-03-01 12:57:56,127::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-426::INFO::2013-03-01 12:57:56,129::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0105879306793', 'lastCheck': '1.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00989699363708', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-426::DEBUG::2013-03-01 12:57:56,131::task::1151::TaskManager.Task::(prepare) Task=`03746065-a2ef-4d25-b7a4-a0c532704fd2`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0105879306793', 'lastCheck': '1.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.00989699363708', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-426::DEBUG::2013-03-01 12:57:56,133::task::568::TaskManager.Task::(_updateState) Task=`03746065-a2ef-4d25-b7a4-a0c532704fd2`::moving from state preparing -> state finished >Thread-426::DEBUG::2013-03-01 12:57:56,134::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-426::DEBUG::2013-03-01 12:57:56,136::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-426::DEBUG::2013-03-01 12:57:56,139::task::957::TaskManager.Task::(_decref) Task=`03746065-a2ef-4d25-b7a4-a0c532704fd2`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 12:57:56,143::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000360221 s, 11.4 MB/s\n'; <rc> = 0 >Thread-427::DEBUG::2013-03-01 12:57:56,220::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-427::DEBUG::2013-03-01 12:57:56,221::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-427::DEBUG::2013-03-01 12:57:56,221::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-427::DEBUG::2013-03-01 12:57:56,221::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-428::DEBUG::2013-03-01 12:57:56,686::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-428::DEBUG::2013-03-01 12:57:56,686::task::568::TaskManager.Task::(_updateState) Task=`215c9a73-f9b0-462b-aee2-8ef1cecee32d`::moving from state init -> state preparing >Thread-428::INFO::2013-03-01 12:57:56,687::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-428::INFO::2013-03-01 12:57:56,687::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-428::DEBUG::2013-03-01 12:57:56,687::task::1151::TaskManager.Task::(prepare) Task=`215c9a73-f9b0-462b-aee2-8ef1cecee32d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-428::DEBUG::2013-03-01 12:57:56,687::task::568::TaskManager.Task::(_updateState) Task=`215c9a73-f9b0-462b-aee2-8ef1cecee32d`::moving from state preparing -> state finished >Thread-428::DEBUG::2013-03-01 12:57:56,688::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-428::DEBUG::2013-03-01 12:57:56,688::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-428::DEBUG::2013-03-01 12:57:56,688::task::957::TaskManager.Task::(_decref) Task=`215c9a73-f9b0-462b-aee2-8ef1cecee32d`::ref 0 aborting False >Thread-429::DEBUG::2013-03-01 12:57:56,713::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-429::DEBUG::2013-03-01 12:57:56,713::task::568::TaskManager.Task::(_updateState) Task=`4f837dc4-cb5f-4bdf-837b-ef138ca3564b`::moving from state init -> state preparing >Thread-429::INFO::2013-03-01 12:57:56,714::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-429::DEBUG::2013-03-01 12:57:56,714::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`442e3757-6c6c-4fde-b898-15def4a25790`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-429::DEBUG::2013-03-01 12:57:56,715::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-429::DEBUG::2013-03-01 12:57:56,715::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-429::DEBUG::2013-03-01 12:57:56,715::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`442e3757-6c6c-4fde-b898-15def4a25790`::Granted request >Thread-429::DEBUG::2013-03-01 12:57:56,716::task::794::TaskManager.Task::(resourceAcquired) Task=`4f837dc4-cb5f-4bdf-837b-ef138ca3564b`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-429::DEBUG::2013-03-01 12:57:56,716::task::957::TaskManager.Task::(_decref) Task=`4f837dc4-cb5f-4bdf-837b-ef138ca3564b`::ref 1 aborting False >Thread-429::INFO::2013-03-01 12:57:56,717::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-429::DEBUG::2013-03-01 12:57:56,718::task::1151::TaskManager.Task::(prepare) Task=`4f837dc4-cb5f-4bdf-837b-ef138ca3564b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-429::DEBUG::2013-03-01 12:57:56,718::task::568::TaskManager.Task::(_updateState) Task=`4f837dc4-cb5f-4bdf-837b-ef138ca3564b`::moving from state preparing -> state finished >Thread-429::DEBUG::2013-03-01 12:57:56,718::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-429::DEBUG::2013-03-01 12:57:56,718::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-429::DEBUG::2013-03-01 12:57:56,719::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-429::DEBUG::2013-03-01 12:57:56,719::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-429::DEBUG::2013-03-01 12:57:56,719::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-429::DEBUG::2013-03-01 12:57:56,720::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-429::DEBUG::2013-03-01 12:57:56,720::task::957::TaskManager.Task::(_decref) Task=`4f837dc4-cb5f-4bdf-837b-ef138ca3564b`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:57:57,479::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:57,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381881 s, 26.8 MB/s\n'; <rc> = 0 >Thread-431::DEBUG::2013-03-01 12:57:59,313::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-431::DEBUG::2013-03-01 12:57:59,314::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-431::DEBUG::2013-03-01 12:57:59,314::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-431::DEBUG::2013-03-01 12:57:59,315::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-431::DEBUG::2013-03-01 12:57:59,315::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-431::DEBUG::2013-03-01 12:57:59,315::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '76.02', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '1.31', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '26.01', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:57:59,597::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:57:59,692::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441814 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:01,712::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:01,822::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478882 s, 21.4 MB/s\n'; <rc> = 0 >Thread-433::DEBUG::2013-03-01 12:58:02,378::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-433::DEBUG::2013-03-01 12:58:02,379::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-433::DEBUG::2013-03-01 12:58:02,379::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-433::DEBUG::2013-03-01 12:58:02,379::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-433::DEBUG::2013-03-01 12:58:02,379::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-433::DEBUG::2013-03-01 12:58:02,380::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '76.02', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.32', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '26.01', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:58:03,841::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:03,949::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409393 s, 25.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:58:05,160::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:58:05,169::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000340985 s, 12.0 MB/s\n'; <rc> = 0 >Thread-435::DEBUG::2013-03-01 12:58:05,443::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-435::DEBUG::2013-03-01 12:58:05,450::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-435::DEBUG::2013-03-01 12:58:05,450::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-435::DEBUG::2013-03-01 12:58:05,451::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-435::DEBUG::2013-03-01 12:58:05,451::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-435::DEBUG::2013-03-01 12:58:05,451::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '20.05', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '1.31', 'elapsedTime': '50', 'vmType': 'kvm', 'cpuSys': '8.68', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:58:05,963::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:06,067::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388774 s, 26.3 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:06,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:06,178::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000393225 s, 10.4 MB/s\n'; <rc> = 0 >Thread-436::DEBUG::2013-03-01 12:58:06,877::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-436::DEBUG::2013-03-01 12:58:06,914::task::568::TaskManager.Task::(_updateState) Task=`48e4d5ca-72e3-4870-b9f5-2ad74f8aeea5`::moving from state init -> state preparing >Thread-436::INFO::2013-03-01 12:58:06,936::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-436::INFO::2013-03-01 12:58:06,948::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-436::DEBUG::2013-03-01 12:58:06,952::task::1151::TaskManager.Task::(prepare) Task=`48e4d5ca-72e3-4870-b9f5-2ad74f8aeea5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-436::DEBUG::2013-03-01 12:58:06,956::task::568::TaskManager.Task::(_updateState) Task=`48e4d5ca-72e3-4870-b9f5-2ad74f8aeea5`::moving from state preparing -> state finished >Thread-436::DEBUG::2013-03-01 12:58:06,959::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-436::DEBUG::2013-03-01 12:58:06,962::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-436::DEBUG::2013-03-01 12:58:06,965::task::957::TaskManager.Task::(_decref) Task=`48e4d5ca-72e3-4870-b9f5-2ad74f8aeea5`::ref 0 aborting False >Thread-437::DEBUG::2013-03-01 12:58:07,075::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-437::DEBUG::2013-03-01 12:58:07,081::task::568::TaskManager.Task::(_updateState) Task=`2090fb9c-5388-49a2-819c-d78044217d87`::moving from state init -> state preparing >Thread-437::INFO::2013-03-01 12:58:07,085::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-437::DEBUG::2013-03-01 12:58:07,093::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`03928a68-b3f2-40f1-957c-dcd7c2f1fae0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-437::DEBUG::2013-03-01 12:58:07,096::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-437::DEBUG::2013-03-01 12:58:07,102::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-437::DEBUG::2013-03-01 12:58:07,105::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`03928a68-b3f2-40f1-957c-dcd7c2f1fae0`::Granted request >Thread-437::DEBUG::2013-03-01 12:58:07,113::task::794::TaskManager.Task::(resourceAcquired) Task=`2090fb9c-5388-49a2-819c-d78044217d87`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-437::DEBUG::2013-03-01 12:58:07,116::task::957::TaskManager.Task::(_decref) Task=`2090fb9c-5388-49a2-819c-d78044217d87`::ref 1 aborting False >Thread-437::INFO::2013-03-01 12:58:07,136::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-437::DEBUG::2013-03-01 12:58:07,140::task::1151::TaskManager.Task::(prepare) Task=`2090fb9c-5388-49a2-819c-d78044217d87`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-437::DEBUG::2013-03-01 12:58:07,144::task::568::TaskManager.Task::(_updateState) Task=`2090fb9c-5388-49a2-819c-d78044217d87`::moving from state preparing -> state finished >Thread-437::DEBUG::2013-03-01 12:58:07,148::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-437::DEBUG::2013-03-01 12:58:07,151::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-437::DEBUG::2013-03-01 12:58:07,156::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-437::DEBUG::2013-03-01 12:58:07,160::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-437::DEBUG::2013-03-01 12:58:07,163::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-437::DEBUG::2013-03-01 12:58:07,166::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-437::DEBUG::2013-03-01 12:58:07,171::task::957::TaskManager.Task::(_decref) Task=`2090fb9c-5388-49a2-819c-d78044217d87`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:08,089::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-439::DEBUG::2013-03-01 12:58:08,739::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-439::DEBUG::2013-03-01 12:58:08,750::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-439::DEBUG::2013-03-01 12:58:08,755::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-439::DEBUG::2013-03-01 12:58:08,760::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-439::DEBUG::2013-03-01 12:58:08,763::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-439::DEBUG::2013-03-01 12:58:08,770::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '20.05', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.51', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '8.68', 'appsList': [], 'guestIPs': ''}]} >Dummy-173::DEBUG::2013-03-01 12:58:09,128::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.670289 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:11,141::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:11,256::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499782 s, 20.5 MB/s\n'; <rc> = 0 >Thread-440::DEBUG::2013-03-01 12:58:11,825::task::568::TaskManager.Task::(_updateState) Task=`fefed692-7dc8-4c74-836e-a73a2cfbef86`::moving from state init -> state preparing >Thread-440::INFO::2013-03-01 12:58:11,826::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-440::INFO::2013-03-01 12:58:11,826::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0097119808197', 'lastCheck': '6.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129508972168', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-440::DEBUG::2013-03-01 12:58:11,826::task::1151::TaskManager.Task::(prepare) Task=`fefed692-7dc8-4c74-836e-a73a2cfbef86`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0097119808197', 'lastCheck': '6.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129508972168', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-440::DEBUG::2013-03-01 12:58:11,827::task::568::TaskManager.Task::(_updateState) Task=`fefed692-7dc8-4c74-836e-a73a2cfbef86`::moving from state preparing -> state finished >Thread-440::DEBUG::2013-03-01 12:58:11,827::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-440::DEBUG::2013-03-01 12:58:11,827::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-440::DEBUG::2013-03-01 12:58:11,827::task::957::TaskManager.Task::(_decref) Task=`fefed692-7dc8-4c74-836e-a73a2cfbef86`::ref 0 aborting False >Thread-441::DEBUG::2013-03-01 12:58:11,865::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-441::DEBUG::2013-03-01 12:58:11,866::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-441::DEBUG::2013-03-01 12:58:11,866::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-441::DEBUG::2013-03-01 12:58:11,866::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Dummy-173::DEBUG::2013-03-01 12:58:13,276::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:13,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417276 s, 24.5 MB/s\n'; <rc> = 0 >Thread-443::DEBUG::2013-03-01 12:58:14,986::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmGetStats with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-443::DEBUG::2013-03-01 12:58:14,987::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc stats not available >Thread-443::DEBUG::2013-03-01 12:58:14,987::libvirtvm::269::vm.Vm::(_getDiskStats) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda stats not available >Thread-443::DEBUG::2013-03-01 12:58:14,987::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hdc latency not available >Thread-443::DEBUG::2013-03-01 12:58:14,987::libvirtvm::308::vm.Vm::(_getDiskLatency) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Disk hda latency not available >Thread-443::DEBUG::2013-03-01 12:58:14,988::BindingXMLRPC::920::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '30628', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-7000632079392253636', 'balloonInfo': {'balloon_max': 524288, 'balloon_cur': 524288}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:81:bc', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'bb607f4f-1442-4f4c-8f78-8dc0f9526e32', 'displayType': 'qxl', 'cpuUser': '20.05', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'hda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e7934077-6752-4445-a00a-1f2551119ade'}}, 'monitorResponse': '0', 'statsAge': '0.66', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '8.68', 'appsList': [], 'guestIPs': ''}]} >Thread-255::DEBUG::2013-03-01 12:58:15,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:58:15,182::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000440964 s, 9.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:15,404::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:15,519::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499654 s, 20.5 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:16,185::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:16,197::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000472559 s, 8.7 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:16,517::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-444::DEBUG::2013-03-01 12:58:16,518::task::568::TaskManager.Task::(_updateState) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::moving from state init -> state preparing >Thread-444::INFO::2013-03-01 12:58:16,518::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='e7934077-6752-4445-a00a-1f2551119ade', srcVolUUID='641da936-3f96-4831-a341-cd57756ebef7', dstImgUUID='40f9ecb8-6c2c-4915-a43d-641b285bbd8a', dstVolUUID='91e28f67-2793-4b25-8e16-5c36b8492d33', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-444::INFO::2013-03-01 12:58:16,519::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-444::DEBUG::2013-03-01 12:58:16,519::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:16,810::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:16,810::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:16,811::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:16,811::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:16,811::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:16,811::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:16,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,060::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:17,061::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-444::DEBUG::2013-03-01 12:58:17,062::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:17,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,277::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-444::INFO::2013-03-01 12:58:17,278::image::458::Storage.Image::(isLegal) image e7934077-6752-4445-a00a-1f2551119ade in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', '641da936-3f96-4831-a341-cd57756ebef7'] >Thread-444::DEBUG::2013-03-01 12:58:17,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,289::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000375328 s, 1.4 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,289::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000375328 s, 1.4 MB/s'], size: 512 >Thread-444::DEBUG::2013-03-01 12:58:17,290::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,299::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319295 s, 1.6 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,300::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319295 s, 1.6 MB/s'], size: 512 >Thread-444::DEBUG::2013-03-01 12:58:17,301::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,310::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316774 s, 1.6 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,311::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316774 s, 1.6 MB/s'], size: 512 >Thread-444::DEBUG::2013-03-01 12:58:17,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,321::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299175 s, 1.7 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,322::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299175 s, 1.7 MB/s'], size: 512 >Thread-444::DEBUG::2013-03-01 12:58:17,322::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:17,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,525::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:17,535::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,554::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-444::DEBUG::2013-03-01 12:58:17,560::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,584::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00043248 s, 1.2 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,586::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00043248 s, 1.2 MB/s'], size: 512 >Thread-444::DEBUG::2013-03-01 12:58:17,592::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-444::DEBUG::2013-03-01 12:58:17,615::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000335624 s, 1.5 MB/s\n'; <rc> = 0 >Thread-444::DEBUG::2013-03-01 12:58:17,617::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000335624 s, 1.5 MB/s'], size: 512 >Thread-444::INFO::2013-03-01 12:58:17,619::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec18e850>, <storage.blockVolume.BlockVolume object at 0x7f15ec187f90>] >Thread-444::DEBUG::2013-03-01 12:58:17,624::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`b5669de2-5031-4972-97a5-d8f3447448fa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-444::DEBUG::2013-03-01 12:58:17,626::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-444::DEBUG::2013-03-01 12:58:17,628::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-444::DEBUG::2013-03-01 12:58:17,630::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`b5669de2-5031-4972-97a5-d8f3447448fa`::Granted request >Thread-444::DEBUG::2013-03-01 12:58:17,635::task::794::TaskManager.Task::(resourceAcquired) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-444::DEBUG::2013-03-01 12:58:17,638::task::957::TaskManager.Task::(_decref) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::ref 1 aborting False >Thread-444::DEBUG::2013-03-01 12:58:17,648::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >Thread-444::DEBUG::2013-03-01 12:58:17,661::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_40f9ecb8-6c2c-4915-a43d-641b285bbd8a for task 9ba04d11-0593-49ad-bba6-6e4008140223 >Thread-444::INFO::2013-03-01 12:58:17,662::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-444::DEBUG::2013-03-01 12:58:17,662::task::1146::TaskManager.Task::(prepare) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::Prepare: 1 jobs exist, move to acquiring >Thread-444::DEBUG::2013-03-01 12:58:17,663::task::568::TaskManager.Task::(_updateState) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::moving from state preparing -> state acquiring >Thread-444::DEBUG::2013-03-01 12:58:17,664::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >Thread-444::DEBUG::2013-03-01 12:58:17,675::task::568::TaskManager.Task::(_updateState) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::moving from state acquiring -> state queued >Thread-444::DEBUG::2013-03-01 12:58:17,676::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >Thread-444::DEBUG::2013-03-01 12:58:17,687::taskManager::50::TaskManager::(_queueTask) queuing task: 9ba04d11-0593-49ad-bba6-6e4008140223 >Thread-444::DEBUG::2013-03-01 12:58:17,688::taskManager::56::TaskManager::(_queueTask) task queued: 9ba04d11-0593-49ad-bba6-6e4008140223 >7950aabb-e44f-4305-a659-e36a1147bdd1::DEBUG::2013-03-01 12:58:17,688::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-444::DEBUG::2013-03-01 12:58:17,689::task::1148::TaskManager.Task::(prepare) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::returning >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,689::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 9ba04d11-0593-49ad-bba6-6e4008140223 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15882f0ab8>> with: None >Thread-444::DEBUG::2013-03-01 12:58:17,690::task::957::TaskManager.Task::(_decref) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::ref 0 aborting False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,690::task::1159::TaskManager.Task::(commit) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::committing task: 9ba04d11-0593-49ad-bba6-6e4008140223 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,691::task::568::TaskManager.Task::(_updateState) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::moving from state queued -> state running >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,693::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,704::task::872::TaskManager.Task::(_runJobs) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::Task.run: running job 0: copyImage_40f9ecb8-6c2c-4915-a43d-641b285bbd8a: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7', '40f9ecb8-6c2c-4915-a43d-641b285bbd8a', '91e28f67-2793-4b25-8e16-5c36b8492d33', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,705::task::304::TaskManager.Task::(run) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::Job.run: running copyImage_40f9ecb8-6c2c-4915-a43d-641b285bbd8a: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'e7934077-6752-4445-a00a-1f2551119ade', '641da936-3f96-4831-a341-cd57756ebef7', '40f9ecb8-6c2c-4915-a43d-641b285bbd8a', '91e28f67-2793-4b25-8e16-5c36b8492d33', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,705::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`828a8971-4f59-4c58-be5f-9c6a331c983f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,706::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' for lock type 'shared' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,707::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,708::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-445::DEBUG::2013-03-01 12:58:17,741::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-445::DEBUG::2013-03-01 12:58:17,743::task::568::TaskManager.Task::(_updateState) Task=`a841f1f0-a2c5-4ac0-8871-0b943cb46054`::moving from state init -> state preparing >Thread-445::INFO::2013-03-01 12:58:17,745::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-445::INFO::2013-03-01 12:58:17,748::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-445::DEBUG::2013-03-01 12:58:17,750::task::1151::TaskManager.Task::(prepare) Task=`a841f1f0-a2c5-4ac0-8871-0b943cb46054`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-445::DEBUG::2013-03-01 12:58:17,752::task::568::TaskManager.Task::(_updateState) Task=`a841f1f0-a2c5-4ac0-8871-0b943cb46054`::moving from state preparing -> state finished >Thread-445::DEBUG::2013-03-01 12:58:17,754::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-445::DEBUG::2013-03-01 12:58:17,756::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-445::DEBUG::2013-03-01 12:58:17,758::task::957::TaskManager.Task::(_decref) Task=`a841f1f0-a2c5-4ac0-8871-0b943cb46054`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:17,788::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.184875 s, 5.5 MB/s\n'; <rc> = 0 >Thread-446::DEBUG::2013-03-01 12:58:17,833::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-446::DEBUG::2013-03-01 12:58:17,833::task::568::TaskManager.Task::(_updateState) Task=`b3dbf402-b840-42c8-af22-7231589715b0`::moving from state init -> state preparing >Thread-446::INFO::2013-03-01 12:58:17,834::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-446::DEBUG::2013-03-01 12:58:17,834::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`703b6dbe-6eb4-48c6-ab73-4db090090d08`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-446::DEBUG::2013-03-01 12:58:17,834::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-446::DEBUG::2013-03-01 12:58:17,834::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-446::DEBUG::2013-03-01 12:58:17,835::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`703b6dbe-6eb4-48c6-ab73-4db090090d08`::Granted request >Thread-446::DEBUG::2013-03-01 12:58:17,835::task::794::TaskManager.Task::(resourceAcquired) Task=`b3dbf402-b840-42c8-af22-7231589715b0`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-446::DEBUG::2013-03-01 12:58:17,835::task::957::TaskManager.Task::(_decref) Task=`b3dbf402-b840-42c8-af22-7231589715b0`::ref 1 aborting False >Thread-446::INFO::2013-03-01 12:58:17,836::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-446::DEBUG::2013-03-01 12:58:17,837::task::1151::TaskManager.Task::(prepare) Task=`b3dbf402-b840-42c8-af22-7231589715b0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-446::DEBUG::2013-03-01 12:58:17,837::task::568::TaskManager.Task::(_updateState) Task=`b3dbf402-b840-42c8-af22-7231589715b0`::moving from state preparing -> state finished >Thread-446::DEBUG::2013-03-01 12:58:17,837::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-446::DEBUG::2013-03-01 12:58:17,837::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-446::DEBUG::2013-03-01 12:58:17,838::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-446::DEBUG::2013-03-01 12:58:17,838::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-446::DEBUG::2013-03-01 12:58:17,838::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-446::DEBUG::2013-03-01 12:58:17,838::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-446::DEBUG::2013-03-01 12:58:17,838::task::957::TaskManager.Task::(_decref) Task=`b3dbf402-b840-42c8-af22-7231589715b0`::ref 0 aborting False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,895::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,911::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327357 s, 1.6 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,923::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327357 s, 1.6 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,934::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297283 s, 1.7 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,935::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297283 s, 1.7 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:17,935::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=e7934077-6752-4445-a00a-1f2551119ade chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec1aeb50>, <storage.blockVolume.BlockVolume object at 0x7f15ec1ae6d0>] >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,936::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97`ReqID=`3a953fe1-08d5-4742-b904-9ba089a1bc08`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,936::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' for lock type 'shared' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,937::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' is free. Now locking as 'shared' (1 active user) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,937::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97`ReqID=`3a953fe1-08d5-4742-b904-9ba089a1bc08`::Granted request >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,938::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`64a77bd6-d853-420c-b886-e5aa5f53a937`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,938::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,938::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,939::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`64a77bd6-d853-420c-b886-e5aa5f53a937`::Granted request >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,939::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free. Now locking as 'shared' (1 active user) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,939::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`828a8971-4f59-4c58-be5f-9c6a331c983f`::Granted request >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,940::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a`ReqID=`dae519dd-bbff-4e86-aa79-86b73ee99791`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,941::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' for lock type 'exclusive' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,941::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:17,942::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >VM Channels Listener::DEBUG::2013-03-01 12:58:17,951::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,133::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,143::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,143::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 40f9ecb8-6c2c-4915-a43d-641b285bbd8a does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,144::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' is free. Now locking as 'exclusive' (1 active user) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,144::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a`ReqID=`dae519dd-bbff-4e86-aa79-86b73ee99791`::Granted request >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:18,145::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=e7934077-6752-4445-a00a-1f2551119ade srcVolUUID=641da936-3f96-4831-a341-cd57756ebef7 dstImgUUID=40f9ecb8-6c2c-4915-a43d-641b285bbd8a dstVolUUID=91e28f67-2793-4b25-8e16-5c36b8492d33 dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,155::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000347229 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,156::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000347229 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,156::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,166::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000343761 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,167::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000343761 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,167::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,177::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000353231 s, 1.4 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,178::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000353231 s, 1.4 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,188::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000353017 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,189::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000353017 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,189::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,199::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000342554 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,200::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000342554 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,200::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,210::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000346639 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,211::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000346639 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:18,211::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:e7934077-6752-4445-a00a-1f2551119ade:641da936-3f96-4831-a341-cd57756ebef7 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:40f9ecb8-6c2c-4915-a43d-641b285bbd8a:91e28f67-2793-4b25-8e16-5c36b8492d33 apparentsize 2097152 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,212::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,212::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-394::DEBUG::2013-03-01 12:58:18,344::task::568::TaskManager.Task::(_updateState) Task=`8c76fcdf-0421-44fe-9632-46c7c396ec88`::moving from state init -> state preparing >Thread-394::INFO::2013-03-01 12:58:18,345::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', volUUID='07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', options=None) >Thread-394::INFO::2013-03-01 12:58:18,345::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-394::DEBUG::2013-03-01 12:58:18,345::task::1151::TaskManager.Task::(prepare) Task=`8c76fcdf-0421-44fe-9632-46c7c396ec88`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-394::DEBUG::2013-03-01 12:58:18,345::task::568::TaskManager.Task::(_updateState) Task=`8c76fcdf-0421-44fe-9632-46c7c396ec88`::moving from state preparing -> state finished >Thread-394::DEBUG::2013-03-01 12:58:18,346::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-394::DEBUG::2013-03-01 12:58:18,346::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-394::DEBUG::2013-03-01 12:58:18,346::task::957::TaskManager.Task::(_decref) Task=`8c76fcdf-0421-44fe-9632-46c7c396ec88`::ref 0 aborting False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,402::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,439::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:18,439::image::458::Storage.Image::(isLegal) image 40f9ecb8-6c2c-4915-a43d-641b285bbd8a in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:18,440::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a for image's volumes >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,440::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,449::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,450::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,641::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,651::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::WARNING::2013-03-01 12:58:18,652::lvm::593::Storage.LVM::(getLv) lv: 91e28f67-2793-4b25-8e16-5c36b8492d33 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:18,652::volume::457::Storage.Volume::(create) Creating volume 91e28f67-2793-4b25-8e16-5c36b8492d33 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,653::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,663::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:18,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 91e28f67-2793-4b25-8e16-5c36b8492d33 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:19,801::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:19,901::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412842 s, 24.8 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,378::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,379::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,380::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,381::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,381::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:20,382::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33 with size = 20480 sectors >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33 10240K' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,396::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,397::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,398::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,591::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,604::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::WARNING::2013-03-01 12:58:20,604::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,606::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,607::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_7 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_40f9ecb8-6c2c-4915-a43d-641b285bbd8a a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,862::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,863::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,863::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:20,864::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,133::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,134::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,134::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,136::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,241::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=91e28f67-2793-4b25-8e16-5c36b8492d33 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,271::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,365::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:21,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:21,924::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:23,436::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.577586 s, 1.8 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,719::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:23,720::blockVolume::280::Storage.Volume::(extend) Request to extend LV 91e28f67-2793-4b25-8e16-5c36b8492d33 of image 40f9ecb8-6c2c-4915-a43d-641b285bbd8a in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,967::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,970::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,981::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000322454 s, 1.6 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,982::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000322454 s, 1.6 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:23,983::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,983::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,994::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000300301 s, 1.7 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,994::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000300301 s, 1.7 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,995::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`eb656c00-fbfd-4026-9db8-bc860207e2c6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,996::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' for lock type 'shared' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,996::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free. Now locking as 'shared' (1 active user) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,996::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7`ReqID=`eb656c00-fbfd-4026-9db8-bc860207e2c6`::Granted request >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:23,997::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:23,998::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,008::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00034708 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,008::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00034708 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,019::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316 s, 1.6 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,019::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316 s, 1.6 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,020::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33`ReqID=`9e846f7e-06e8-4e10-8b4a-16a3225ea361`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,020::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33' for lock type 'exclusive' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:24,022::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >Thread-450::DEBUG::2013-03-01 12:58:24,287::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-450::DEBUG::2013-03-01 12:58:24,288::task::568::TaskManager.Task::(_updateState) Task=`1e28ce0a-7f56-4285-838e-0517d1794841`::moving from state init -> state preparing >Thread-450::INFO::2013-03-01 12:58:24,288::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-450::DEBUG::2013-03-01 12:58:24,288::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-450::DEBUG::2013-03-01 12:58:24,288::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9ba04d11-0593-49ad-bba6-6e4008140223 >Thread-450::DEBUG::2013-03-01 12:58:24,289::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'} >Thread-450::DEBUG::2013-03-01 12:58:24,289::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9ba04d11-0593-49ad-bba6-6e4008140223': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'}} >Thread-450::INFO::2013-03-01 12:58:24,289::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9ba04d11-0593-49ad-bba6-6e4008140223': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'}}} >Thread-450::DEBUG::2013-03-01 12:58:24,290::task::1151::TaskManager.Task::(prepare) Task=`1e28ce0a-7f56-4285-838e-0517d1794841`::finished: {'allTasksStatus': {'9ba04d11-0593-49ad-bba6-6e4008140223': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'}}} >Thread-450::DEBUG::2013-03-01 12:58:24,290::task::568::TaskManager.Task::(_updateState) Task=`1e28ce0a-7f56-4285-838e-0517d1794841`::moving from state preparing -> state finished >Thread-450::DEBUG::2013-03-01 12:58:24,290::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-450::DEBUG::2013-03-01 12:58:24,290::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-450::DEBUG::2013-03-01 12:58:24,291::task::957::TaskManager.Task::(_decref) Task=`1e28ce0a-7f56-4285-838e-0517d1794841`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:58:25,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:58:25,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000360967 s, 11.3 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,648::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,648::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,649::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,649::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33' is free. Now locking as 'exclusive' (1 active user) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,649::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33`ReqID=`9e846f7e-06e8-4e10-8b4a-16a3225ea361`::Granted request >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,650::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,651::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:25,672::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:25,757::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039349 s, 26.0 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,845::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,853::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,854::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,864::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000348111 s, 1.5 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,864::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000348111 s, 1.5 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,866::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,876::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000315085 s, 1.6 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,877::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000315085 s, 1.6 MB/s'], size: 512 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,877::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33 (qcow2) START >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,878::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:25,887::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >Thread-105::DEBUG::2013-03-01 12:58:26,203::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:58:26,203::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:26,518::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:26,520::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:58:26,520::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:26,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000326595 s, 12.5 MB/s\n'; <rc> = 0 >Thread-451::DEBUG::2013-03-01 12:58:27,177::task::568::TaskManager.Task::(_updateState) Task=`3f7f8440-e9c1-4278-8527-5a715aca8e75`::moving from state init -> state preparing >Thread-451::INFO::2013-03-01 12:58:27,178::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-451::INFO::2013-03-01 12:58:27,178::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0107071399689', 'lastCheck': '2.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0113370418549', 'lastCheck': '0.6', 'code': 0, 'valid': True}} >Thread-451::DEBUG::2013-03-01 12:58:27,179::task::1151::TaskManager.Task::(prepare) Task=`3f7f8440-e9c1-4278-8527-5a715aca8e75`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0107071399689', 'lastCheck': '2.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0113370418549', 'lastCheck': '0.6', 'code': 0, 'valid': True}} >Thread-451::DEBUG::2013-03-01 12:58:27,179::task::568::TaskManager.Task::(_updateState) Task=`3f7f8440-e9c1-4278-8527-5a715aca8e75`::moving from state preparing -> state finished >Thread-451::DEBUG::2013-03-01 12:58:27,179::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-451::DEBUG::2013-03-01 12:58:27,179::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-451::DEBUG::2013-03-01 12:58:27,179::task::957::TaskManager.Task::(_decref) Task=`3f7f8440-e9c1-4278-8527-5a715aca8e75`::ref 0 aborting False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:27,504::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:27,504::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/641da936-3f96-4831-a341-cd57756ebef7 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33 DONE >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:27,504::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:641da936-3f96-4831-a341-cd57756ebef7 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:91e28f67-2793-4b25-8e16-5c36b8492d33 >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:27,505::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 justme False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:27,505::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:27,505::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:27,505::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:27,506::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:27,771::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:27,870::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500635 s, 20.5 MB/s\n'; <rc> = 0 >Thread-453::DEBUG::2013-03-01 12:58:27,908::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-453::DEBUG::2013-03-01 12:58:27,909::task::568::TaskManager.Task::(_updateState) Task=`8a6e4b06-c98e-427c-aed9-073575154531`::moving from state init -> state preparing >Thread-453::INFO::2013-03-01 12:58:27,910::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-453::INFO::2013-03-01 12:58:27,910::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-453::DEBUG::2013-03-01 12:58:27,910::task::1151::TaskManager.Task::(prepare) Task=`8a6e4b06-c98e-427c-aed9-073575154531`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-453::DEBUG::2013-03-01 12:58:27,911::task::568::TaskManager.Task::(_updateState) Task=`8a6e4b06-c98e-427c-aed9-073575154531`::moving from state preparing -> state finished >Thread-453::DEBUG::2013-03-01 12:58:27,911::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-453::DEBUG::2013-03-01 12:58:27,911::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-453::DEBUG::2013-03-01 12:58:27,912::task::957::TaskManager.Task::(_decref) Task=`8a6e4b06-c98e-427c-aed9-073575154531`::ref 0 aborting False >Thread-454::DEBUG::2013-03-01 12:58:27,937::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-454::DEBUG::2013-03-01 12:58:27,937::task::568::TaskManager.Task::(_updateState) Task=`9439cf61-28b8-457f-b824-aa6286f0cc70`::moving from state init -> state preparing >Thread-454::INFO::2013-03-01 12:58:27,938::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-454::DEBUG::2013-03-01 12:58:27,938::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9d726791-5624-4cbf-b82e-8e803aca6818`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-454::DEBUG::2013-03-01 12:58:27,939::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-454::DEBUG::2013-03-01 12:58:27,939::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-454::DEBUG::2013-03-01 12:58:27,939::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9d726791-5624-4cbf-b82e-8e803aca6818`::Granted request >Thread-454::DEBUG::2013-03-01 12:58:27,940::task::794::TaskManager.Task::(resourceAcquired) Task=`9439cf61-28b8-457f-b824-aa6286f0cc70`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-454::DEBUG::2013-03-01 12:58:27,940::task::957::TaskManager.Task::(_decref) Task=`9439cf61-28b8-457f-b824-aa6286f0cc70`::ref 1 aborting False >Thread-454::INFO::2013-03-01 12:58:27,942::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-454::DEBUG::2013-03-01 12:58:27,942::task::1151::TaskManager.Task::(prepare) Task=`9439cf61-28b8-457f-b824-aa6286f0cc70`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-454::DEBUG::2013-03-01 12:58:27,942::task::568::TaskManager.Task::(_updateState) Task=`9439cf61-28b8-457f-b824-aa6286f0cc70`::moving from state preparing -> state finished >Thread-454::DEBUG::2013-03-01 12:58:27,943::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-454::DEBUG::2013-03-01 12:58:27,943::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-454::DEBUG::2013-03-01 12:58:27,943::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-454::DEBUG::2013-03-01 12:58:27,944::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-454::DEBUG::2013-03-01 12:58:27,944::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-454::DEBUG::2013-03-01 12:58:27,944::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-454::DEBUG::2013-03-01 12:58:27,945::task::957::TaskManager.Task::(_decref) Task=`9439cf61-28b8-457f-b824-aa6286f0cc70`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:29,892::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:29,988::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386807 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:32,005::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,005::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n device-mapper: remove ioctl on failed: Device or resource busy\n Unable to deactivate a558fc2a--a4a3--4118--9b81--d1d601eaa295-641da936--3f96--4831--a341--cd57756ebef7 (253:18)\n'; <rc> = 5 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,202::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,227::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::WARNING::2013-03-01 12:58:33,239::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' device-mapper: remove ioctl on failed: Device or resource busy\', \' Unable to deactivate a558fc2a--a4a3--4118--9b81--d1d601eaa295-641da936--3f96--4831--a341--cd57756ebef7 (253:18)\']\\na558fc2a-a4a3-4118-9b81-d1d601eaa295/[\'641da936-3f96-4831-a341-cd57756ebef7\']",)',)) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,268::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,315::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,329::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:33,388::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.598487 s, 1.7 MB/s\n'; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,531::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::INFO::2013-03-01 12:58:33,531::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33 justme False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,531::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,531::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,531::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,532::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,771::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,771::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,771::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.91e28f67-2793-4b25-8e16-5c36b8492d33', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,772::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:33,772::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,021::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,033::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,034::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,034::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,034::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,035::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.40f9ecb8-6c2c-4915-a43d-641b285bbd8a', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,035::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,035::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,036::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,036::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,036::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,037::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,037::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,037::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,038::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,038::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,038::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.641da936-3f96-4831-a341-cd57756ebef7', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,039::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.e7934077-6752-4445-a00a-1f2551119ade', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,039::task::568::TaskManager.Task::(_updateState) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::moving from state running -> state finished >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,040::task::719::TaskManager.Task::(_save) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9ba04d11-0593-49ad-bba6-6e4008140223.temp >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,051::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,051::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,052::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,052::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,053::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,053::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,053::task::880::TaskManager.Task::(_runJobs) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::Task.run: exit - success: result {'uuid': '91e28f67-2793-4b25-8e16-5c36b8492d33'} >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,053::task::957::TaskManager.Task::(_decref) Task=`9ba04d11-0593-49ad-bba6-6e4008140223`::ref 0 aborting False >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:34,054::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-457::DEBUG::2013-03-01 12:58:34,320::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-457::DEBUG::2013-03-01 12:58:34,321::task::568::TaskManager.Task::(_updateState) Task=`8907693d-18f1-4822-9acf-85ecb2aed91d`::moving from state init -> state preparing >Thread-457::INFO::2013-03-01 12:58:34,321::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-457::DEBUG::2013-03-01 12:58:34,321::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-457::DEBUG::2013-03-01 12:58:34,322::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9ba04d11-0593-49ad-bba6-6e4008140223 >Thread-457::DEBUG::2013-03-01 12:58:34,322::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'} >Thread-457::DEBUG::2013-03-01 12:58:34,322::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9ba04d11-0593-49ad-bba6-6e4008140223': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'}} >Thread-457::INFO::2013-03-01 12:58:34,322::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9ba04d11-0593-49ad-bba6-6e4008140223': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'}}} >Thread-457::DEBUG::2013-03-01 12:58:34,323::task::1151::TaskManager.Task::(prepare) Task=`8907693d-18f1-4822-9acf-85ecb2aed91d`::finished: {'allTasksStatus': {'9ba04d11-0593-49ad-bba6-6e4008140223': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9ba04d11-0593-49ad-bba6-6e4008140223'}}} >Thread-457::DEBUG::2013-03-01 12:58:34,323::task::568::TaskManager.Task::(_updateState) Task=`8907693d-18f1-4822-9acf-85ecb2aed91d`::moving from state preparing -> state finished >Thread-457::DEBUG::2013-03-01 12:58:34,323::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-457::DEBUG::2013-03-01 12:58:34,323::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-457::DEBUG::2013-03-01 12:58:34,324::task::957::TaskManager.Task::(_decref) Task=`8907693d-18f1-4822-9acf-85ecb2aed91d`::ref 0 aborting False >Thread-458::DEBUG::2013-03-01 12:58:34,409::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-458::DEBUG::2013-03-01 12:58:34,409::task::568::TaskManager.Task::(_updateState) Task=`c0559152-466f-4e87-a01c-1b53cbab13f6`::moving from state init -> state preparing >Thread-458::INFO::2013-03-01 12:58:34,409::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='40f9ecb8-6c2c-4915-a43d-641b285bbd8a', volUUID='91e28f67-2793-4b25-8e16-5c36b8492d33', options=None) >Thread-458::DEBUG::2013-03-01 12:58:34,410::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`7b4526d9-0030-4c88-a1f7-c01aa7ce1317`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-458::DEBUG::2013-03-01 12:58:34,410::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-458::DEBUG::2013-03-01 12:58:34,411::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-458::DEBUG::2013-03-01 12:58:34,411::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`7b4526d9-0030-4c88-a1f7-c01aa7ce1317`::Granted request >Thread-458::DEBUG::2013-03-01 12:58:34,412::task::794::TaskManager.Task::(resourceAcquired) Task=`c0559152-466f-4e87-a01c-1b53cbab13f6`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-458::DEBUG::2013-03-01 12:58:34,412::task::957::TaskManager.Task::(_decref) Task=`c0559152-466f-4e87-a01c-1b53cbab13f6`::ref 1 aborting False >Thread-458::INFO::2013-03-01 12:58:34,412::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=40f9ecb8-6c2c-4915-a43d-641b285bbd8a volUUID = 91e28f67-2793-4b25-8e16-5c36b8492d33 >Thread-458::DEBUG::2013-03-01 12:58:34,413::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-458::DEBUG::2013-03-01 12:58:34,428::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00468782 s, 109 kB/s\n'; <rc> = 0 >Thread-458::DEBUG::2013-03-01 12:58:34,428::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00468782 s, 109 kB/s'], size: 512 >Thread-458::DEBUG::2013-03-01 12:58:34,429::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-458::DEBUG::2013-03-01 12:58:34,439::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00030897 s, 1.7 MB/s\n'; <rc> = 0 >Thread-458::DEBUG::2013-03-01 12:58:34,439::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00030897 s, 1.7 MB/s'], size: 512 >Thread-458::DEBUG::2013-03-01 12:58:34,440::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-458::DEBUG::2013-03-01 12:58:34,441::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-458::DEBUG::2013-03-01 12:58:34,636::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-458::DEBUG::2013-03-01 12:58:34,645::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-458::INFO::2013-03-01 12:58:34,646::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '40f9ecb8-6c2c-4915-a43d-641b285bbd8a', 'ctime': '1362135501', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135505', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '91e28f67-2793-4b25-8e16-5c36b8492d33', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-458::INFO::2013-03-01 12:58:34,646::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '40f9ecb8-6c2c-4915-a43d-641b285bbd8a', 'ctime': '1362135501', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135505', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '91e28f67-2793-4b25-8e16-5c36b8492d33', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-458::DEBUG::2013-03-01 12:58:34,646::task::1151::TaskManager.Task::(prepare) Task=`c0559152-466f-4e87-a01c-1b53cbab13f6`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '40f9ecb8-6c2c-4915-a43d-641b285bbd8a', 'ctime': '1362135501', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135505', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '91e28f67-2793-4b25-8e16-5c36b8492d33', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-458::DEBUG::2013-03-01 12:58:34,647::task::568::TaskManager.Task::(_updateState) Task=`c0559152-466f-4e87-a01c-1b53cbab13f6`::moving from state preparing -> state finished >Thread-458::DEBUG::2013-03-01 12:58:34,647::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-458::DEBUG::2013-03-01 12:58:34,647::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-458::DEBUG::2013-03-01 12:58:34,647::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-458::DEBUG::2013-03-01 12:58:34,648::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-458::DEBUG::2013-03-01 12:58:34,648::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-458::DEBUG::2013-03-01 12:58:34,648::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-458::DEBUG::2013-03-01 12:58:34,648::task::957::TaskManager.Task::(_decref) Task=`c0559152-466f-4e87-a01c-1b53cbab13f6`::ref 0 aborting False >Thread-459::DEBUG::2013-03-01 12:58:34,726::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-459::DEBUG::2013-03-01 12:58:34,727::task::568::TaskManager.Task::(_updateState) Task=`60952f0d-67ac-4111-8aa3-6d960171f078`::moving from state init -> state preparing >Thread-459::INFO::2013-03-01 12:58:34,727::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='9ba04d11-0593-49ad-bba6-6e4008140223', spUUID=None, options=None) >Thread-459::DEBUG::2013-03-01 12:58:34,727::taskManager::161::TaskManager::(clearTask) Entry. taskID: 9ba04d11-0593-49ad-bba6-6e4008140223 >Thread-459::DEBUG::2013-03-01 12:58:34,729::taskManager::166::TaskManager::(clearTask) Return. >Thread-459::INFO::2013-03-01 12:58:34,729::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-459::DEBUG::2013-03-01 12:58:34,729::task::1151::TaskManager.Task::(prepare) Task=`60952f0d-67ac-4111-8aa3-6d960171f078`::finished: None >Thread-459::DEBUG::2013-03-01 12:58:34,729::task::568::TaskManager.Task::(_updateState) Task=`60952f0d-67ac-4111-8aa3-6d960171f078`::moving from state preparing -> state finished >Thread-459::DEBUG::2013-03-01 12:58:34,730::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-459::DEBUG::2013-03-01 12:58:34,730::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-459::DEBUG::2013-03-01 12:58:34,730::task::957::TaskManager.Task::(_decref) Task=`60952f0d-67ac-4111-8aa3-6d960171f078`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:58:35,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:58:35,207::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000318877 s, 12.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:35,401::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:35,503::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042245 s, 24.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:36,536::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:36,548::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000475868 s, 8.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:37,523::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:37,630::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487641 s, 21.0 MB/s\n'; <rc> = 0 >Thread-461::DEBUG::2013-03-01 12:58:37,987::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-461::DEBUG::2013-03-01 12:58:37,988::task::568::TaskManager.Task::(_updateState) Task=`8e71e8ff-3b1b-480e-bd95-f23e7e52203c`::moving from state init -> state preparing >Thread-461::INFO::2013-03-01 12:58:37,988::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-461::INFO::2013-03-01 12:58:37,989::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-461::DEBUG::2013-03-01 12:58:37,989::task::1151::TaskManager.Task::(prepare) Task=`8e71e8ff-3b1b-480e-bd95-f23e7e52203c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-461::DEBUG::2013-03-01 12:58:37,990::task::568::TaskManager.Task::(_updateState) Task=`8e71e8ff-3b1b-480e-bd95-f23e7e52203c`::moving from state preparing -> state finished >Thread-461::DEBUG::2013-03-01 12:58:37,990::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-461::DEBUG::2013-03-01 12:58:37,990::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-461::DEBUG::2013-03-01 12:58:37,990::task::957::TaskManager.Task::(_decref) Task=`8e71e8ff-3b1b-480e-bd95-f23e7e52203c`::ref 0 aborting False >Thread-462::DEBUG::2013-03-01 12:58:38,018::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-462::DEBUG::2013-03-01 12:58:38,018::task::568::TaskManager.Task::(_updateState) Task=`defa7d24-e616-46ce-8089-7849cb8c8690`::moving from state init -> state preparing >Thread-462::INFO::2013-03-01 12:58:38,018::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-462::DEBUG::2013-03-01 12:58:38,019::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`a78a409b-279c-46dc-811b-b88e05b0847e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-462::DEBUG::2013-03-01 12:58:38,019::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-462::DEBUG::2013-03-01 12:58:38,020::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-462::DEBUG::2013-03-01 12:58:38,020::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`a78a409b-279c-46dc-811b-b88e05b0847e`::Granted request >Thread-462::DEBUG::2013-03-01 12:58:38,021::task::794::TaskManager.Task::(resourceAcquired) Task=`defa7d24-e616-46ce-8089-7849cb8c8690`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-462::DEBUG::2013-03-01 12:58:38,021::task::957::TaskManager.Task::(_decref) Task=`defa7d24-e616-46ce-8089-7849cb8c8690`::ref 1 aborting False >Thread-462::INFO::2013-03-01 12:58:38,022::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-462::DEBUG::2013-03-01 12:58:38,023::task::1151::TaskManager.Task::(prepare) Task=`defa7d24-e616-46ce-8089-7849cb8c8690`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-462::DEBUG::2013-03-01 12:58:38,023::task::568::TaskManager.Task::(_updateState) Task=`defa7d24-e616-46ce-8089-7849cb8c8690`::moving from state preparing -> state finished >Thread-462::DEBUG::2013-03-01 12:58:38,023::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-462::DEBUG::2013-03-01 12:58:38,024::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-462::DEBUG::2013-03-01 12:58:38,024::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-462::DEBUG::2013-03-01 12:58:38,024::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-462::DEBUG::2013-03-01 12:58:38,025::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-462::DEBUG::2013-03-01 12:58:38,025::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-462::DEBUG::2013-03-01 12:58:38,025::task::957::TaskManager.Task::(_decref) Task=`defa7d24-e616-46ce-8089-7849cb8c8690`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:39,645::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:39,749::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384152 s, 26.7 MB/s\n'; <rc> = 0 >Thread-464::DEBUG::2013-03-01 12:58:39,828::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-464::DEBUG::2013-03-01 12:58:39,828::task::568::TaskManager.Task::(_updateState) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::moving from state init -> state preparing >Thread-464::INFO::2013-03-01 12:58:39,829::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='40f9ecb8-6c2c-4915-a43d-641b285bbd8a', postZero='false', force='false') >Thread-464::INFO::2013-03-01 12:58:39,829::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-464::DEBUG::2013-03-01 12:58:39,830::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-464::DEBUG::2013-03-01 12:58:40,020::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-464::DEBUG::2013-03-01 12:58:40,021::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,021::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,022::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,022::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,022::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,023::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-464::DEBUG::2013-03-01 12:58:40,214::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-464::DEBUG::2013-03-01 12:58:40,216::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,216::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-464::DEBUG::2013-03-01 12:58:40,217::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a`ReqID=`1dcd361f-be59-429e-bbfe-301b37245392`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-464::DEBUG::2013-03-01 12:58:40,218::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' for lock type 'exclusive' >Thread-464::DEBUG::2013-03-01 12:58:40,218::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' is free. Now locking as 'exclusive' (1 active user) >Thread-464::DEBUG::2013-03-01 12:58:40,218::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a`ReqID=`1dcd361f-be59-429e-bbfe-301b37245392`::Granted request >Thread-464::DEBUG::2013-03-01 12:58:40,219::task::794::TaskManager.Task::(resourceAcquired) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_resourcesAcquired: Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a (exclusive) >Thread-464::DEBUG::2013-03-01 12:58:40,219::task::957::TaskManager.Task::(_decref) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::ref 1 aborting False >Thread-464::DEBUG::2013-03-01 12:58:40,219::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`63f4d713-686f-42fa-9400-367fb9dc2989`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-464::DEBUG::2013-03-01 12:58:40,219::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-464::DEBUG::2013-03-01 12:58:40,220::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-464::DEBUG::2013-03-01 12:58:40,220::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`63f4d713-686f-42fa-9400-367fb9dc2989`::Granted request >Thread-464::DEBUG::2013-03-01 12:58:40,220::task::794::TaskManager.Task::(resourceAcquired) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-464::DEBUG::2013-03-01 12:58:40,221::task::957::TaskManager.Task::(_decref) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::ref 1 aborting False >Thread-464::DEBUG::2013-03-01 12:58:40,221::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,222::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-464::DEBUG::2013-03-01 12:58:40,465::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-464::DEBUG::2013-03-01 12:58:40,474::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/91e28f67-2793-4b25-8e16-5c36b8492d33' (cwd None) >Thread-464::DEBUG::2013-03-01 12:58:40,733::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-464::DEBUG::2013-03-01 12:58:40,733::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,734::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-464::DEBUG::2013-03-01 12:58:40,734::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a/91e28f67-2793-4b25-8e16-5c36b8492d33'] >Thread-464::DEBUG::2013-03-01 12:58:40,735::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/40f9ecb8-6c2c-4915-a43d-641b285bbd8a >Thread-464::DEBUG::2013-03-01 12:58:40,736::task::719::TaskManager.Task::(_save) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3.temp >Thread-464::DEBUG::2013-03-01 12:58:40,744::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_40f9ecb8-6c2c-4915-a43d-641b285bbd8a for task fe259a5c-f1d9-490e-b65e-300c60718ca3 >Thread-464::INFO::2013-03-01 12:58:40,744::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-464::DEBUG::2013-03-01 12:58:40,744::task::1146::TaskManager.Task::(prepare) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::Prepare: 1 jobs exist, move to acquiring >Thread-464::DEBUG::2013-03-01 12:58:40,744::task::568::TaskManager.Task::(_updateState) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::moving from state preparing -> state acquiring >Thread-464::DEBUG::2013-03-01 12:58:40,745::task::719::TaskManager.Task::(_save) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3.temp >Thread-464::DEBUG::2013-03-01 12:58:40,753::task::568::TaskManager.Task::(_updateState) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::moving from state acquiring -> state queued >Thread-464::DEBUG::2013-03-01 12:58:40,754::task::719::TaskManager.Task::(_save) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3.temp >Thread-464::DEBUG::2013-03-01 12:58:40,761::taskManager::50::TaskManager::(_queueTask) queuing task: fe259a5c-f1d9-490e-b65e-300c60718ca3 >Thread-464::DEBUG::2013-03-01 12:58:40,761::taskManager::56::TaskManager::(_queueTask) task queued: fe259a5c-f1d9-490e-b65e-300c60718ca3 >Thread-3::DEBUG::2013-03-01 12:58:40,762::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-464::DEBUG::2013-03-01 12:58:40,763::task::1148::TaskManager.Task::(prepare) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::returning >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,763::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: fe259a5c-f1d9-490e-b65e-300c60718ca3 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15f8025950>> with: None >Thread-464::DEBUG::2013-03-01 12:58:40,764::task::957::TaskManager.Task::(_decref) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::ref 0 aborting False >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,765::task::1159::TaskManager.Task::(commit) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::committing task: fe259a5c-f1d9-490e-b65e-300c60718ca3 >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,767::task::568::TaskManager.Task::(_updateState) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::moving from state queued -> state running >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,769::task::719::TaskManager.Task::(_save) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3.temp >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,777::task::872::TaskManager.Task::(_runJobs) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::Task.run: running job 0: deleteImage_40f9ecb8-6c2c-4915-a43d-641b285bbd8a: <function <lambda> at 0x7f15ec179de8> (args: () kwargs: {}) >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,777::task::304::TaskManager.Task::(run) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::Job.run: running deleteImage_40f9ecb8-6c2c-4915-a43d-641b285bbd8a: <function <lambda> at 0x7f15ec179de8> (args: () kwargs: {}) callback None >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,777::task::568::TaskManager.Task::(_updateState) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::moving from state running -> state finished >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,778::task::719::TaskManager.Task::(_save) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/fe259a5c-f1d9-490e-b65e-300c60718ca3.temp >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,786::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a': < ResourceRef 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a', isValid: 'True' obj: 'None'>} >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,787::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,787::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,788::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,788::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,788::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,789::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,789::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' (0 active users) >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,789::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a' is free, finding out if anyone is waiting for it. >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,790::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.40f9ecb8-6c2c-4915-a43d-641b285bbd8a', Clearing records. >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,790::task::880::TaskManager.Task::(_runJobs) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::Task.run: exit - success: result True >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,790::task::957::TaskManager.Task::(_decref) Task=`fe259a5c-f1d9-490e-b65e-300c60718ca3`::ref 0 aborting False >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 12:58:40,791::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:58:41,769::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:41,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360311 s, 28.4 MB/s\n'; <rc> = 0 >Thread-465::DEBUG::2013-03-01 12:58:42,451::task::568::TaskManager.Task::(_updateState) Task=`546f7015-292e-445c-8257-d6c15571563f`::moving from state init -> state preparing >Thread-465::INFO::2013-03-01 12:58:42,452::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-465::INFO::2013-03-01 12:58:42,452::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103769302368', 'lastCheck': '7.2', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131750106812', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-465::DEBUG::2013-03-01 12:58:42,452::task::1151::TaskManager.Task::(prepare) Task=`546f7015-292e-445c-8257-d6c15571563f`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103769302368', 'lastCheck': '7.2', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131750106812', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-465::DEBUG::2013-03-01 12:58:42,453::task::568::TaskManager.Task::(_updateState) Task=`546f7015-292e-445c-8257-d6c15571563f`::moving from state preparing -> state finished >Thread-465::DEBUG::2013-03-01 12:58:42,453::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-465::DEBUG::2013-03-01 12:58:42,453::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-465::DEBUG::2013-03-01 12:58:42,453::task::957::TaskManager.Task::(_decref) Task=`546f7015-292e-445c-8257-d6c15571563f`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:43,863::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:43,951::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0427601 s, 23.9 MB/s\n'; <rc> = 0 >Thread-467::DEBUG::2013-03-01 12:58:44,363::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-467::DEBUG::2013-03-01 12:58:44,364::task::568::TaskManager.Task::(_updateState) Task=`162cec75-1869-4261-b0d5-94d3d345e3bb`::moving from state init -> state preparing >Thread-467::INFO::2013-03-01 12:58:44,364::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-467::DEBUG::2013-03-01 12:58:44,365::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-467::DEBUG::2013-03-01 12:58:44,365::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: fe259a5c-f1d9-490e-b65e-300c60718ca3 >Thread-467::DEBUG::2013-03-01 12:58:44,365::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fe259a5c-f1d9-490e-b65e-300c60718ca3'} >Thread-467::DEBUG::2013-03-01 12:58:44,366::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'fe259a5c-f1d9-490e-b65e-300c60718ca3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fe259a5c-f1d9-490e-b65e-300c60718ca3'}} >Thread-467::INFO::2013-03-01 12:58:44,366::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'fe259a5c-f1d9-490e-b65e-300c60718ca3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fe259a5c-f1d9-490e-b65e-300c60718ca3'}}} >Thread-467::DEBUG::2013-03-01 12:58:44,366::task::1151::TaskManager.Task::(prepare) Task=`162cec75-1869-4261-b0d5-94d3d345e3bb`::finished: {'allTasksStatus': {'fe259a5c-f1d9-490e-b65e-300c60718ca3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fe259a5c-f1d9-490e-b65e-300c60718ca3'}}} >Thread-467::DEBUG::2013-03-01 12:58:44,367::task::568::TaskManager.Task::(_updateState) Task=`162cec75-1869-4261-b0d5-94d3d345e3bb`::moving from state preparing -> state finished >Thread-467::DEBUG::2013-03-01 12:58:44,367::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-467::DEBUG::2013-03-01 12:58:44,367::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-467::DEBUG::2013-03-01 12:58:44,367::task::957::TaskManager.Task::(_decref) Task=`162cec75-1869-4261-b0d5-94d3d345e3bb`::ref 0 aborting False >Thread-468::DEBUG::2013-03-01 12:58:44,454::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-468::DEBUG::2013-03-01 12:58:44,455::task::568::TaskManager.Task::(_updateState) Task=`07010110-7e3e-48ec-914c-93186b92b601`::moving from state init -> state preparing >Thread-468::INFO::2013-03-01 12:58:44,455::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='fe259a5c-f1d9-490e-b65e-300c60718ca3', spUUID=None, options=None) >Thread-468::DEBUG::2013-03-01 12:58:44,456::taskManager::161::TaskManager::(clearTask) Entry. taskID: fe259a5c-f1d9-490e-b65e-300c60718ca3 >Thread-468::DEBUG::2013-03-01 12:58:44,457::taskManager::166::TaskManager::(clearTask) Return. >Thread-468::INFO::2013-03-01 12:58:44,457::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-468::DEBUG::2013-03-01 12:58:44,457::task::1151::TaskManager.Task::(prepare) Task=`07010110-7e3e-48ec-914c-93186b92b601`::finished: None >Thread-468::DEBUG::2013-03-01 12:58:44,458::task::568::TaskManager.Task::(_updateState) Task=`07010110-7e3e-48ec-914c-93186b92b601`::moving from state preparing -> state finished >Thread-468::DEBUG::2013-03-01 12:58:44,458::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-468::DEBUG::2013-03-01 12:58:44,458::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-468::DEBUG::2013-03-01 12:58:44,458::task::957::TaskManager.Task::(_decref) Task=`07010110-7e3e-48ec-914c-93186b92b601`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:58:45,209::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:58:45,218::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000299481 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:45,965::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:46,075::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493945 s, 20.7 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:46,554::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:58:46,555::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:46,872::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:46,874::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:58:46,875::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:46,887::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000357172 s, 11.5 MB/s\n'; <rc> = 0 >Thread-470::DEBUG::2013-03-01 12:58:48,066::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-470::DEBUG::2013-03-01 12:58:48,067::task::568::TaskManager.Task::(_updateState) Task=`2a6dba0c-2f78-4165-88b5-9e75f59c2fbe`::moving from state init -> state preparing >Thread-470::INFO::2013-03-01 12:58:48,067::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-470::INFO::2013-03-01 12:58:48,068::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-470::DEBUG::2013-03-01 12:58:48,068::task::1151::TaskManager.Task::(prepare) Task=`2a6dba0c-2f78-4165-88b5-9e75f59c2fbe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-470::DEBUG::2013-03-01 12:58:48,068::task::568::TaskManager.Task::(_updateState) Task=`2a6dba0c-2f78-4165-88b5-9e75f59c2fbe`::moving from state preparing -> state finished >Thread-470::DEBUG::2013-03-01 12:58:48,069::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-470::DEBUG::2013-03-01 12:58:48,069::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-470::DEBUG::2013-03-01 12:58:48,069::task::957::TaskManager.Task::(_decref) Task=`2a6dba0c-2f78-4165-88b5-9e75f59c2fbe`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:48,093::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-471::DEBUG::2013-03-01 12:58:48,104::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-471::DEBUG::2013-03-01 12:58:48,106::task::568::TaskManager.Task::(_updateState) Task=`93ab837d-9bf3-40cb-9e4a-4d942ee51028`::moving from state init -> state preparing >Thread-471::INFO::2013-03-01 12:58:48,106::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-471::DEBUG::2013-03-01 12:58:48,107::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`4be9c11e-50bf-485b-a0f7-e124b71c0db9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-471::DEBUG::2013-03-01 12:58:48,107::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-471::DEBUG::2013-03-01 12:58:48,107::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-471::DEBUG::2013-03-01 12:58:48,108::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`4be9c11e-50bf-485b-a0f7-e124b71c0db9`::Granted request >Thread-471::DEBUG::2013-03-01 12:58:48,109::task::794::TaskManager.Task::(resourceAcquired) Task=`93ab837d-9bf3-40cb-9e4a-4d942ee51028`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-471::DEBUG::2013-03-01 12:58:48,110::task::957::TaskManager.Task::(_decref) Task=`93ab837d-9bf3-40cb-9e4a-4d942ee51028`::ref 1 aborting False >Thread-471::INFO::2013-03-01 12:58:48,111::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-471::DEBUG::2013-03-01 12:58:48,111::task::1151::TaskManager.Task::(prepare) Task=`93ab837d-9bf3-40cb-9e4a-4d942ee51028`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-471::DEBUG::2013-03-01 12:58:48,112::task::568::TaskManager.Task::(_updateState) Task=`93ab837d-9bf3-40cb-9e4a-4d942ee51028`::moving from state preparing -> state finished >Thread-471::DEBUG::2013-03-01 12:58:48,112::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-471::DEBUG::2013-03-01 12:58:48,112::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-471::DEBUG::2013-03-01 12:58:48,113::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-471::DEBUG::2013-03-01 12:58:48,113::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-471::DEBUG::2013-03-01 12:58:48,114::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-471::DEBUG::2013-03-01 12:58:48,114::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-471::DEBUG::2013-03-01 12:58:48,114::task::957::TaskManager.Task::(_decref) Task=`93ab837d-9bf3-40cb-9e4a-4d942ee51028`::ref 0 aborting False >VM Channels Listener::DEBUG::2013-03-01 12:58:48,188::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 17. >Dummy-173::DEBUG::2013-03-01 12:58:48,206::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457661 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:50,226::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:50,339::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476579 s, 21.5 MB/s\n'; <rc> = 0 >Thread-473::DEBUG::2013-03-01 12:58:51,541::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call vmDestroy with ('bb607f4f-1442-4f4c-8f78-8dc0f9526e32',) {} >Thread-473::INFO::2013-03-01 12:58:51,541::API::309::vds::(destroy) vmContainerLock acquired by vm bb607f4f-1442-4f4c-8f78-8dc0f9526e32 >Thread-473::DEBUG::2013-03-01 12:58:51,542::libvirtvm::2588::vm.Vm::(destroy) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::destroy Called >Thread-473::INFO::2013-03-01 12:58:51,542::libvirtvm::2537::vm.Vm::(releaseVm) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Release VM resources >Thread-473::DEBUG::2013-03-01 12:58:51,554::utils::353::vm.Vm::(stop) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Stop statistics collection >Thread-394::DEBUG::2013-03-01 12:58:51,555::utils::384::vm.Vm::(run) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Stats thread finished >Thread-473::DEBUG::2013-03-01 12:58:51,555::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >Thread-473::DEBUG::2013-03-01 12:58:52,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >libvirtEventLoop::DEBUG::2013-03-01 12:58:52,170::libvirtvm::3003::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::event Stopped detail 1 opaque None >libvirtEventLoop::INFO::2013-03-01 12:58:52,171::vm::733::vm.Vm::(_onQemuDeath) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::underlying process disconnected >VM Channels Listener::DEBUG::2013-03-01 12:58:52,195::vmChannels::82::vds::(_do_del_channels) [Errno 2] No such file or directory (unregister was called twice?) >VM Channels Listener::DEBUG::2013-03-01 12:58:52,195::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Thread-473::DEBUG::2013-03-01 12:58:52,205::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-473::DEBUG::2013-03-01 12:58:52,205::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >Thread-473::DEBUG::2013-03-01 12:58:52,206::task::568::TaskManager.Task::(_updateState) Task=`04534f2f-2823-44e7-9ec5-bb15e529fb67`::moving from state init -> state preparing >Thread-473::INFO::2013-03-01 12:58:52,207::logUtils::37::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='bb607f4f-1442-4f4c-8f78-8dc0f9526e32') >Thread-473::INFO::2013-03-01 12:58:52,211::logUtils::39::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-473::DEBUG::2013-03-01 12:58:52,211::task::1151::TaskManager.Task::(prepare) Task=`04534f2f-2823-44e7-9ec5-bb15e529fb67`::finished: None >Thread-473::DEBUG::2013-03-01 12:58:52,211::task::568::TaskManager.Task::(_updateState) Task=`04534f2f-2823-44e7-9ec5-bb15e529fb67`::moving from state preparing -> state finished >Thread-473::DEBUG::2013-03-01 12:58:52,212::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-473::DEBUG::2013-03-01 12:58:52,212::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-473::DEBUG::2013-03-01 12:58:52,212::task::957::TaskManager.Task::(_decref) Task=`04534f2f-2823-44e7-9ec5-bb15e529fb67`::ref 0 aborting False >Thread-473::DEBUG::2013-03-01 12:58:52,213::libvirtvm::2582::vm.Vm::(deleteVm) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Total desktops after destroy of bb607f4f-1442-4f4c-8f78-8dc0f9526e32 is 0 >Thread-473::DEBUG::2013-03-01 12:58:52,214::BindingXMLRPC::920::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2013-03-01 12:58:52,215::vm::1047::vm.Vm::(setDownStatus) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2013-03-01 12:58:52,217::vmChannels::152::vds::(unregister) Delete fileno 17 from listener. >libvirtEventLoop::DEBUG::2013-03-01 12:58:52,219::utils::353::vm.Vm::(stop) vmId=`bb607f4f-1442-4f4c-8f78-8dc0f9526e32`::Stop statistics collection >Dummy-173::DEBUG::2013-03-01 12:58:52,359::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:52,471::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462561 s, 22.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2013-03-01 12:58:53,197::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >VM Channels Listener::DEBUG::2013-03-01 12:58:53,197::vmChannels::88::vds::(_do_del_channels) fileno 17 was removed from listener. >Dummy-173::DEBUG::2013-03-01 12:58:54,491::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:54,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370612 s, 27.6 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:58:55,220::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:58:55,230::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000312827 s, 13.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:58:56,612::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:56,716::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462495 s, 22.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:58:56,893::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:58:56,906::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000353554 s, 11.6 MB/s\n'; <rc> = 0 >Thread-476::DEBUG::2013-03-01 12:58:58,185::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-476::DEBUG::2013-03-01 12:58:58,186::task::568::TaskManager.Task::(_updateState) Task=`8a32ae13-a239-4acf-aba5-a21b7c835a16`::moving from state init -> state preparing >Thread-476::INFO::2013-03-01 12:58:58,187::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-476::INFO::2013-03-01 12:58:58,187::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-476::DEBUG::2013-03-01 12:58:58,187::task::1151::TaskManager.Task::(prepare) Task=`8a32ae13-a239-4acf-aba5-a21b7c835a16`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-476::DEBUG::2013-03-01 12:58:58,188::task::568::TaskManager.Task::(_updateState) Task=`8a32ae13-a239-4acf-aba5-a21b7c835a16`::moving from state preparing -> state finished >Thread-476::DEBUG::2013-03-01 12:58:58,188::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-476::DEBUG::2013-03-01 12:58:58,188::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-476::DEBUG::2013-03-01 12:58:58,188::task::957::TaskManager.Task::(_decref) Task=`8a32ae13-a239-4acf-aba5-a21b7c835a16`::ref 0 aborting False >Thread-477::DEBUG::2013-03-01 12:58:58,222::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-477::DEBUG::2013-03-01 12:58:58,222::task::568::TaskManager.Task::(_updateState) Task=`53f4d7ed-0b6f-4600-8ec7-75971d65af82`::moving from state init -> state preparing >Thread-477::INFO::2013-03-01 12:58:58,222::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-477::DEBUG::2013-03-01 12:58:58,223::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`59166204-41be-442f-961d-ca8331b733ce`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-477::DEBUG::2013-03-01 12:58:58,223::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-477::DEBUG::2013-03-01 12:58:58,224::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-477::DEBUG::2013-03-01 12:58:58,224::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`59166204-41be-442f-961d-ca8331b733ce`::Granted request >Thread-477::DEBUG::2013-03-01 12:58:58,225::task::794::TaskManager.Task::(resourceAcquired) Task=`53f4d7ed-0b6f-4600-8ec7-75971d65af82`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-477::DEBUG::2013-03-01 12:58:58,225::task::957::TaskManager.Task::(_decref) Task=`53f4d7ed-0b6f-4600-8ec7-75971d65af82`::ref 1 aborting False >Thread-477::INFO::2013-03-01 12:58:58,227::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-477::DEBUG::2013-03-01 12:58:58,227::task::1151::TaskManager.Task::(prepare) Task=`53f4d7ed-0b6f-4600-8ec7-75971d65af82`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-477::DEBUG::2013-03-01 12:58:58,227::task::568::TaskManager.Task::(_updateState) Task=`53f4d7ed-0b6f-4600-8ec7-75971d65af82`::moving from state preparing -> state finished >Thread-477::DEBUG::2013-03-01 12:58:58,227::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-477::DEBUG::2013-03-01 12:58:58,228::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-477::DEBUG::2013-03-01 12:58:58,228::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-477::DEBUG::2013-03-01 12:58:58,229::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-477::DEBUG::2013-03-01 12:58:58,229::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-477::DEBUG::2013-03-01 12:58:58,229::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-477::DEBUG::2013-03-01 12:58:58,230::task::957::TaskManager.Task::(_decref) Task=`53f4d7ed-0b6f-4600-8ec7-75971d65af82`::ref 0 aborting False >Thread-478::DEBUG::2013-03-01 12:58:58,365::task::568::TaskManager.Task::(_updateState) Task=`8d17a90e-bb00-48f7-aa43-cfdb3f222333`::moving from state init -> state preparing >Thread-478::INFO::2013-03-01 12:58:58,365::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-478::INFO::2013-03-01 12:58:58,365::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102660655975', 'lastCheck': '3.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0574748516083', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-478::DEBUG::2013-03-01 12:58:58,366::task::1151::TaskManager.Task::(prepare) Task=`8d17a90e-bb00-48f7-aa43-cfdb3f222333`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102660655975', 'lastCheck': '3.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0574748516083', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-478::DEBUG::2013-03-01 12:58:58,366::task::568::TaskManager.Task::(_updateState) Task=`8d17a90e-bb00-48f7-aa43-cfdb3f222333`::moving from state preparing -> state finished >Thread-478::DEBUG::2013-03-01 12:58:58,366::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-478::DEBUG::2013-03-01 12:58:58,366::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-478::DEBUG::2013-03-01 12:58:58,367::task::957::TaskManager.Task::(_decref) Task=`8d17a90e-bb00-48f7-aa43-cfdb3f222333`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:58:58,728::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:58:58,836::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469035 s, 21.8 MB/s\n'; <rc> = 0 >Thread-480::DEBUG::2013-03-01 12:58:59,158::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-480::DEBUG::2013-03-01 12:58:59,158::task::568::TaskManager.Task::(_updateState) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::moving from state init -> state preparing >Thread-480::INFO::2013-03-01 12:58:59,158::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='15078fcf-636b-4259-b3ea-7ca11f9d5d87', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-480::INFO::2013-03-01 12:58:59,159::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-480::DEBUG::2013-03-01 12:58:59,159::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-480::DEBUG::2013-03-01 12:58:59,419::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-480::DEBUG::2013-03-01 12:58:59,419::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-480::DEBUG::2013-03-01 12:58:59,419::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-480::DEBUG::2013-03-01 12:58:59,420::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-480::DEBUG::2013-03-01 12:58:59,420::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-480::DEBUG::2013-03-01 12:58:59,420::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-480::DEBUG::2013-03-01 12:58:59,421::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-480::DEBUG::2013-03-01 12:58:59,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-480::DEBUG::2013-03-01 12:58:59,669::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-480::DEBUG::2013-03-01 12:58:59,669::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-480::DEBUG::2013-03-01 12:58:59,670::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d121cc3d-3e29-441d-81af-e16b93df53b9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-480::DEBUG::2013-03-01 12:58:59,670::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-480::DEBUG::2013-03-01 12:58:59,671::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-480::DEBUG::2013-03-01 12:58:59,671::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d121cc3d-3e29-441d-81af-e16b93df53b9`::Granted request >Thread-480::DEBUG::2013-03-01 12:58:59,671::task::794::TaskManager.Task::(resourceAcquired) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-480::DEBUG::2013-03-01 12:58:59,671::task::957::TaskManager.Task::(_decref) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::ref 1 aborting False >Thread-480::DEBUG::2013-03-01 12:58:59,673::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >Thread-480::DEBUG::2013-03-01 12:58:59,679::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab >Thread-480::INFO::2013-03-01 12:58:59,679::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-480::DEBUG::2013-03-01 12:58:59,679::task::1146::TaskManager.Task::(prepare) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::Prepare: 1 jobs exist, move to acquiring >Thread-480::DEBUG::2013-03-01 12:58:59,680::task::568::TaskManager.Task::(_updateState) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::moving from state preparing -> state acquiring >Thread-480::DEBUG::2013-03-01 12:58:59,680::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >Thread-480::DEBUG::2013-03-01 12:58:59,686::task::568::TaskManager.Task::(_updateState) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::moving from state acquiring -> state queued >Thread-480::DEBUG::2013-03-01 12:58:59,687::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >Thread-480::DEBUG::2013-03-01 12:58:59,694::taskManager::50::TaskManager::(_queueTask) queuing task: 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab >Thread-480::DEBUG::2013-03-01 12:58:59,695::taskManager::56::TaskManager::(_queueTask) task queued: 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab >9ba04d11-0593-49ad-bba6-6e4008140223::DEBUG::2013-03-01 12:58:59,695::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-480::DEBUG::2013-03-01 12:58:59,695::task::1148::TaskManager.Task::(prepare) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::returning >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,696::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab running: <bound method Task.commit of <storage.task.Task instance at 0x7f15ec1a25a8>> with: None >Thread-480::DEBUG::2013-03-01 12:58:59,696::task::957::TaskManager.Task::(_decref) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::ref 0 aborting False >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,696::task::1159::TaskManager.Task::(commit) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::committing task: 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,698::task::568::TaskManager.Task::(_updateState) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::moving from state queued -> state running >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,700::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,706::task::872::TaskManager.Task::(_runJobs) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 12582912, 4, 2, 2, '15078fcf-636b-4259-b3ea-7ca11f9d5d87', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,707::task::304::TaskManager.Task::(run) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 12582912, 4, 2, 2, '15078fcf-636b-4259-b3ea-7ca11f9d5d87', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,707::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`cec2520c-e285-4fad-acf2-0c730eacf291`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,707::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' for lock type 'exclusive' >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,708::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,953::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,964::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,964::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image d89f5a12-6aa5-4fe7-83f7-f54f128098ec does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,964::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free. Now locking as 'exclusive' (1 active user) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,964::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`cec2520c-e285-4fad-acf2-0c730eacf291`::Granted request >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::INFO::2013-03-01 12:58:59,965::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec for image's volumes >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,966::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,975::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:58:59,976::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:00,222::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:00,233::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::WARNING::2013-03-01 12:59:00,233::lvm::593::Storage.LVM::(getLv) lv: 15078fcf-636b-4259-b3ea-7ca11f9d5d87 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::INFO::2013-03-01 12:59:00,233::volume::457::Storage.Volume::(create) Creating volume 15078fcf-636b-4259-b3ea-7ca11f9d5d87 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:00,234::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:00,245::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:00,255::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 15078fcf-636b-4259-b3ea-7ca11f9d5d87 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:00,851::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:00,958::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476452 s, 21.5 MB/s\n'; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,928::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,938::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,938::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,938::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,939::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::INFO::2013-03-01 12:59:01,940::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 with size = 12582912 sectors >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,940::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 6291456K' (cwd None) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,952::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,953::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:01,954::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,161::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,172::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::WARNING::2013-03-01 12:59:02,172::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,172::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_d89f5a12-6aa5-4fe7-83f7-f54f128098ec --addtag MD_7 --addtag PU_00000000-0000-0000-0000-000000000000 a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87' (cwd None) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,378::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,378::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,379::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,379::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87' (cwd None) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,588::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,589::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,594::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,595::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,604::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=15078fcf-636b-4259-b3ea-7ca11f9d5d87 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,610::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,619::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,619::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' (0 active users) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,620::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free, finding out if anyone is waiting for it. >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,620::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec', Clearing records. >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,620::task::568::TaskManager.Task::(_updateState) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::moving from state running -> state finished >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,621::task::719::TaskManager.Task::(_save) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/9e8a0da8-8ddc-4a7b-8df7-644a3087fdab.temp >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,631::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,631::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,632::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,632::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,632::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,632::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,633::task::880::TaskManager.Task::(_runJobs) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::Task.run: exit - success: result {'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87'} >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,633::task::957::TaskManager.Task::(_decref) Task=`9e8a0da8-8ddc-4a7b-8df7-644a3087fdab`::ref 0 aborting False >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 12:59:02,633::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:59:02,976::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:03,078::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408746 s, 25.1 MB/s\n'; <rc> = 0 >Thread-482::DEBUG::2013-03-01 12:59:04,414::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-482::DEBUG::2013-03-01 12:59:04,415::task::568::TaskManager.Task::(_updateState) Task=`f7f693c8-cc57-4856-bf73-8c0b1fe8cac1`::moving from state init -> state preparing >Thread-482::INFO::2013-03-01 12:59:04,416::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-482::DEBUG::2013-03-01 12:59:04,416::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-482::DEBUG::2013-03-01 12:59:04,416::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab >Thread-482::DEBUG::2013-03-01 12:59:04,416::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9e8a0da8-8ddc-4a7b-8df7-644a3087fdab'} >Thread-482::DEBUG::2013-03-01 12:59:04,417::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9e8a0da8-8ddc-4a7b-8df7-644a3087fdab': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9e8a0da8-8ddc-4a7b-8df7-644a3087fdab'}} >Thread-482::INFO::2013-03-01 12:59:04,417::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9e8a0da8-8ddc-4a7b-8df7-644a3087fdab': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9e8a0da8-8ddc-4a7b-8df7-644a3087fdab'}}} >Thread-482::DEBUG::2013-03-01 12:59:04,417::task::1151::TaskManager.Task::(prepare) Task=`f7f693c8-cc57-4856-bf73-8c0b1fe8cac1`::finished: {'allTasksStatus': {'9e8a0da8-8ddc-4a7b-8df7-644a3087fdab': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9e8a0da8-8ddc-4a7b-8df7-644a3087fdab'}}} >Thread-482::DEBUG::2013-03-01 12:59:04,418::task::568::TaskManager.Task::(_updateState) Task=`f7f693c8-cc57-4856-bf73-8c0b1fe8cac1`::moving from state preparing -> state finished >Thread-482::DEBUG::2013-03-01 12:59:04,418::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-482::DEBUG::2013-03-01 12:59:04,418::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-482::DEBUG::2013-03-01 12:59:04,418::task::957::TaskManager.Task::(_decref) Task=`f7f693c8-cc57-4856-bf73-8c0b1fe8cac1`::ref 0 aborting False >Thread-483::DEBUG::2013-03-01 12:59:04,474::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-483::DEBUG::2013-03-01 12:59:04,475::task::568::TaskManager.Task::(_updateState) Task=`00140aee-7e33-4b5f-92ef-3a5d6d248bdd`::moving from state init -> state preparing >Thread-483::INFO::2013-03-01 12:59:04,475::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', volUUID='15078fcf-636b-4259-b3ea-7ca11f9d5d87', options=None) >Thread-483::DEBUG::2013-03-01 12:59:04,476::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`4db77c5a-75d7-4ccf-b613-f0d68108252d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-483::DEBUG::2013-03-01 12:59:04,476::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-483::DEBUG::2013-03-01 12:59:04,476::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-483::DEBUG::2013-03-01 12:59:04,477::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`4db77c5a-75d7-4ccf-b613-f0d68108252d`::Granted request >Thread-483::DEBUG::2013-03-01 12:59:04,477::task::794::TaskManager.Task::(resourceAcquired) Task=`00140aee-7e33-4b5f-92ef-3a5d6d248bdd`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-483::DEBUG::2013-03-01 12:59:04,477::task::957::TaskManager.Task::(_decref) Task=`00140aee-7e33-4b5f-92ef-3a5d6d248bdd`::ref 1 aborting False >Thread-483::DEBUG::2013-03-01 12:59:04,478::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-483::DEBUG::2013-03-01 12:59:04,479::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-483::DEBUG::2013-03-01 12:59:04,721::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-483::DEBUG::2013-03-01 12:59:04,733::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-483::INFO::2013-03-01 12:59:04,733::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec volUUID = 15078fcf-636b-4259-b3ea-7ca11f9d5d87 >Thread-483::DEBUG::2013-03-01 12:59:04,734::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-483::DEBUG::2013-03-01 12:59:04,744::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000304969 s, 1.7 MB/s\n'; <rc> = 0 >Thread-483::DEBUG::2013-03-01 12:59:04,744::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000304969 s, 1.7 MB/s'], size: 512 >Thread-483::DEBUG::2013-03-01 12:59:04,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-483::DEBUG::2013-03-01 12:59:04,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000302327 s, 1.7 MB/s\n'; <rc> = 0 >Thread-483::DEBUG::2013-03-01 12:59:04,756::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000302327 s, 1.7 MB/s'], size: 512 >Thread-483::DEBUG::2013-03-01 12:59:04,756::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-483::DEBUG::2013-03-01 12:59:04,757::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-483::DEBUG::2013-03-01 12:59:05,004::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-483::DEBUG::2013-03-01 12:59:05,015::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-483::INFO::2013-03-01 12:59:05,016::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-483::INFO::2013-03-01 12:59:05,016::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-483::DEBUG::2013-03-01 12:59:05,016::task::1151::TaskManager.Task::(prepare) Task=`00140aee-7e33-4b5f-92ef-3a5d6d248bdd`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-483::DEBUG::2013-03-01 12:59:05,016::task::568::TaskManager.Task::(_updateState) Task=`00140aee-7e33-4b5f-92ef-3a5d6d248bdd`::moving from state preparing -> state finished >Thread-483::DEBUG::2013-03-01 12:59:05,017::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-483::DEBUG::2013-03-01 12:59:05,017::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-483::DEBUG::2013-03-01 12:59:05,017::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-483::DEBUG::2013-03-01 12:59:05,018::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-483::DEBUG::2013-03-01 12:59:05,018::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-483::DEBUG::2013-03-01 12:59:05,018::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-483::DEBUG::2013-03-01 12:59:05,019::task::957::TaskManager.Task::(_decref) Task=`00140aee-7e33-4b5f-92ef-3a5d6d248bdd`::ref 0 aborting False >Thread-485::DEBUG::2013-03-01 12:59:05,067::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-485::DEBUG::2013-03-01 12:59:05,068::task::568::TaskManager.Task::(_updateState) Task=`08503756-7596-4205-bf21-0b7c4c359250`::moving from state init -> state preparing >Thread-485::INFO::2013-03-01 12:59:05,068::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='9e8a0da8-8ddc-4a7b-8df7-644a3087fdab', spUUID=None, options=None) >Thread-485::DEBUG::2013-03-01 12:59:05,068::taskManager::161::TaskManager::(clearTask) Entry. taskID: 9e8a0da8-8ddc-4a7b-8df7-644a3087fdab >Thread-485::DEBUG::2013-03-01 12:59:05,070::taskManager::166::TaskManager::(clearTask) Return. >Thread-485::INFO::2013-03-01 12:59:05,070::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-485::DEBUG::2013-03-01 12:59:05,070::task::1151::TaskManager.Task::(prepare) Task=`08503756-7596-4205-bf21-0b7c4c359250`::finished: None >Thread-485::DEBUG::2013-03-01 12:59:05,071::task::568::TaskManager.Task::(_updateState) Task=`08503756-7596-4205-bf21-0b7c4c359250`::moving from state preparing -> state finished >Thread-485::DEBUG::2013-03-01 12:59:05,071::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-485::DEBUG::2013-03-01 12:59:05,071::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-485::DEBUG::2013-03-01 12:59:05,071::task::957::TaskManager.Task::(_decref) Task=`08503756-7596-4205-bf21-0b7c4c359250`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:59:05,098::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:05,207::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490911 s, 20.9 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:59:05,232::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:05,241::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000321668 s, 12.7 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:06,956::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:06,956::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:07,227::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:07,304::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300742 s, 34.0 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:07,324::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:07,325::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:07,326::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:07,338::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000361237 s, 11.3 MB/s\n'; <rc> = 0 >Thread-487::DEBUG::2013-03-01 12:59:08,322::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-487::DEBUG::2013-03-01 12:59:08,322::task::568::TaskManager.Task::(_updateState) Task=`29ed5f0a-8bd6-46fc-ab84-80c95f4f9151`::moving from state init -> state preparing >Thread-487::INFO::2013-03-01 12:59:08,323::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-487::INFO::2013-03-01 12:59:08,323::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-487::DEBUG::2013-03-01 12:59:08,324::task::1151::TaskManager.Task::(prepare) Task=`29ed5f0a-8bd6-46fc-ab84-80c95f4f9151`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-487::DEBUG::2013-03-01 12:59:08,324::task::568::TaskManager.Task::(_updateState) Task=`29ed5f0a-8bd6-46fc-ab84-80c95f4f9151`::moving from state preparing -> state finished >Thread-487::DEBUG::2013-03-01 12:59:08,324::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-487::DEBUG::2013-03-01 12:59:08,324::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-487::DEBUG::2013-03-01 12:59:08,325::task::957::TaskManager.Task::(_decref) Task=`29ed5f0a-8bd6-46fc-ab84-80c95f4f9151`::ref 0 aborting False >Thread-488::DEBUG::2013-03-01 12:59:08,350::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-488::DEBUG::2013-03-01 12:59:08,350::task::568::TaskManager.Task::(_updateState) Task=`e8a14e95-f718-40ed-954f-c1104d3d194b`::moving from state init -> state preparing >Thread-488::INFO::2013-03-01 12:59:08,351::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-488::DEBUG::2013-03-01 12:59:08,356::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`93ce8381-dea6-4542-bee9-4c92e310e266`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-488::DEBUG::2013-03-01 12:59:08,356::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-488::DEBUG::2013-03-01 12:59:08,356::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-488::DEBUG::2013-03-01 12:59:08,357::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`93ce8381-dea6-4542-bee9-4c92e310e266`::Granted request >Thread-488::DEBUG::2013-03-01 12:59:08,357::task::794::TaskManager.Task::(resourceAcquired) Task=`e8a14e95-f718-40ed-954f-c1104d3d194b`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-488::DEBUG::2013-03-01 12:59:08,358::task::957::TaskManager.Task::(_decref) Task=`e8a14e95-f718-40ed-954f-c1104d3d194b`::ref 1 aborting False >Thread-488::INFO::2013-03-01 12:59:08,359::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-488::DEBUG::2013-03-01 12:59:08,359::task::1151::TaskManager.Task::(prepare) Task=`e8a14e95-f718-40ed-954f-c1104d3d194b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-488::DEBUG::2013-03-01 12:59:08,360::task::568::TaskManager.Task::(_updateState) Task=`e8a14e95-f718-40ed-954f-c1104d3d194b`::moving from state preparing -> state finished >Thread-488::DEBUG::2013-03-01 12:59:08,360::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-488::DEBUG::2013-03-01 12:59:08,360::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-488::DEBUG::2013-03-01 12:59:08,361::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-488::DEBUG::2013-03-01 12:59:08,361::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-488::DEBUG::2013-03-01 12:59:08,361::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-488::DEBUG::2013-03-01 12:59:08,361::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-488::DEBUG::2013-03-01 12:59:08,362::task::957::TaskManager.Task::(_decref) Task=`e8a14e95-f718-40ed-954f-c1104d3d194b`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:59:09,318::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:09,432::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413768 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:11,451::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:11,562::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049867 s, 20.5 MB/s\n'; <rc> = 0 >Thread-490::DEBUG::2013-03-01 12:59:12,716::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-490::DEBUG::2013-03-01 12:59:12,716::task::568::TaskManager.Task::(_updateState) Task=`7e0e4799-d199-4d5e-a949-921d71d395ae`::moving from state init -> state preparing >Thread-490::INFO::2013-03-01 12:59:12,717::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', volUUID='15078fcf-636b-4259-b3ea-7ca11f9d5d87', options=None) >Thread-490::DEBUG::2013-03-01 12:59:12,717::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a9640dcf-082c-42ca-9485-c628859e7cd2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-490::DEBUG::2013-03-01 12:59:12,718::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-490::DEBUG::2013-03-01 12:59:12,718::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-490::DEBUG::2013-03-01 12:59:12,718::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a9640dcf-082c-42ca-9485-c628859e7cd2`::Granted request >Thread-490::DEBUG::2013-03-01 12:59:12,719::task::794::TaskManager.Task::(resourceAcquired) Task=`7e0e4799-d199-4d5e-a949-921d71d395ae`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-490::DEBUG::2013-03-01 12:59:12,719::task::957::TaskManager.Task::(_decref) Task=`7e0e4799-d199-4d5e-a949-921d71d395ae`::ref 1 aborting False >Thread-490::INFO::2013-03-01 12:59:12,720::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec volUUID = 15078fcf-636b-4259-b3ea-7ca11f9d5d87 >Thread-490::DEBUG::2013-03-01 12:59:12,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-490::DEBUG::2013-03-01 12:59:12,730::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000331306 s, 1.5 MB/s\n'; <rc> = 0 >Thread-490::DEBUG::2013-03-01 12:59:12,731::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000331306 s, 1.5 MB/s'], size: 512 >Thread-490::DEBUG::2013-03-01 12:59:12,732::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-490::DEBUG::2013-03-01 12:59:12,741::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00030668 s, 1.7 MB/s\n'; <rc> = 0 >Thread-490::DEBUG::2013-03-01 12:59:12,742::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00030668 s, 1.7 MB/s'], size: 512 >Thread-490::DEBUG::2013-03-01 12:59:12,742::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-490::DEBUG::2013-03-01 12:59:12,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-490::DEBUG::2013-03-01 12:59:12,987::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-490::DEBUG::2013-03-01 12:59:12,998::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-490::INFO::2013-03-01 12:59:12,998::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-490::INFO::2013-03-01 12:59:12,999::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-490::DEBUG::2013-03-01 12:59:12,999::task::1151::TaskManager.Task::(prepare) Task=`7e0e4799-d199-4d5e-a949-921d71d395ae`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-490::DEBUG::2013-03-01 12:59:12,999::task::568::TaskManager.Task::(_updateState) Task=`7e0e4799-d199-4d5e-a949-921d71d395ae`::moving from state preparing -> state finished >Thread-490::DEBUG::2013-03-01 12:59:12,999::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-490::DEBUG::2013-03-01 12:59:13,000::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-490::DEBUG::2013-03-01 12:59:13,000::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-490::DEBUG::2013-03-01 12:59:13,000::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-490::DEBUG::2013-03-01 12:59:13,000::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-490::DEBUG::2013-03-01 12:59:13,001::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-490::DEBUG::2013-03-01 12:59:13,001::task::957::TaskManager.Task::(_decref) Task=`7e0e4799-d199-4d5e-a949-921d71d395ae`::ref 0 aborting False >Thread-491::DEBUG::2013-03-01 12:59:13,109::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-491::DEBUG::2013-03-01 12:59:13,110::task::568::TaskManager.Task::(_updateState) Task=`8a786b1f-da74-424c-b5d7-4fac92a8e67e`::moving from state init -> state preparing >Thread-491::INFO::2013-03-01 12:59:13,110::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', volUUID='15078fcf-636b-4259-b3ea-7ca11f9d5d87', options=None) >Thread-491::DEBUG::2013-03-01 12:59:13,111::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ce4b4774-147a-43c5-b63b-c810dfaf44af`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-491::DEBUG::2013-03-01 12:59:13,111::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-491::DEBUG::2013-03-01 12:59:13,111::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-491::DEBUG::2013-03-01 12:59:13,112::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ce4b4774-147a-43c5-b63b-c810dfaf44af`::Granted request >Thread-491::DEBUG::2013-03-01 12:59:13,112::task::794::TaskManager.Task::(resourceAcquired) Task=`8a786b1f-da74-424c-b5d7-4fac92a8e67e`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-491::DEBUG::2013-03-01 12:59:13,113::task::957::TaskManager.Task::(_decref) Task=`8a786b1f-da74-424c-b5d7-4fac92a8e67e`::ref 1 aborting False >Thread-491::INFO::2013-03-01 12:59:13,113::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec volUUID = 15078fcf-636b-4259-b3ea-7ca11f9d5d87 >Thread-491::DEBUG::2013-03-01 12:59:13,113::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-491::DEBUG::2013-03-01 12:59:13,123::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308739 s, 1.7 MB/s\n'; <rc> = 0 >Thread-491::DEBUG::2013-03-01 12:59:13,124::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308739 s, 1.7 MB/s'], size: 512 >Thread-491::DEBUG::2013-03-01 12:59:13,125::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-491::DEBUG::2013-03-01 12:59:13,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316048 s, 1.6 MB/s\n'; <rc> = 0 >Thread-491::DEBUG::2013-03-01 12:59:13,135::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316048 s, 1.6 MB/s'], size: 512 >Thread-491::DEBUG::2013-03-01 12:59:13,136::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-491::DEBUG::2013-03-01 12:59:13,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-491::DEBUG::2013-03-01 12:59:13,381::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-491::DEBUG::2013-03-01 12:59:13,392::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-491::INFO::2013-03-01 12:59:13,393::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-491::INFO::2013-03-01 12:59:13,393::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-491::DEBUG::2013-03-01 12:59:13,393::task::1151::TaskManager.Task::(prepare) Task=`8a786b1f-da74-424c-b5d7-4fac92a8e67e`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135542', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135542', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-491::DEBUG::2013-03-01 12:59:13,394::task::568::TaskManager.Task::(_updateState) Task=`8a786b1f-da74-424c-b5d7-4fac92a8e67e`::moving from state preparing -> state finished >Thread-491::DEBUG::2013-03-01 12:59:13,394::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-491::DEBUG::2013-03-01 12:59:13,394::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-491::DEBUG::2013-03-01 12:59:13,395::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-491::DEBUG::2013-03-01 12:59:13,395::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-491::DEBUG::2013-03-01 12:59:13,395::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-491::DEBUG::2013-03-01 12:59:13,396::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-491::DEBUG::2013-03-01 12:59:13,396::task::957::TaskManager.Task::(_decref) Task=`8a786b1f-da74-424c-b5d7-4fac92a8e67e`::ref 0 aborting False >Thread-492::DEBUG::2013-03-01 12:59:13,427::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-492::DEBUG::2013-03-01 12:59:13,428::task::568::TaskManager.Task::(_updateState) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::moving from state init -> state preparing >Thread-492::INFO::2013-03-01 12:59:13,428::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='7dd32175-f11e-4137-9148-5d783cc08e2f', desc='', srcImgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', srcVolUUID='15078fcf-636b-4259-b3ea-7ca11f9d5d87') >Thread-492::INFO::2013-03-01 12:59:13,429::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-492::DEBUG::2013-03-01 12:59:13,429::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:13,582::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-493::DEBUG::2013-03-01 12:59:13,643::task::568::TaskManager.Task::(_updateState) Task=`f9d84c99-a68f-4a77-8075-ece03fd64940`::moving from state init -> state preparing >Thread-493::INFO::2013-03-01 12:59:13,646::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-493::INFO::2013-03-01 12:59:13,649::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104038715363', 'lastCheck': '8.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.012305021286', 'lastCheck': '6.3', 'code': 0, 'valid': True}} >Thread-493::DEBUG::2013-03-01 12:59:13,650::task::1151::TaskManager.Task::(prepare) Task=`f9d84c99-a68f-4a77-8075-ece03fd64940`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104038715363', 'lastCheck': '8.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.012305021286', 'lastCheck': '6.3', 'code': 0, 'valid': True}} >Thread-493::DEBUG::2013-03-01 12:59:13,653::task::568::TaskManager.Task::(_updateState) Task=`f9d84c99-a68f-4a77-8075-ece03fd64940`::moving from state preparing -> state finished >Thread-493::DEBUG::2013-03-01 12:59:13,654::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-493::DEBUG::2013-03-01 12:59:13,655::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-493::DEBUG::2013-03-01 12:59:13,656::task::957::TaskManager.Task::(_decref) Task=`f9d84c99-a68f-4a77-8075-ece03fd64940`::ref 0 aborting False >Thread-492::DEBUG::2013-03-01 12:59:13,671::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-492::DEBUG::2013-03-01 12:59:13,674::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-492::DEBUG::2013-03-01 12:59:13,677::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-492::DEBUG::2013-03-01 12:59:13,679::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-492::DEBUG::2013-03-01 12:59:13,681::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-492::DEBUG::2013-03-01 12:59:13,683::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-492::DEBUG::2013-03-01 12:59:13,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:13,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438814 s, 23.3 MB/s\n'; <rc> = 0 >Thread-492::DEBUG::2013-03-01 12:59:13,877::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-492::DEBUG::2013-03-01 12:59:13,878::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-492::DEBUG::2013-03-01 12:59:13,879::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-492::DEBUG::2013-03-01 12:59:13,880::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`b0c51bbf-18d2-4345-8c61-731926bb1ec7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-492::DEBUG::2013-03-01 12:59:13,880::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-492::DEBUG::2013-03-01 12:59:13,880::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-492::DEBUG::2013-03-01 12:59:13,881::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`b0c51bbf-18d2-4345-8c61-731926bb1ec7`::Granted request >Thread-492::DEBUG::2013-03-01 12:59:13,881::task::794::TaskManager.Task::(resourceAcquired) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-492::DEBUG::2013-03-01 12:59:13,881::task::957::TaskManager.Task::(_decref) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::ref 1 aborting False >Thread-492::DEBUG::2013-03-01 12:59:13,882::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >Thread-492::DEBUG::2013-03-01 12:59:13,888::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task ad0f352c-ea49-4c10-87f6-38166a43fa38 >Thread-492::INFO::2013-03-01 12:59:13,888::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-492::DEBUG::2013-03-01 12:59:13,888::task::1146::TaskManager.Task::(prepare) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::Prepare: 1 jobs exist, move to acquiring >Thread-492::DEBUG::2013-03-01 12:59:13,888::task::568::TaskManager.Task::(_updateState) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::moving from state preparing -> state acquiring >Thread-492::DEBUG::2013-03-01 12:59:13,889::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >Thread-492::DEBUG::2013-03-01 12:59:13,894::task::568::TaskManager.Task::(_updateState) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::moving from state acquiring -> state queued >Thread-492::DEBUG::2013-03-01 12:59:13,895::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >Thread-492::DEBUG::2013-03-01 12:59:13,900::taskManager::50::TaskManager::(_queueTask) queuing task: ad0f352c-ea49-4c10-87f6-38166a43fa38 >269d8563-1c33-4a96-8b83-ea783b7979ec::DEBUG::2013-03-01 12:59:13,901::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-492::DEBUG::2013-03-01 12:59:13,901::taskManager::56::TaskManager::(_queueTask) task queued: ad0f352c-ea49-4c10-87f6-38166a43fa38 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,902::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: ad0f352c-ea49-4c10-87f6-38166a43fa38 running: <bound method Task.commit of <storage.task.Task instance at 0x17be440>> with: None >Thread-492::DEBUG::2013-03-01 12:59:13,902::task::1148::TaskManager.Task::(prepare) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::returning >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,902::task::1159::TaskManager.Task::(commit) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::committing task: ad0f352c-ea49-4c10-87f6-38166a43fa38 >Thread-492::DEBUG::2013-03-01 12:59:13,903::task::957::TaskManager.Task::(_decref) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::ref 0 aborting False >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,903::task::568::TaskManager.Task::(_updateState) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::moving from state queued -> state running >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,906::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,911::task::872::TaskManager.Task::(_runJobs) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 12582912, 4, 2, 2, '7dd32175-f11e-4137-9148-5d783cc08e2f', '', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', '15078fcf-636b-4259-b3ea-7ca11f9d5d87') kwargs: {}) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,912::task::304::TaskManager.Task::(run) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 12582912, 4, 2, 2, '7dd32175-f11e-4137-9148-5d783cc08e2f', '', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', '15078fcf-636b-4259-b3ea-7ca11f9d5d87') kwargs: {}) callback None >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,912::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`483664ed-c2dd-4d50-a08d-f59c4d51b486`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,912::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' for lock type 'exclusive' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,913::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:13,913::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,134::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,144::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,155::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299868 s, 1.7 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,156::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299868 s, 1.7 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,157::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,166::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000300567 s, 1.7 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,167::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000300567 s, 1.7 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::INFO::2013-03-01 12:59:14,167::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec143490>] >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,168::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`10e36719-809f-4be7-871d-9b451b62f2eb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,168::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' for lock type 'exclusive' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,169::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free. Now locking as 'exclusive' (1 active user) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,169::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`10e36719-809f-4be7-871d-9b451b62f2eb`::Granted request >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,170::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free. Now locking as 'exclusive' (1 active user) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,170::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`483664ed-c2dd-4d50-a08d-f59c4d51b486`::Granted request >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,171::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,172::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,373::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,383::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::WARNING::2013-03-01 12:59:14,383::lvm::593::Storage.LVM::(getLv) lv: 7dd32175-f11e-4137-9148-5d783cc08e2f not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,396::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00371407 s, 138 kB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,397::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00371407 s, 138 kB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,398::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,407::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000312575 s, 1.6 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,408::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000312575 s, 1.6 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::INFO::2013-03-01 12:59:14,408::volume::457::Storage.Volume::(create) Creating volume 7dd32175-f11e-4137-9148-5d783cc08e2f >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,409::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,418::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:14,428::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 7dd32175-f11e-4137-9148-5d783cc08e2f a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-495::DEBUG::2013-03-01 12:59:14,460::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-495::DEBUG::2013-03-01 12:59:14,461::task::568::TaskManager.Task::(_updateState) Task=`39a08766-0074-4336-aea2-88f51c84b966`::moving from state init -> state preparing >Thread-495::INFO::2013-03-01 12:59:14,461::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-495::DEBUG::2013-03-01 12:59:14,461::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-495::DEBUG::2013-03-01 12:59:14,462::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ad0f352c-ea49-4c10-87f6-38166a43fa38 >Thread-495::DEBUG::2013-03-01 12:59:14,462::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'} >Thread-495::DEBUG::2013-03-01 12:59:14,462::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ad0f352c-ea49-4c10-87f6-38166a43fa38': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'}} >Thread-495::INFO::2013-03-01 12:59:14,463::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ad0f352c-ea49-4c10-87f6-38166a43fa38': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'}}} >Thread-495::DEBUG::2013-03-01 12:59:14,463::task::1151::TaskManager.Task::(prepare) Task=`39a08766-0074-4336-aea2-88f51c84b966`::finished: {'allTasksStatus': {'ad0f352c-ea49-4c10-87f6-38166a43fa38': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'}}} >Thread-495::DEBUG::2013-03-01 12:59:14,463::task::568::TaskManager.Task::(_updateState) Task=`39a08766-0074-4336-aea2-88f51c84b966`::moving from state preparing -> state finished >Thread-495::DEBUG::2013-03-01 12:59:14,463::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-495::DEBUG::2013-03-01 12:59:14,464::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-495::DEBUG::2013-03-01 12:59:14,464::task::957::TaskManager.Task::(_decref) Task=`39a08766-0074-4336-aea2-88f51c84b966`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:59:15,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:15,257::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000366021 s, 11.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:15,756::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:15,864::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441479 s, 23.2 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,068::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,069::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,070::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,070::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,070::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::INFO::2013-03-01 12:59:16,071::blockVolume::182::Storage.Volume::(_create) Request to create snapshot d89f5a12-6aa5-4fe7-83f7-f54f128098ec/7dd32175-f11e-4137-9148-5d783cc08e2f of volume d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,072::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,083::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000397318 s, 1.3 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,094::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000397318 s, 1.3 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,095::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,104::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000355711 s, 1.4 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,105::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000355711 s, 1.4 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::INFO::2013-03-01 12:59:16,106::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,106::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,116::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000301995 s, 1.7 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,117::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000301995 s, 1.7 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,117::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`f0de15b4-4ba6-4313-87c7-95994d837571`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,118::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' for lock type 'shared' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:16,119::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:17,343::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-105::DEBUG::2013-03-01 12:59:17,345::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,346::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:17,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:17,669::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,669::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-105::DEBUG::2013-03-01 12:59:17,671::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:17,681::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000390693 s, 5.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:17,682::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000390693 s, 5.2 MB/s'], size: 2048 >Thread-105::DEBUG::2013-03-01 12:59:17,682::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-105::WARNING::2013-03-01 12:59:17,683::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-105::DEBUG::2013-03-01 12:59:17,683::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-105::DEBUG::2013-03-01 12:59:17,684::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,685::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,685::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,686::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,687::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,731::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,732::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-105::DEBUG::2013-03-01 12:59:17,876::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:17,878::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,879::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,879::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Dummy-173::DEBUG::2013-03-01 12:59:17,881::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,890::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,896::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free. Now locking as 'shared' (1 active user) >Thread-105::WARNING::2013-03-01 12:59:17,897::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,899::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`f0de15b4-4ba6-4313-87c7-95994d837571`::Granted request >Thread-105::WARNING::2013-03-01 12:59:17,900::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-105::WARNING::2013-03-01 12:59:17,902::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,908::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:17,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:17,927::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:18,020::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0843757 s, 12.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:18,186::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:18,186::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:18,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000231293 s, 17.7 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,214::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,226::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,226::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/7dd32175-f11e-4137-9148-5d783cc08e2f >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,227::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,237::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311967 s, 1.6 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,237::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311967 s, 1.6 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,238::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,247::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000301935 s, 1.7 MB/s\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,248::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000301935 s, 1.7 MB/s'], size: 512 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,249::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/7dd32175-f11e-4137-9148-5d783cc08e2f' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,262::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::INFO::2013-03-01 12:59:18,262::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87 justme False >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,263::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,263::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' (0 active users) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,263::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free, finding out if anyone is waiting for it. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,264::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87' (cwd None) >Thread-497::DEBUG::2013-03-01 12:59:18,405::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-497::DEBUG::2013-03-01 12:59:18,406::task::568::TaskManager.Task::(_updateState) Task=`00493e47-a3d0-4172-8f0e-6de865df3047`::moving from state init -> state preparing >Thread-497::INFO::2013-03-01 12:59:18,407::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-497::INFO::2013-03-01 12:59:18,408::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-497::DEBUG::2013-03-01 12:59:18,409::task::1151::TaskManager.Task::(prepare) Task=`00493e47-a3d0-4172-8f0e-6de865df3047`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-497::DEBUG::2013-03-01 12:59:18,410::task::568::TaskManager.Task::(_updateState) Task=`00493e47-a3d0-4172-8f0e-6de865df3047`::moving from state preparing -> state finished >Thread-497::DEBUG::2013-03-01 12:59:18,410::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-497::DEBUG::2013-03-01 12:59:18,411::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-497::DEBUG::2013-03-01 12:59:18,412::task::957::TaskManager.Task::(_decref) Task=`00493e47-a3d0-4172-8f0e-6de865df3047`::ref 0 aborting False >Thread-498::DEBUG::2013-03-01 12:59:18,439::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-498::DEBUG::2013-03-01 12:59:18,439::task::568::TaskManager.Task::(_updateState) Task=`732bb7ca-78c9-4367-8843-dcb41c1d58aa`::moving from state init -> state preparing >Thread-498::INFO::2013-03-01 12:59:18,440::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-498::DEBUG::2013-03-01 12:59:18,441::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b537b90a-6697-406d-8465-b897f4226aa9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-498::DEBUG::2013-03-01 12:59:18,441::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-498::DEBUG::2013-03-01 12:59:18,442::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-498::DEBUG::2013-03-01 12:59:18,442::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b537b90a-6697-406d-8465-b897f4226aa9`::Granted request >Thread-498::DEBUG::2013-03-01 12:59:18,444::task::794::TaskManager.Task::(resourceAcquired) Task=`732bb7ca-78c9-4367-8843-dcb41c1d58aa`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-498::DEBUG::2013-03-01 12:59:18,444::task::957::TaskManager.Task::(_decref) Task=`732bb7ca-78c9-4367-8843-dcb41c1d58aa`::ref 1 aborting False >Thread-498::INFO::2013-03-01 12:59:18,446::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-498::DEBUG::2013-03-01 12:59:18,446::task::1151::TaskManager.Task::(prepare) Task=`732bb7ca-78c9-4367-8843-dcb41c1d58aa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-498::DEBUG::2013-03-01 12:59:18,446::task::568::TaskManager.Task::(_updateState) Task=`732bb7ca-78c9-4367-8843-dcb41c1d58aa`::moving from state preparing -> state finished >Thread-498::DEBUG::2013-03-01 12:59:18,447::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-498::DEBUG::2013-03-01 12:59:18,447::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-498::DEBUG::2013-03-01 12:59:18,447::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-498::DEBUG::2013-03-01 12:59:18,448::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-498::DEBUG::2013-03-01 12:59:18,448::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-498::DEBUG::2013-03-01 12:59:18,448::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-498::DEBUG::2013-03-01 12:59:18,449::task::957::TaskManager.Task::(_decref) Task=`732bb7ca-78c9-4367-8843-dcb41c1d58aa`::ref 0 aborting False >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,528::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,529::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,529::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,529::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87', Clearing records. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,529::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,530::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,759::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,772::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,772::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,966::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,976::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::WARNING::2013-03-01 12:59:18,976::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/7dd32175-f11e-4137-9148-5d783cc08e2f >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,976::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 8 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:18,977::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_d89f5a12-6aa5-4fe7-83f7-f54f128098ec --addtag MD_8 --addtag PU_15078fcf-636b-4259-b3ea-7ca11f9d5d87 a558fc2a-a4a3-4118-9b81-d1d601eaa295/7dd32175-f11e-4137-9148-5d783cc08e2f' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,177::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,178::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,179::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,180::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/7dd32175-f11e-4137-9148-5d783cc08e2f' (cwd None) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,399::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,400::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,400::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,401::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,413::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=7dd32175-f11e-4137-9148-5d783cc08e2f sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,420::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,428::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,428::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' (0 active users) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,429::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free, finding out if anyone is waiting for it. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,429::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,429::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' (0 active users) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,430::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free, finding out if anyone is waiting for it. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,430::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87', Clearing records. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,430::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec', Clearing records. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,431::task::568::TaskManager.Task::(_updateState) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::moving from state running -> state finished >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,431::task::719::TaskManager.Task::(_save) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ad0f352c-ea49-4c10-87f6-38166a43fa38.temp >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,440::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,440::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,441::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,441::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,441::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,442::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,442::task::880::TaskManager.Task::(_runJobs) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::Task.run: exit - success: result {'uuid': '7dd32175-f11e-4137-9148-5d783cc08e2f'} >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,442::task::957::TaskManager.Task::(_decref) Task=`ad0f352c-ea49-4c10-87f6-38166a43fa38`::ref 0 aborting False >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:19,443::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:59:20,034::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:20,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459922 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:22,165::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:22,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377124 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:24,288::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-501::DEBUG::2013-03-01 12:59:24,592::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-501::DEBUG::2013-03-01 12:59:24,612::task::568::TaskManager.Task::(_updateState) Task=`d3bddda2-5d6d-40d6-98d1-bda672877afa`::moving from state init -> state preparing >Thread-501::INFO::2013-03-01 12:59:24,620::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-501::DEBUG::2013-03-01 12:59:24,625::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-501::DEBUG::2013-03-01 12:59:24,629::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ad0f352c-ea49-4c10-87f6-38166a43fa38 >Thread-501::DEBUG::2013-03-01 12:59:24,634::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'} >Thread-501::DEBUG::2013-03-01 12:59:24,639::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ad0f352c-ea49-4c10-87f6-38166a43fa38': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'}} >Thread-501::INFO::2013-03-01 12:59:24,644::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ad0f352c-ea49-4c10-87f6-38166a43fa38': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'}}} >Thread-501::DEBUG::2013-03-01 12:59:24,648::task::1151::TaskManager.Task::(prepare) Task=`d3bddda2-5d6d-40d6-98d1-bda672877afa`::finished: {'allTasksStatus': {'ad0f352c-ea49-4c10-87f6-38166a43fa38': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad0f352c-ea49-4c10-87f6-38166a43fa38'}}} >Thread-501::DEBUG::2013-03-01 12:59:24,653::task::568::TaskManager.Task::(_updateState) Task=`d3bddda2-5d6d-40d6-98d1-bda672877afa`::moving from state preparing -> state finished >Thread-501::DEBUG::2013-03-01 12:59:24,657::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-501::DEBUG::2013-03-01 12:59:24,661::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-501::DEBUG::2013-03-01 12:59:24,665::task::957::TaskManager.Task::(_decref) Task=`d3bddda2-5d6d-40d6-98d1-bda672877afa`::ref 0 aborting False >Thread-502::DEBUG::2013-03-01 12:59:24,805::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-502::DEBUG::2013-03-01 12:59:24,814::task::568::TaskManager.Task::(_updateState) Task=`947baddf-2e7e-4b11-9e4e-1bea2cb17ce1`::moving from state init -> state preparing >Thread-502::INFO::2013-03-01 12:59:24,819::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', volUUID='7dd32175-f11e-4137-9148-5d783cc08e2f', options=None) >Thread-502::DEBUG::2013-03-01 12:59:24,829::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`859f96c1-d4c1-4a63-ba12-912bc16f12ab`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-502::DEBUG::2013-03-01 12:59:24,833::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-502::DEBUG::2013-03-01 12:59:24,841::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-502::DEBUG::2013-03-01 12:59:24,845::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`859f96c1-d4c1-4a63-ba12-912bc16f12ab`::Granted request >Thread-502::DEBUG::2013-03-01 12:59:24,855::task::794::TaskManager.Task::(resourceAcquired) Task=`947baddf-2e7e-4b11-9e4e-1bea2cb17ce1`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-502::DEBUG::2013-03-01 12:59:24,859::task::957::TaskManager.Task::(_decref) Task=`947baddf-2e7e-4b11-9e4e-1bea2cb17ce1`::ref 1 aborting False >Thread-502::DEBUG::2013-03-01 12:59:24,870::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-502::DEBUG::2013-03-01 12:59:24,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:25,285::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:25,651::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00518236 s, 790 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:25,690::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.757591 s, 1.4 MB/s\n'; <rc> = 0 >Thread-502::DEBUG::2013-03-01 12:59:25,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-502::DEBUG::2013-03-01 12:59:25,802::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-502::INFO::2013-03-01 12:59:25,802::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec volUUID = 7dd32175-f11e-4137-9148-5d783cc08e2f >Thread-502::DEBUG::2013-03-01 12:59:25,803::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-502::DEBUG::2013-03-01 12:59:25,813::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000302716 s, 1.7 MB/s\n'; <rc> = 0 >Thread-502::DEBUG::2013-03-01 12:59:25,813::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000302716 s, 1.7 MB/s'], size: 512 >Thread-502::DEBUG::2013-03-01 12:59:25,814::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-502::DEBUG::2013-03-01 12:59:25,824::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319905 s, 1.6 MB/s\n'; <rc> = 0 >Thread-502::DEBUG::2013-03-01 12:59:25,825::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319905 s, 1.6 MB/s'], size: 512 >Thread-502::DEBUG::2013-03-01 12:59:25,825::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-502::DEBUG::2013-03-01 12:59:25,826::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-502::DEBUG::2013-03-01 12:59:26,023::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-502::DEBUG::2013-03-01 12:59:26,034::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-502::INFO::2013-03-01 12:59:26,035::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/7dd32175-f11e-4137-9148-5d783cc08e2f info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135559', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135559', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '7dd32175-f11e-4137-9148-5d783cc08e2f', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-502::INFO::2013-03-01 12:59:26,035::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135559', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135559', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '7dd32175-f11e-4137-9148-5d783cc08e2f', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-502::DEBUG::2013-03-01 12:59:26,035::task::1151::TaskManager.Task::(prepare) Task=`947baddf-2e7e-4b11-9e4e-1bea2cb17ce1`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '15078fcf-636b-4259-b3ea-7ca11f9d5d87', 'format': 'COW', 'image': 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', 'ctime': '1362135559', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135559', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '7dd32175-f11e-4137-9148-5d783cc08e2f', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-502::DEBUG::2013-03-01 12:59:26,036::task::568::TaskManager.Task::(_updateState) Task=`947baddf-2e7e-4b11-9e4e-1bea2cb17ce1`::moving from state preparing -> state finished >Thread-502::DEBUG::2013-03-01 12:59:26,036::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-502::DEBUG::2013-03-01 12:59:26,036::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-502::DEBUG::2013-03-01 12:59:26,037::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-502::DEBUG::2013-03-01 12:59:26,037::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-502::DEBUG::2013-03-01 12:59:26,038::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-502::DEBUG::2013-03-01 12:59:26,038::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-502::DEBUG::2013-03-01 12:59:26,038::task::957::TaskManager.Task::(_decref) Task=`947baddf-2e7e-4b11-9e4e-1bea2cb17ce1`::ref 0 aborting False >Thread-504::DEBUG::2013-03-01 12:59:26,091::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-504::DEBUG::2013-03-01 12:59:26,091::task::568::TaskManager.Task::(_updateState) Task=`88479053-718e-40db-b4b1-d6fdef266115`::moving from state init -> state preparing >Thread-504::INFO::2013-03-01 12:59:26,092::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='ad0f352c-ea49-4c10-87f6-38166a43fa38', spUUID=None, options=None) >Thread-504::DEBUG::2013-03-01 12:59:26,092::taskManager::161::TaskManager::(clearTask) Entry. taskID: ad0f352c-ea49-4c10-87f6-38166a43fa38 >Thread-504::DEBUG::2013-03-01 12:59:26,093::taskManager::166::TaskManager::(clearTask) Return. >Thread-504::INFO::2013-03-01 12:59:26,093::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-504::DEBUG::2013-03-01 12:59:26,094::task::1151::TaskManager.Task::(prepare) Task=`88479053-718e-40db-b4b1-d6fdef266115`::finished: None >Thread-504::DEBUG::2013-03-01 12:59:26,094::task::568::TaskManager.Task::(_updateState) Task=`88479053-718e-40db-b4b1-d6fdef266115`::moving from state preparing -> state finished >Thread-504::DEBUG::2013-03-01 12:59:26,094::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-504::DEBUG::2013-03-01 12:59:26,095::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-504::DEBUG::2013-03-01 12:59:26,095::task::957::TaskManager.Task::(_decref) Task=`88479053-718e-40db-b4b1-d6fdef266115`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:59:27,706::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:28,213::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-505::DEBUG::2013-03-01 12:59:28,718::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-505::DEBUG::2013-03-01 12:59:28,766::task::568::TaskManager.Task::(_updateState) Task=`edb455aa-259d-4dc7-95f2-a2d81ad82f00`::moving from state init -> state preparing >Thread-505::INFO::2013-03-01 12:59:28,795::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-105::DEBUG::2013-03-01 12:59:28,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00481745 s, 850 kB/s\n'; <rc> = 0 >Thread-505::INFO::2013-03-01 12:59:28,853::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-505::DEBUG::2013-03-01 12:59:28,857::task::1151::TaskManager.Task::(prepare) Task=`edb455aa-259d-4dc7-95f2-a2d81ad82f00`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-505::DEBUG::2013-03-01 12:59:28,860::task::568::TaskManager.Task::(_updateState) Task=`edb455aa-259d-4dc7-95f2-a2d81ad82f00`::moving from state preparing -> state finished >Thread-505::DEBUG::2013-03-01 12:59:28,862::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-505::DEBUG::2013-03-01 12:59:28,865::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-505::DEBUG::2013-03-01 12:59:28,868::task::957::TaskManager.Task::(_decref) Task=`edb455aa-259d-4dc7-95f2-a2d81ad82f00`::ref 0 aborting False >Thread-506::DEBUG::2013-03-01 12:59:28,905::task::568::TaskManager.Task::(_updateState) Task=`a30e0e6b-ba35-436e-b44e-93fa38fbf4cf`::moving from state init -> state preparing >Thread-507::DEBUG::2013-03-01 12:59:28,908::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-506::INFO::2013-03-01 12:59:28,908::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-507::DEBUG::2013-03-01 12:59:28,911::task::568::TaskManager.Task::(_updateState) Task=`a76111de-fb75-48e3-ae73-b8c791185ca7`::moving from state init -> state preparing >Thread-506::INFO::2013-03-01 12:59:28,913::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.380808115005', 'lastCheck': '3.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.631754159927', 'lastCheck': '0.0', 'code': 0, 'valid': True}} >Thread-507::INFO::2013-03-01 12:59:28,914::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-506::DEBUG::2013-03-01 12:59:28,916::task::1151::TaskManager.Task::(prepare) Task=`a30e0e6b-ba35-436e-b44e-93fa38fbf4cf`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.380808115005', 'lastCheck': '3.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.631754159927', 'lastCheck': '0.0', 'code': 0, 'valid': True}} >Thread-506::DEBUG::2013-03-01 12:59:28,918::task::568::TaskManager.Task::(_updateState) Task=`a30e0e6b-ba35-436e-b44e-93fa38fbf4cf`::moving from state preparing -> state finished >Thread-507::DEBUG::2013-03-01 12:59:28,920::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3acab1c9-79a9-4554-9424-400571184424`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-506::DEBUG::2013-03-01 12:59:28,921::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-507::DEBUG::2013-03-01 12:59:28,922::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-506::DEBUG::2013-03-01 12:59:28,923::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-506::DEBUG::2013-03-01 12:59:28,926::task::957::TaskManager.Task::(_decref) Task=`a30e0e6b-ba35-436e-b44e-93fa38fbf4cf`::ref 0 aborting False >Thread-507::DEBUG::2013-03-01 12:59:28,926::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-507::DEBUG::2013-03-01 12:59:28,929::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3acab1c9-79a9-4554-9424-400571184424`::Granted request >Thread-507::DEBUG::2013-03-01 12:59:28,935::task::794::TaskManager.Task::(resourceAcquired) Task=`a76111de-fb75-48e3-ae73-b8c791185ca7`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-507::DEBUG::2013-03-01 12:59:28,937::task::957::TaskManager.Task::(_decref) Task=`a76111de-fb75-48e3-ae73-b8c791185ca7`::ref 1 aborting False >Thread-507::INFO::2013-03-01 12:59:28,951::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-507::DEBUG::2013-03-01 12:59:28,953::task::1151::TaskManager.Task::(prepare) Task=`a76111de-fb75-48e3-ae73-b8c791185ca7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-507::DEBUG::2013-03-01 12:59:28,956::task::568::TaskManager.Task::(_updateState) Task=`a76111de-fb75-48e3-ae73-b8c791185ca7`::moving from state preparing -> state finished >Thread-507::DEBUG::2013-03-01 12:59:28,958::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-507::DEBUG::2013-03-01 12:59:28,960::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-507::DEBUG::2013-03-01 12:59:28,963::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-507::DEBUG::2013-03-01 12:59:28,967::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-507::DEBUG::2013-03-01 12:59:28,968::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-507::DEBUG::2013-03-01 12:59:28,970::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-507::DEBUG::2013-03-01 12:59:28,971::task::957::TaskManager.Task::(_decref) Task=`a76111de-fb75-48e3-ae73-b8c791185ca7`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:59:29,021::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.03196 s, 992 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:31,036::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:31,139::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385406 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:33,159::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:33,265::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412289 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:35,281::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:35,373::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461402 s, 22.2 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 12:59:35,654::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:35,664::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000438768 s, 9.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:37,387::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:37,494::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411403 s, 24.9 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:38,889::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:38,901::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000524208 s, 7.8 MB/s\n'; <rc> = 0 >Thread-512::DEBUG::2013-03-01 12:59:39,032::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-512::DEBUG::2013-03-01 12:59:39,033::task::568::TaskManager.Task::(_updateState) Task=`8132832a-cf1a-4c5c-8a67-d1b47512b834`::moving from state init -> state preparing >Thread-512::INFO::2013-03-01 12:59:39,033::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-512::INFO::2013-03-01 12:59:39,033::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-512::DEBUG::2013-03-01 12:59:39,034::task::1151::TaskManager.Task::(prepare) Task=`8132832a-cf1a-4c5c-8a67-d1b47512b834`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-512::DEBUG::2013-03-01 12:59:39,034::task::568::TaskManager.Task::(_updateState) Task=`8132832a-cf1a-4c5c-8a67-d1b47512b834`::moving from state preparing -> state finished >Thread-512::DEBUG::2013-03-01 12:59:39,034::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-512::DEBUG::2013-03-01 12:59:39,035::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-512::DEBUG::2013-03-01 12:59:39,035::task::957::TaskManager.Task::(_decref) Task=`8132832a-cf1a-4c5c-8a67-d1b47512b834`::ref 0 aborting False >Thread-513::DEBUG::2013-03-01 12:59:39,060::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-513::DEBUG::2013-03-01 12:59:39,061::task::568::TaskManager.Task::(_updateState) Task=`0d9183a3-f6f8-4808-9388-be0b12fb8fd0`::moving from state init -> state preparing >Thread-513::INFO::2013-03-01 12:59:39,061::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-513::DEBUG::2013-03-01 12:59:39,062::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1605e020-74fa-45c9-904a-40f2cc54c7eb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-513::DEBUG::2013-03-01 12:59:39,062::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-513::DEBUG::2013-03-01 12:59:39,063::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-513::DEBUG::2013-03-01 12:59:39,063::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1605e020-74fa-45c9-904a-40f2cc54c7eb`::Granted request >Thread-513::DEBUG::2013-03-01 12:59:39,063::task::794::TaskManager.Task::(resourceAcquired) Task=`0d9183a3-f6f8-4808-9388-be0b12fb8fd0`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-513::DEBUG::2013-03-01 12:59:39,064::task::957::TaskManager.Task::(_decref) Task=`0d9183a3-f6f8-4808-9388-be0b12fb8fd0`::ref 1 aborting False >Thread-513::INFO::2013-03-01 12:59:39,065::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-513::DEBUG::2013-03-01 12:59:39,066::task::1151::TaskManager.Task::(prepare) Task=`0d9183a3-f6f8-4808-9388-be0b12fb8fd0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-513::DEBUG::2013-03-01 12:59:39,066::task::568::TaskManager.Task::(_updateState) Task=`0d9183a3-f6f8-4808-9388-be0b12fb8fd0`::moving from state preparing -> state finished >Thread-513::DEBUG::2013-03-01 12:59:39,066::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-513::DEBUG::2013-03-01 12:59:39,067::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-513::DEBUG::2013-03-01 12:59:39,067::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-513::DEBUG::2013-03-01 12:59:39,067::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-513::DEBUG::2013-03-01 12:59:39,068::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-513::DEBUG::2013-03-01 12:59:39,068::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-513::DEBUG::2013-03-01 12:59:39,068::task::957::TaskManager.Task::(_decref) Task=`0d9183a3-f6f8-4808-9388-be0b12fb8fd0`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:59:39,514::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:39,630::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499838 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:41,650::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:41,767::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600005 s, 17.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:43,779::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:43,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359711 s, 28.5 MB/s\n'; <rc> = 0 >Thread-515::DEBUG::2013-03-01 12:59:44,202::task::568::TaskManager.Task::(_updateState) Task=`5cb0f698-750e-4edc-8acc-698b883f8287`::moving from state init -> state preparing >Thread-515::INFO::2013-03-01 12:59:44,228::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-515::INFO::2013-03-01 12:59:44,229::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106399059296', 'lastCheck': '8.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129199028015', 'lastCheck': '5.3', 'code': 0, 'valid': True}} >Thread-515::DEBUG::2013-03-01 12:59:44,229::task::1151::TaskManager.Task::(prepare) Task=`5cb0f698-750e-4edc-8acc-698b883f8287`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106399059296', 'lastCheck': '8.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129199028015', 'lastCheck': '5.3', 'code': 0, 'valid': True}} >Thread-515::DEBUG::2013-03-01 12:59:44,229::task::568::TaskManager.Task::(_updateState) Task=`5cb0f698-750e-4edc-8acc-698b883f8287`::moving from state preparing -> state finished >Thread-515::DEBUG::2013-03-01 12:59:44,230::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-515::DEBUG::2013-03-01 12:59:44,230::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-515::DEBUG::2013-03-01 12:59:44,230::task::957::TaskManager.Task::(_decref) Task=`5cb0f698-750e-4edc-8acc-698b883f8287`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:59:45,666::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:45,676::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000306405 s, 13.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 12:59:45,899::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:46,012::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048356 s, 21.2 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:46,837::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-517::DEBUG::2013-03-01 12:59:46,838::task::568::TaskManager.Task::(_updateState) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::moving from state init -> state preparing >Thread-517::INFO::2013-03-01 12:59:46,839::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', srcVolUUID='15078fcf-636b-4259-b3ea-7ca11f9d5d87', dstImgUUID='2545ace8-7886-4a93-a63a-5dbd581c3d81', dstVolUUID='95b38c37-bb99-4dc4-b3ae-559b1a54a26a', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-517::INFO::2013-03-01 12:59:46,839::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-517::DEBUG::2013-03-01 12:59:46,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,084::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,085::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,085::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,086::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,086::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,086::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,422::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,425::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,425::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-517::DEBUG::2013-03-01 12:59:47,426::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,675::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,687::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-517::INFO::2013-03-01 12:59:47,687::image::458::Storage.Image::(isLegal) image d89f5a12-6aa5-4fe7-83f7-f54f128098ec in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['15078fcf-636b-4259-b3ea-7ca11f9d5d87', '7dd32175-f11e-4137-9148-5d783cc08e2f'] >Thread-517::DEBUG::2013-03-01 12:59:47,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,698::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000366907 s, 1.4 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,698::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000366907 s, 1.4 MB/s'], size: 512 >Thread-517::DEBUG::2013-03-01 12:59:47,699::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,721::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000332617 s, 1.5 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,722::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000332617 s, 1.5 MB/s'], size: 512 >Thread-517::DEBUG::2013-03-01 12:59:47,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,733::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000367973 s, 1.4 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,733::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000367973 s, 1.4 MB/s'], size: 512 >Thread-517::DEBUG::2013-03-01 12:59:47,734::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000367256 s, 1.4 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,744::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000367256 s, 1.4 MB/s'], size: 512 >Thread-517::DEBUG::2013-03-01 12:59:47,745::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,746::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,951::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,965::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-517::DEBUG::2013-03-01 12:59:47,965::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,975::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000329874 s, 1.6 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,976::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000329874 s, 1.6 MB/s'], size: 512 >Thread-517::DEBUG::2013-03-01 12:59:47,977::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,986::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000336452 s, 1.5 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,987::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000336452 s, 1.5 MB/s'], size: 512 >Thread-517::DEBUG::2013-03-01 12:59:47,988::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-517::DEBUG::2013-03-01 12:59:47,997::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000330157 s, 1.6 MB/s\n'; <rc> = 0 >Thread-517::DEBUG::2013-03-01 12:59:47,998::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000330157 s, 1.6 MB/s'], size: 512 >Thread-517::INFO::2013-03-01 12:59:47,998::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec chain=[<storage.blockVolume.BlockVolume object at 0x7f15e00c0f50>, <storage.blockVolume.BlockVolume object at 0x7f15ec11dc50>] >Thread-517::DEBUG::2013-03-01 12:59:47,999::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1cc160b4-f910-4489-8f34-319e76235ef4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-517::DEBUG::2013-03-01 12:59:48,000::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-517::DEBUG::2013-03-01 12:59:48,000::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-517::DEBUG::2013-03-01 12:59:48,000::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1cc160b4-f910-4489-8f34-319e76235ef4`::Granted request >Thread-517::DEBUG::2013-03-01 12:59:48,001::task::794::TaskManager.Task::(resourceAcquired) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-517::DEBUG::2013-03-01 12:59:48,001::task::957::TaskManager.Task::(_decref) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::ref 1 aborting False >Thread-517::DEBUG::2013-03-01 12:59:48,003::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >Thread-517::DEBUG::2013-03-01 12:59:48,010::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_2545ace8-7886-4a93-a63a-5dbd581c3d81 for task 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >Thread-517::INFO::2013-03-01 12:59:48,010::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-517::DEBUG::2013-03-01 12:59:48,010::task::1146::TaskManager.Task::(prepare) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::Prepare: 1 jobs exist, move to acquiring >Thread-517::DEBUG::2013-03-01 12:59:48,011::task::568::TaskManager.Task::(_updateState) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::moving from state preparing -> state acquiring >Thread-517::DEBUG::2013-03-01 12:59:48,011::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >Thread-517::DEBUG::2013-03-01 12:59:48,019::task::568::TaskManager.Task::(_updateState) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::moving from state acquiring -> state queued >Thread-517::DEBUG::2013-03-01 12:59:48,019::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >Thread-517::DEBUG::2013-03-01 12:59:48,026::taskManager::50::TaskManager::(_queueTask) queuing task: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >ad0f352c-ea49-4c10-87f6-38166a43fa38::DEBUG::2013-03-01 12:59:48,027::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-517::DEBUG::2013-03-01 12:59:48,027::taskManager::56::TaskManager::(_queueTask) task queued: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,029::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 running: <bound method Task.commit of <storage.task.Task instance at 0x17ba710>> with: None >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,030::task::1159::TaskManager.Task::(commit) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::committing task: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >Thread-517::DEBUG::2013-03-01 12:59:48,030::task::1148::TaskManager.Task::(prepare) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::returning >Dummy-173::DEBUG::2013-03-01 12:59:48,032::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,033::task::568::TaskManager.Task::(_updateState) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::moving from state queued -> state running >Thread-517::DEBUG::2013-03-01 12:59:48,045::task::957::TaskManager.Task::(_decref) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::ref 1 aborting False >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,046::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,069::task::872::TaskManager.Task::(_runJobs) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::Task.run: running job 0: copyImage_2545ace8-7886-4a93-a63a-5dbd581c3d81: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', '15078fcf-636b-4259-b3ea-7ca11f9d5d87', '2545ace8-7886-4a93-a63a-5dbd581c3d81', '95b38c37-bb99-4dc4-b3ae-559b1a54a26a', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,071::task::304::TaskManager.Task::(run) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::Job.run: running copyImage_2545ace8-7886-4a93-a63a-5dbd581c3d81: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'd89f5a12-6aa5-4fe7-83f7-f54f128098ec', '15078fcf-636b-4259-b3ea-7ca11f9d5d87', '2545ace8-7886-4a93-a63a-5dbd581c3d81', '95b38c37-bb99-4dc4-b3ae-559b1a54a26a', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,073::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`699f2c1c-88b6-4529-a36a-5b8a4cd2def7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,074::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' for lock type 'shared' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,078::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,083::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:48,154::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0748732 s, 13.7 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,267::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,276::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,276::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,285::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000293623 s, 1.7 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,285::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000293623 s, 1.7 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,286::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,293::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000284488 s, 1.8 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,294::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000284488 s, 1.8 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,295::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,302::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000287842 s, 1.8 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,303::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000287842 s, 1.8 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:48,303::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec chain=[<storage.blockVolume.BlockVolume object at 0x7f15e00def10>, <storage.blockVolume.BlockVolume object at 0x7f15e00c0e10>] >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,304::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`fe97adff-96f2-421f-a03b-de255e708750`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,304::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' for lock type 'shared' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,304::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free. Now locking as 'shared' (1 active user) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,304::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`fe97adff-96f2-421f-a03b-de255e708750`::Granted request >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,305::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f`ReqID=`ebb6d637-eda9-4383-a6a7-f19c8bf92896`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,305::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f' for lock type 'shared' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,305::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f' is free. Now locking as 'shared' (1 active user) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,305::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f`ReqID=`ebb6d637-eda9-4383-a6a7-f19c8bf92896`::Granted request >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,306::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free. Now locking as 'shared' (1 active user) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,306::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`699f2c1c-88b6-4529-a36a-5b8a4cd2def7`::Granted request >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,307::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81`ReqID=`5e822c6d-dc45-4384-9368-e66738899b98`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,307::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81' for lock type 'exclusive' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,307::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,308::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,550::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,561::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,561::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 2545ace8-7886-4a93-a63a-5dbd581c3d81 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,561::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81' is free. Now locking as 'exclusive' (1 active user) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,562::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81`ReqID=`5e822c6d-dc45-4384-9368-e66738899b98`::Granted request >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:48,562::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=d89f5a12-6aa5-4fe7-83f7-f54f128098ec srcVolUUID=15078fcf-636b-4259-b3ea-7ca11f9d5d87 dstImgUUID=2545ace8-7886-4a93-a63a-5dbd581c3d81 dstVolUUID=95b38c37-bb99-4dc4-b3ae-559b1a54a26a dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,571::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000276629 s, 1.9 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,571::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000276629 s, 1.9 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,572::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316157 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,582::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316157 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00034914 s, 1.5 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,592::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00034914 s, 1.5 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,593::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,602::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000310733 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,603::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000310733 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,604::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,613::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031048 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,614::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031048 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,615::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,624::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000328231 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,625::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000328231 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:48,625::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:d89f5a12-6aa5-4fe7-83f7-f54f128098ec:15078fcf-636b-4259-b3ea-7ca11f9d5d87 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:2545ace8-7886-4a93-a63a-5dbd581c3d81:95b38c37-bb99-4dc4-b3ae-559b1a54a26a apparentsize 2097152 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,626::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,841::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,852::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:48,852::image::458::Storage.Image::(isLegal) image 2545ace8-7886-4a93-a63a-5dbd581c3d81 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:48,852::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81 for image's volumes >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,853::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,862::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:48,863::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:48,908::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 12:59:48,918::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000350582 s, 11.7 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:49,108::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-519::DEBUG::2013-03-01 12:59:49,119::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-519::DEBUG::2013-03-01 12:59:49,124::task::568::TaskManager.Task::(_updateState) Task=`98977b68-4c82-4f4c-8cb8-13321d8edbcf`::moving from state init -> state preparing >Thread-519::INFO::2013-03-01 12:59:49,128::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:49,130::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-519::INFO::2013-03-01 12:59:49,131::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >8fcf3a12-a991-4a10-81a2-8f1746cfb708::WARNING::2013-03-01 12:59:49,131::lvm::593::Storage.LVM::(getLv) lv: 95b38c37-bb99-4dc4-b3ae-559b1a54a26a not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >Thread-519::DEBUG::2013-03-01 12:59:49,132::task::1151::TaskManager.Task::(prepare) Task=`98977b68-4c82-4f4c-8cb8-13321d8edbcf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:49,133::volume::457::Storage.Volume::(create) Creating volume 95b38c37-bb99-4dc4-b3ae-559b1a54a26a >Thread-519::DEBUG::2013-03-01 12:59:49,133::task::568::TaskManager.Task::(_updateState) Task=`98977b68-4c82-4f4c-8cb8-13321d8edbcf`::moving from state preparing -> state finished >Thread-519::DEBUG::2013-03-01 12:59:49,135::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-519::DEBUG::2013-03-01 12:59:49,136::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:49,136::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >Thread-519::DEBUG::2013-03-01 12:59:49,137::task::957::TaskManager.Task::(_decref) Task=`98977b68-4c82-4f4c-8cb8-13321d8edbcf`::ref 0 aborting False >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:49,150::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:49,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 95b38c37-bb99-4dc4-b3ae-559b1a54a26a a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-520::DEBUG::2013-03-01 12:59:49,172::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-520::DEBUG::2013-03-01 12:59:49,172::task::568::TaskManager.Task::(_updateState) Task=`4552a386-9e6c-45a3-b254-e8a504ebb10b`::moving from state init -> state preparing >Thread-520::INFO::2013-03-01 12:59:49,173::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-520::DEBUG::2013-03-01 12:59:49,174::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`30667812-62e5-4a05-bce9-fed461794b65`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-520::DEBUG::2013-03-01 12:59:49,174::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-520::DEBUG::2013-03-01 12:59:49,174::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-520::DEBUG::2013-03-01 12:59:49,175::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`30667812-62e5-4a05-bce9-fed461794b65`::Granted request >Thread-520::DEBUG::2013-03-01 12:59:49,175::task::794::TaskManager.Task::(resourceAcquired) Task=`4552a386-9e6c-45a3-b254-e8a504ebb10b`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-520::DEBUG::2013-03-01 12:59:49,175::task::957::TaskManager.Task::(_decref) Task=`4552a386-9e6c-45a3-b254-e8a504ebb10b`::ref 1 aborting False >Thread-520::INFO::2013-03-01 12:59:49,177::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-520::DEBUG::2013-03-01 12:59:49,178::task::1151::TaskManager.Task::(prepare) Task=`4552a386-9e6c-45a3-b254-e8a504ebb10b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-520::DEBUG::2013-03-01 12:59:49,178::task::568::TaskManager.Task::(_updateState) Task=`4552a386-9e6c-45a3-b254-e8a504ebb10b`::moving from state preparing -> state finished >Thread-520::DEBUG::2013-03-01 12:59:49,178::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-520::DEBUG::2013-03-01 12:59:49,178::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-520::DEBUG::2013-03-01 12:59:49,179::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-520::DEBUG::2013-03-01 12:59:49,179::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-520::DEBUG::2013-03-01 12:59:49,179::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-520::DEBUG::2013-03-01 12:59:49,180::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-520::DEBUG::2013-03-01 12:59:49,180::task::957::TaskManager.Task::(_decref) Task=`4552a386-9e6c-45a3-b254-e8a504ebb10b`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 12:59:50,167::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:50,268::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474581 s, 21.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,840::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,841::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,841::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,841::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,842::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:50,842::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a with size = 20480 sectors >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,843::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a 10240K' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,854::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,855::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:50,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,102::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,117::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::WARNING::2013-03-01 12:59:51,118::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,118::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 9 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,119::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_2545ace8-7886-4a93-a63a-5dbd581c3d81 --addtag MD_9 a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,378::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,379::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,379::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,380::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,643::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,644::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,644::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,646::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,658::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=95b38c37-bb99-4dc4-b3ae-559b1a54a26a sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 9) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,664::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,674::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,938::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:51,938::blockVolume::280::Storage.Volume::(extend) Request to extend LV 95b38c37-bb99-4dc4-b3ae-559b1a54a26a of image 2545ace8-7886-4a93-a63a-5dbd581c3d81 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:51,939::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,181::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,184::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,185::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299015 s, 1.7 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,196::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299015 s, 1.7 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:52,197::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,207::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000333117 s, 1.5 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,208::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000333117 s, 1.5 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,209::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`a7578472-9ff4-40fd-8100-9abd4a2ec8d7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,209::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' for lock type 'shared' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:52,210::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:52,282::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:52,395::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470269 s, 21.8 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,908::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,909::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,909::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,910::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free. Now locking as 'shared' (1 active user) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,910::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87`ReqID=`a7578472-9ff4-40fd-8100-9abd4a2ec8d7`::Granted request >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,911::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:53,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,159::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,174::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:54,175::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,175::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,185::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000321845 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,186::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000321845 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,186::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,196::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000322122 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,197::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000322122 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,198::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a`ReqID=`b1734c29-207f-4520-b73f-940a5526408c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,198::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a' for lock type 'exclusive' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:54,199::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:54,414::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:54,520::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478842 s, 21.4 MB/s\n'; <rc> = 0 >Thread-523::DEBUG::2013-03-01 12:59:54,723::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-523::DEBUG::2013-03-01 12:59:54,724::task::568::TaskManager.Task::(_updateState) Task=`f9811694-2b4b-42b6-b4fa-a620e136eae4`::moving from state init -> state preparing >Thread-523::INFO::2013-03-01 12:59:54,725::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-523::DEBUG::2013-03-01 12:59:54,725::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-523::DEBUG::2013-03-01 12:59:54,725::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >Thread-523::DEBUG::2013-03-01 12:59:54,725::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'} >Thread-523::DEBUG::2013-03-01 12:59:54,726::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'8fcf3a12-a991-4a10-81a2-8f1746cfb708': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'}} >Thread-523::INFO::2013-03-01 12:59:54,726::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'8fcf3a12-a991-4a10-81a2-8f1746cfb708': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'}}} >Thread-523::DEBUG::2013-03-01 12:59:54,726::task::1151::TaskManager.Task::(prepare) Task=`f9811694-2b4b-42b6-b4fa-a620e136eae4`::finished: {'allTasksStatus': {'8fcf3a12-a991-4a10-81a2-8f1746cfb708': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'}}} >Thread-523::DEBUG::2013-03-01 12:59:54,726::task::568::TaskManager.Task::(_updateState) Task=`f9811694-2b4b-42b6-b4fa-a620e136eae4`::moving from state preparing -> state finished >Thread-523::DEBUG::2013-03-01 12:59:54,727::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-523::DEBUG::2013-03-01 12:59:54,727::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-523::DEBUG::2013-03-01 12:59:54,727::task::957::TaskManager.Task::(_decref) Task=`f9811694-2b4b-42b6-b4fa-a620e136eae4`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 12:59:55,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 12:59:55,688::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000322938 s, 12.7 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,857::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,859::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,859::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,859::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a' is free. Now locking as 'exclusive' (1 active user) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,860::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a`ReqID=`b1734c29-207f-4520-b73f-940a5526408c`::Granted request >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,861::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:55,862::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,083::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,083::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297226 s, 1.7 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,094::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297226 s, 1.7 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,096::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,105::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000322355 s, 1.6 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,106::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000322355 s, 1.6 MB/s'], size: 512 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,106::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a (qcow2) START >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,107::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:56,116::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >Dummy-173::DEBUG::2013-03-01 12:59:56,534::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:56,613::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331465 s, 30.9 MB/s\n'; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,715::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,715::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/15078fcf-636b-4259-b3ea-7ca11f9d5d87 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a DONE >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:57,740::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:15078fcf-636b-4259-b3ea-7ca11f9d5d87 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:95b38c37-bb99-4dc4-b3ae-559b1a54a26a >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:57,741::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87 justme False >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,742::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,744::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,746::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,747::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,973::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,973::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,974::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,974::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,975::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:57,976::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,223::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,234::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::INFO::2013-03-01 12:59:58,235::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a justme False >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,235::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,235::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,236::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,237::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,442::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,443::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,443::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,443::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.95b38c37-bb99-4dc4-b3ae-559b1a54a26a', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,444::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,444::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 12:59:58,627::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,694::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,728::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,731::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,732::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,733::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,734::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2545ace8-7886-4a93-a63a-5dbd581c3d81', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,737::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,739::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,740::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,742::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,744::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,745::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,746::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.15078fcf-636b-4259-b3ea-7ca11f9d5d87', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,749::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,751::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,752::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,753::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.7dd32175-f11e-4137-9148-5d783cc08e2f', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,755::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.d89f5a12-6aa5-4fe7-83f7-f54f128098ec', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,757::task::568::TaskManager.Task::(_updateState) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::moving from state running -> state finished >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,761::task::719::TaskManager.Task::(_save) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/8fcf3a12-a991-4a10-81a2-8f1746cfb708.temp >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,798::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,799::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,800::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,803::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,804::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,805::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,808::task::880::TaskManager.Task::(_runJobs) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::Task.run: exit - success: result {'uuid': '95b38c37-bb99-4dc4-b3ae-559b1a54a26a'} >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,809::task::957::TaskManager.Task::(_decref) Task=`8fcf3a12-a991-4a10-81a2-8f1746cfb708`::ref 0 aborting False >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 12:59:58,811::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 12:59:58,837::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423188 s, 24.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 12:59:58,924::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 12:59:58,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-525::DEBUG::2013-03-01 12:59:59,312::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-525::DEBUG::2013-03-01 12:59:59,327::task::568::TaskManager.Task::(_updateState) Task=`1fa42227-b119-438b-aeda-9f9f9745c51f`::moving from state init -> state preparing >Thread-525::INFO::2013-03-01 12:59:59,333::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-525::INFO::2013-03-01 12:59:59,340::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-525::DEBUG::2013-03-01 12:59:59,342::task::1151::TaskManager.Task::(prepare) Task=`1fa42227-b119-438b-aeda-9f9f9745c51f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-525::DEBUG::2013-03-01 12:59:59,346::task::568::TaskManager.Task::(_updateState) Task=`1fa42227-b119-438b-aeda-9f9f9745c51f`::moving from state preparing -> state finished >Thread-525::DEBUG::2013-03-01 12:59:59,349::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-525::DEBUG::2013-03-01 12:59:59,352::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-525::DEBUG::2013-03-01 12:59:59,355::task::957::TaskManager.Task::(_decref) Task=`1fa42227-b119-438b-aeda-9f9f9745c51f`::ref 0 aborting False >Thread-526::DEBUG::2013-03-01 12:59:59,483::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-526::DEBUG::2013-03-01 12:59:59,490::task::568::TaskManager.Task::(_updateState) Task=`7fa66aaa-c16d-40da-901d-51267ace134a`::moving from state init -> state preparing >Thread-526::INFO::2013-03-01 12:59:59,496::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-526::DEBUG::2013-03-01 12:59:59,507::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7c2d984b-710e-45c9-b775-df19c5844d85`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-526::DEBUG::2013-03-01 12:59:59,511::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-526::DEBUG::2013-03-01 12:59:59,519::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-526::DEBUG::2013-03-01 12:59:59,523::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7c2d984b-710e-45c9-b775-df19c5844d85`::Granted request >Thread-526::DEBUG::2013-03-01 12:59:59,533::task::794::TaskManager.Task::(resourceAcquired) Task=`7fa66aaa-c16d-40da-901d-51267ace134a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-526::DEBUG::2013-03-01 12:59:59,537::task::957::TaskManager.Task::(_decref) Task=`7fa66aaa-c16d-40da-901d-51267ace134a`::ref 1 aborting False >Thread-526::DEBUG::2013-03-01 12:59:59,550::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-526::DEBUG::2013-03-01 12:59:59,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-527::DEBUG::2013-03-01 12:59:59,783::task::568::TaskManager.Task::(_updateState) Task=`4b8fe2f3-fefa-4cb2-b476-ce4e8367dc8f`::moving from state init -> state preparing >Thread-527::INFO::2013-03-01 12:59:59,793::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-527::INFO::2013-03-01 12:59:59,801::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0109059810638', 'lastCheck': '4.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.011745929718', 'lastCheck': '10.9', 'code': 0, 'valid': True}} >Thread-527::DEBUG::2013-03-01 12:59:59,804::task::1151::TaskManager.Task::(prepare) Task=`4b8fe2f3-fefa-4cb2-b476-ce4e8367dc8f`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0109059810638', 'lastCheck': '4.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.011745929718', 'lastCheck': '10.9', 'code': 0, 'valid': True}} >Thread-527::DEBUG::2013-03-01 12:59:59,809::task::568::TaskManager.Task::(_updateState) Task=`4b8fe2f3-fefa-4cb2-b476-ce4e8367dc8f`::moving from state preparing -> state finished >Thread-527::DEBUG::2013-03-01 12:59:59,814::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-527::DEBUG::2013-03-01 12:59:59,818::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-527::DEBUG::2013-03-01 12:59:59,823::task::957::TaskManager.Task::(_decref) Task=`4b8fe2f3-fefa-4cb2-b476-ce4e8367dc8f`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:00:00,752::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:00,787::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:00,993::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:01,352::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0046224 s, 886 kB/s\n'; <rc> = 0 >Thread-526::DEBUG::2013-03-01 13:00:01,606::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-526::DEBUG::2013-03-01 13:00:01,610::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-526::INFO::2013-03-01 13:00:01,615::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-526::DEBUG::2013-03-01 13:00:01,616::task::1151::TaskManager.Task::(prepare) Task=`7fa66aaa-c16d-40da-901d-51267ace134a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-526::DEBUG::2013-03-01 13:00:01,618::task::568::TaskManager.Task::(_updateState) Task=`7fa66aaa-c16d-40da-901d-51267ace134a`::moving from state preparing -> state finished >Thread-526::DEBUG::2013-03-01 13:00:01,619::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-526::DEBUG::2013-03-01 13:00:01,621::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-526::DEBUG::2013-03-01 13:00:01,624::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-526::DEBUG::2013-03-01 13:00:01,626::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-526::DEBUG::2013-03-01 13:00:01,626::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-526::DEBUG::2013-03-01 13:00:01,627::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-526::DEBUG::2013-03-01 13:00:01,629::task::957::TaskManager.Task::(_decref) Task=`7fa66aaa-c16d-40da-901d-51267ace134a`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:01,672::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.475215 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:03,685::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:03,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375174 s, 27.3 MB/s\n'; <rc> = 0 >Thread-530::DEBUG::2013-03-01 13:00:04,764::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-530::DEBUG::2013-03-01 13:00:04,765::task::568::TaskManager.Task::(_updateState) Task=`b6f2a15e-939c-4891-9b06-df7821429838`::moving from state init -> state preparing >Thread-530::INFO::2013-03-01 13:00:04,765::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-530::DEBUG::2013-03-01 13:00:04,766::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-530::DEBUG::2013-03-01 13:00:04,766::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >Thread-530::DEBUG::2013-03-01 13:00:04,766::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'} >Thread-530::DEBUG::2013-03-01 13:00:04,766::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'8fcf3a12-a991-4a10-81a2-8f1746cfb708': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'}} >Thread-530::INFO::2013-03-01 13:00:04,767::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'8fcf3a12-a991-4a10-81a2-8f1746cfb708': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'}}} >Thread-530::DEBUG::2013-03-01 13:00:04,767::task::1151::TaskManager.Task::(prepare) Task=`b6f2a15e-939c-4891-9b06-df7821429838`::finished: {'allTasksStatus': {'8fcf3a12-a991-4a10-81a2-8f1746cfb708': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8fcf3a12-a991-4a10-81a2-8f1746cfb708'}}} >Thread-530::DEBUG::2013-03-01 13:00:04,767::task::568::TaskManager.Task::(_updateState) Task=`b6f2a15e-939c-4891-9b06-df7821429838`::moving from state preparing -> state finished >Thread-530::DEBUG::2013-03-01 13:00:04,768::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-530::DEBUG::2013-03-01 13:00:04,768::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-530::DEBUG::2013-03-01 13:00:04,768::task::957::TaskManager.Task::(_decref) Task=`b6f2a15e-939c-4891-9b06-df7821429838`::ref 0 aborting False >Thread-531::DEBUG::2013-03-01 13:00:04,837::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-531::DEBUG::2013-03-01 13:00:04,838::task::568::TaskManager.Task::(_updateState) Task=`167ce80a-a40b-480e-8ead-74f30c4ee19e`::moving from state init -> state preparing >Thread-531::INFO::2013-03-01 13:00:04,838::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2545ace8-7886-4a93-a63a-5dbd581c3d81', volUUID='95b38c37-bb99-4dc4-b3ae-559b1a54a26a', options=None) >Thread-531::DEBUG::2013-03-01 13:00:04,839::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`f5f41fd7-c691-4c42-bfc2-3ab7661e0e80`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-531::DEBUG::2013-03-01 13:00:04,839::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-531::DEBUG::2013-03-01 13:00:04,839::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-531::DEBUG::2013-03-01 13:00:04,840::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`f5f41fd7-c691-4c42-bfc2-3ab7661e0e80`::Granted request >Thread-531::DEBUG::2013-03-01 13:00:04,840::task::794::TaskManager.Task::(resourceAcquired) Task=`167ce80a-a40b-480e-8ead-74f30c4ee19e`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-531::DEBUG::2013-03-01 13:00:04,840::task::957::TaskManager.Task::(_decref) Task=`167ce80a-a40b-480e-8ead-74f30c4ee19e`::ref 1 aborting False >Thread-531::INFO::2013-03-01 13:00:04,841::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2545ace8-7886-4a93-a63a-5dbd581c3d81 volUUID = 95b38c37-bb99-4dc4-b3ae-559b1a54a26a >Thread-531::DEBUG::2013-03-01 13:00:04,842::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-531::DEBUG::2013-03-01 13:00:04,854::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000932329 s, 549 kB/s\n'; <rc> = 0 >Thread-531::DEBUG::2013-03-01 13:00:04,855::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000932329 s, 549 kB/s'], size: 512 >Thread-531::DEBUG::2013-03-01 13:00:04,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-531::DEBUG::2013-03-01 13:00:04,867::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00034348 s, 1.5 MB/s\n'; <rc> = 0 >Thread-531::DEBUG::2013-03-01 13:00:04,868::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00034348 s, 1.5 MB/s'], size: 512 >Thread-531::DEBUG::2013-03-01 13:00:04,868::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-531::DEBUG::2013-03-01 13:00:04,869::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-531::DEBUG::2013-03-01 13:00:05,147::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-531::DEBUG::2013-03-01 13:00:05,166::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-531::INFO::2013-03-01 13:00:05,168::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2545ace8-7886-4a93-a63a-5dbd581c3d81', 'ctime': '1362135591', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135595', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '95b38c37-bb99-4dc4-b3ae-559b1a54a26a', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-531::INFO::2013-03-01 13:00:05,168::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2545ace8-7886-4a93-a63a-5dbd581c3d81', 'ctime': '1362135591', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135595', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '95b38c37-bb99-4dc4-b3ae-559b1a54a26a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-531::DEBUG::2013-03-01 13:00:05,168::task::1151::TaskManager.Task::(prepare) Task=`167ce80a-a40b-480e-8ead-74f30c4ee19e`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2545ace8-7886-4a93-a63a-5dbd581c3d81', 'ctime': '1362135591', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135595', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '95b38c37-bb99-4dc4-b3ae-559b1a54a26a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-531::DEBUG::2013-03-01 13:00:05,169::task::568::TaskManager.Task::(_updateState) Task=`167ce80a-a40b-480e-8ead-74f30c4ee19e`::moving from state preparing -> state finished >Thread-531::DEBUG::2013-03-01 13:00:05,169::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-531::DEBUG::2013-03-01 13:00:05,169::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-531::DEBUG::2013-03-01 13:00:05,170::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-531::DEBUG::2013-03-01 13:00:05,170::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-531::DEBUG::2013-03-01 13:00:05,170::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-531::DEBUG::2013-03-01 13:00:05,170::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-531::DEBUG::2013-03-01 13:00:05,171::task::957::TaskManager.Task::(_decref) Task=`167ce80a-a40b-480e-8ead-74f30c4ee19e`::ref 0 aborting False >Thread-532::DEBUG::2013-03-01 13:00:05,233::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-532::DEBUG::2013-03-01 13:00:05,234::task::568::TaskManager.Task::(_updateState) Task=`d807cdcf-ae43-498e-8177-d9665eb5ca9b`::moving from state init -> state preparing >Thread-532::INFO::2013-03-01 13:00:05,234::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='8fcf3a12-a991-4a10-81a2-8f1746cfb708', spUUID=None, options=None) >Thread-532::DEBUG::2013-03-01 13:00:05,235::taskManager::161::TaskManager::(clearTask) Entry. taskID: 8fcf3a12-a991-4a10-81a2-8f1746cfb708 >Thread-532::DEBUG::2013-03-01 13:00:05,236::taskManager::166::TaskManager::(clearTask) Return. >Thread-532::INFO::2013-03-01 13:00:05,237::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-532::DEBUG::2013-03-01 13:00:05,237::task::1151::TaskManager.Task::(prepare) Task=`d807cdcf-ae43-498e-8177-d9665eb5ca9b`::finished: None >Thread-532::DEBUG::2013-03-01 13:00:05,237::task::568::TaskManager.Task::(_updateState) Task=`d807cdcf-ae43-498e-8177-d9665eb5ca9b`::moving from state preparing -> state finished >Thread-532::DEBUG::2013-03-01 13:00:05,237::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-532::DEBUG::2013-03-01 13:00:05,238::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-532::DEBUG::2013-03-01 13:00:05,238::task::957::TaskManager.Task::(_decref) Task=`d807cdcf-ae43-498e-8177-d9665eb5ca9b`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:00:05,690::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:05,700::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000332145 s, 12.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:05,811::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:07,231::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.64037 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:09,411::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:09,497::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038762 s, 26.4 MB/s\n'; <rc> = 0 >Thread-535::DEBUG::2013-03-01 13:00:10,805::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-535::DEBUG::2013-03-01 13:00:10,806::task::568::TaskManager.Task::(_updateState) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::moving from state init -> state preparing >Thread-535::INFO::2013-03-01 13:00:10,806::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2545ace8-7886-4a93-a63a-5dbd581c3d81', postZero='false', force='false') >Thread-535::INFO::2013-03-01 13:00:10,807::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-535::DEBUG::2013-03-01 13:00:10,807::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-535::DEBUG::2013-03-01 13:00:11,002::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-535::DEBUG::2013-03-01 13:00:11,003::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,003::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,003::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,004::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,004::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-535::DEBUG::2013-03-01 13:00:11,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-535::DEBUG::2013-03-01 13:00:11,197::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,198::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-535::DEBUG::2013-03-01 13:00:11,199::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81`ReqID=`eff7de5e-932e-49d1-92e6-6f4204a4416c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-535::DEBUG::2013-03-01 13:00:11,200::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81' for lock type 'exclusive' >Thread-535::DEBUG::2013-03-01 13:00:11,200::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81' is free. Now locking as 'exclusive' (1 active user) >Thread-535::DEBUG::2013-03-01 13:00:11,200::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81`ReqID=`eff7de5e-932e-49d1-92e6-6f4204a4416c`::Granted request >Thread-535::DEBUG::2013-03-01 13:00:11,201::task::794::TaskManager.Task::(resourceAcquired) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_resourcesAcquired: Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81 (exclusive) >Thread-535::DEBUG::2013-03-01 13:00:11,201::task::957::TaskManager.Task::(_decref) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::ref 1 aborting False >Thread-535::DEBUG::2013-03-01 13:00:11,202::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`7ab6062a-b8bd-470d-8ea6-2a9bae4bd667`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-535::DEBUG::2013-03-01 13:00:11,202::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-535::DEBUG::2013-03-01 13:00:11,202::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-535::DEBUG::2013-03-01 13:00:11,203::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`7ab6062a-b8bd-470d-8ea6-2a9bae4bd667`::Granted request >Thread-535::DEBUG::2013-03-01 13:00:11,203::task::794::TaskManager.Task::(resourceAcquired) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-535::DEBUG::2013-03-01 13:00:11,204::task::957::TaskManager.Task::(_decref) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::ref 1 aborting False >Thread-535::DEBUG::2013-03-01 13:00:11,204::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-535::DEBUG::2013-03-01 13:00:11,416::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-535::DEBUG::2013-03-01 13:00:11,431::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,432::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/95b38c37-bb99-4dc4-b3ae-559b1a54a26a' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:11,510::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:11,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:11,606::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000300827 s, 13.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:11,628::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316952 s, 32.3 MB/s\n'; <rc> = 0 >Thread-535::DEBUG::2013-03-01 13:00:11,637::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-535::DEBUG::2013-03-01 13:00:11,638::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,639::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-535::DEBUG::2013-03-01 13:00:11,640::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81/95b38c37-bb99-4dc4-b3ae-559b1a54a26a'] >Thread-535::DEBUG::2013-03-01 13:00:11,641::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2545ace8-7886-4a93-a63a-5dbd581c3d81 >Thread-535::DEBUG::2013-03-01 13:00:11,644::task::719::TaskManager.Task::(_save) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9.temp >Thread-535::DEBUG::2013-03-01 13:00:11,664::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_2545ace8-7886-4a93-a63a-5dbd581c3d81 for task e6b13302-0d36-43bc-ae19-2081d75c64f9 >Thread-535::INFO::2013-03-01 13:00:11,665::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-535::DEBUG::2013-03-01 13:00:11,666::task::1146::TaskManager.Task::(prepare) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::Prepare: 1 jobs exist, move to acquiring >Thread-535::DEBUG::2013-03-01 13:00:11,667::task::568::TaskManager.Task::(_updateState) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::moving from state preparing -> state acquiring >Thread-535::DEBUG::2013-03-01 13:00:11,670::task::719::TaskManager.Task::(_save) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9.temp >Thread-535::DEBUG::2013-03-01 13:00:11,684::task::568::TaskManager.Task::(_updateState) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::moving from state acquiring -> state queued >Thread-535::DEBUG::2013-03-01 13:00:11,684::task::719::TaskManager.Task::(_save) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9.temp >Thread-535::DEBUG::2013-03-01 13:00:11,690::taskManager::50::TaskManager::(_queueTask) queuing task: e6b13302-0d36-43bc-ae19-2081d75c64f9 >Thread-535::DEBUG::2013-03-01 13:00:11,690::taskManager::56::TaskManager::(_queueTask) task queued: e6b13302-0d36-43bc-ae19-2081d75c64f9 >9e8a0da8-8ddc-4a7b-8df7-644a3087fdab::DEBUG::2013-03-01 13:00:11,691::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-535::DEBUG::2013-03-01 13:00:11,692::task::1148::TaskManager.Task::(prepare) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::returning >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,692::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: e6b13302-0d36-43bc-ae19-2081d75c64f9 running: <bound method Task.commit of <storage.task.Task instance at 0x17b4b48>> with: None >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,693::task::1159::TaskManager.Task::(commit) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::committing task: e6b13302-0d36-43bc-ae19-2081d75c64f9 >Thread-535::DEBUG::2013-03-01 13:00:11,694::task::957::TaskManager.Task::(_decref) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::ref 0 aborting False >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,695::task::568::TaskManager.Task::(_updateState) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::moving from state queued -> state running >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,698::task::719::TaskManager.Task::(_save) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9.temp >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,706::task::872::TaskManager.Task::(_runJobs) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::Task.run: running job 0: deleteImage_2545ace8-7886-4a93-a63a-5dbd581c3d81: <function <lambda> at 0x7f15882fc320> (args: () kwargs: {}) >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,706::task::304::TaskManager.Task::(run) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::Job.run: running deleteImage_2545ace8-7886-4a93-a63a-5dbd581c3d81: <function <lambda> at 0x7f15882fc320> (args: () kwargs: {}) callback None >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,707::task::568::TaskManager.Task::(_updateState) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::moving from state running -> state finished >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,708::task::719::TaskManager.Task::(_save) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e6b13302-0d36-43bc-ae19-2081d75c64f9.temp >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,715::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81': < ResourceRef 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81', isValid: 'True' obj: 'None'>} >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,715::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,716::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,716::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,716::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,716::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,717::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81' >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,717::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81' (0 active users) >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,717::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81' is free, finding out if anyone is waiting for it. >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,717::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.2545ace8-7886-4a93-a63a-5dbd581c3d81', Clearing records. >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,718::task::880::TaskManager.Task::(_runJobs) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::Task.run: exit - success: result True >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,718::task::957::TaskManager.Task::(_decref) Task=`e6b13302-0d36-43bc-ae19-2081d75c64f9`::ref 0 aborting False >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:11,718::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-536::DEBUG::2013-03-01 13:00:11,729::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-536::DEBUG::2013-03-01 13:00:11,730::task::568::TaskManager.Task::(_updateState) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::moving from state init -> state preparing >Thread-536::INFO::2013-03-01 13:00:11,730::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='d89f5a12-6aa5-4fe7-83f7-f54f128098ec', postZero='false', force='false') >Thread-536::INFO::2013-03-01 13:00:11,730::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-536::DEBUG::2013-03-01 13:00:11,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-536::DEBUG::2013-03-01 13:00:11,920::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-536::DEBUG::2013-03-01 13:00:11,921::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:11,921::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:11,922::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:11,922::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:11,923::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:11,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-536::DEBUG::2013-03-01 13:00:12,211::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-536::DEBUG::2013-03-01 13:00:12,213::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,213::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-536::DEBUG::2013-03-01 13:00:12,215::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`128b4717-a681-4632-b234-b8e10655bea3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-536::DEBUG::2013-03-01 13:00:12,215::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' for lock type 'exclusive' >Thread-536::DEBUG::2013-03-01 13:00:12,215::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free. Now locking as 'exclusive' (1 active user) >Thread-536::DEBUG::2013-03-01 13:00:12,216::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec`ReqID=`128b4717-a681-4632-b234-b8e10655bea3`::Granted request >Thread-536::DEBUG::2013-03-01 13:00:12,216::task::794::TaskManager.Task::(resourceAcquired) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_resourcesAcquired: Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec (exclusive) >Thread-536::DEBUG::2013-03-01 13:00:12,217::task::957::TaskManager.Task::(_decref) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::ref 1 aborting False >Thread-536::DEBUG::2013-03-01 13:00:12,217::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ce439443-ba62-410b-8eee-8130a33c410e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-536::DEBUG::2013-03-01 13:00:12,217::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-536::DEBUG::2013-03-01 13:00:12,218::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-536::DEBUG::2013-03-01 13:00:12,218::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ce439443-ba62-410b-8eee-8130a33c410e`::Granted request >Thread-536::DEBUG::2013-03-01 13:00:12,219::task::794::TaskManager.Task::(resourceAcquired) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-536::DEBUG::2013-03-01 13:00:12,219::task::957::TaskManager.Task::(_decref) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::ref 1 aborting False >Thread-536::DEBUG::2013-03-01 13:00:12,220::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,224::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-536::DEBUG::2013-03-01 13:00:12,417::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-536::DEBUG::2013-03-01 13:00:12,431::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,433::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/15078fcf-636b-4259-b3ea-7ca11f9d5d87 a558fc2a-a4a3-4118-9b81-d1d601eaa295/7dd32175-f11e-4137-9148-5d783cc08e2f' (cwd None) >Thread-536::DEBUG::2013-03-01 13:00:12,643::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-536::DEBUG::2013-03-01 13:00:12,644::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,644::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,645::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,645::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-536::DEBUG::2013-03-01 13:00:12,646::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec/7dd32175-f11e-4137-9148-5d783cc08e2f'] >Thread-536::DEBUG::2013-03-01 13:00:12,646::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/d89f5a12-6aa5-4fe7-83f7-f54f128098ec >Thread-536::DEBUG::2013-03-01 13:00:12,648::task::719::TaskManager.Task::(_save) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1.temp >Thread-536::DEBUG::2013-03-01 13:00:12,654::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_d89f5a12-6aa5-4fe7-83f7-f54f128098ec for task 172f931e-c2b1-409c-92e6-f0f43d5b99d1 >Thread-536::INFO::2013-03-01 13:00:12,654::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-536::DEBUG::2013-03-01 13:00:12,655::task::1146::TaskManager.Task::(prepare) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::Prepare: 1 jobs exist, move to acquiring >Thread-536::DEBUG::2013-03-01 13:00:12,655::task::568::TaskManager.Task::(_updateState) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::moving from state preparing -> state acquiring >Thread-536::DEBUG::2013-03-01 13:00:12,656::task::719::TaskManager.Task::(_save) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1.temp >Thread-536::DEBUG::2013-03-01 13:00:12,663::task::568::TaskManager.Task::(_updateState) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::moving from state acquiring -> state queued >Thread-536::DEBUG::2013-03-01 13:00:12,664::task::719::TaskManager.Task::(_save) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1.temp >Thread-536::DEBUG::2013-03-01 13:00:12,671::taskManager::50::TaskManager::(_queueTask) queuing task: 172f931e-c2b1-409c-92e6-f0f43d5b99d1 >fe259a5c-f1d9-490e-b65e-300c60718ca3::DEBUG::2013-03-01 13:00:12,671::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-536::DEBUG::2013-03-01 13:00:12,671::taskManager::56::TaskManager::(_queueTask) task queued: 172f931e-c2b1-409c-92e6-f0f43d5b99d1 >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,673::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 172f931e-c2b1-409c-92e6-f0f43d5b99d1 running: <bound method Task.commit of <storage.task.Task instance at 0x17b4170>> with: None >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,674::task::1159::TaskManager.Task::(commit) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::committing task: 172f931e-c2b1-409c-92e6-f0f43d5b99d1 >Thread-536::DEBUG::2013-03-01 13:00:12,675::task::1148::TaskManager.Task::(prepare) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::returning >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,676::task::568::TaskManager.Task::(_updateState) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::moving from state queued -> state running >Thread-536::DEBUG::2013-03-01 13:00:12,678::task::957::TaskManager.Task::(_decref) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::ref 1 aborting False >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,681::task::719::TaskManager.Task::(_save) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1.temp >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,693::task::872::TaskManager.Task::(_runJobs) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::Task.run: running job 0: deleteImage_d89f5a12-6aa5-4fe7-83f7-f54f128098ec: <function <lambda> at 0x7f15882e8c08> (args: () kwargs: {}) >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,693::task::304::TaskManager.Task::(run) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::Job.run: running deleteImage_d89f5a12-6aa5-4fe7-83f7-f54f128098ec: <function <lambda> at 0x7f15882e8c08> (args: () kwargs: {}) callback None >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,693::task::568::TaskManager.Task::(_updateState) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::moving from state running -> state finished >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,694::task::719::TaskManager.Task::(_save) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/172f931e-c2b1-409c-92e6-f0f43d5b99d1.temp >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,702::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec': < ResourceRef 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec', isValid: 'True' obj: 'None'>} >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,702::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,703::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,703::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,704::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,704::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,704::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,705::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' (0 active users) >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,705::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec' is free, finding out if anyone is waiting for it. >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,705::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.d89f5a12-6aa5-4fe7-83f7-f54f128098ec', Clearing records. >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,706::task::880::TaskManager.Task::(_runJobs) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::Task.run: exit - success: result True >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,706::task::957::TaskManager.Task::(_decref) Task=`172f931e-c2b1-409c-92e6-f0f43d5b99d1`::ref 0 aborting False >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:00:12,706::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-538::DEBUG::2013-03-01 13:00:12,735::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-538::DEBUG::2013-03-01 13:00:12,736::task::568::TaskManager.Task::(_updateState) Task=`7ccf1799-bf6b-4c94-b195-cb999b554b69`::moving from state init -> state preparing >Thread-538::INFO::2013-03-01 13:00:12,736::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-538::INFO::2013-03-01 13:00:12,737::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-538::DEBUG::2013-03-01 13:00:12,737::task::1151::TaskManager.Task::(prepare) Task=`7ccf1799-bf6b-4c94-b195-cb999b554b69`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-538::DEBUG::2013-03-01 13:00:12,737::task::568::TaskManager.Task::(_updateState) Task=`7ccf1799-bf6b-4c94-b195-cb999b554b69`::moving from state preparing -> state finished >Thread-538::DEBUG::2013-03-01 13:00:12,737::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-538::DEBUG::2013-03-01 13:00:12,738::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-538::DEBUG::2013-03-01 13:00:12,738::task::957::TaskManager.Task::(_decref) Task=`7ccf1799-bf6b-4c94-b195-cb999b554b69`::ref 0 aborting False >Thread-539::DEBUG::2013-03-01 13:00:12,812::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-539::DEBUG::2013-03-01 13:00:12,813::task::568::TaskManager.Task::(_updateState) Task=`2c3894a0-8031-42fd-b50c-5e3bf0bb6511`::moving from state init -> state preparing >Thread-539::INFO::2013-03-01 13:00:12,813::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-539::DEBUG::2013-03-01 13:00:12,814::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7b3bb0bd-3ad0-48e4-a693-b5b7185c338b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-539::DEBUG::2013-03-01 13:00:12,814::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-539::DEBUG::2013-03-01 13:00:12,815::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-539::DEBUG::2013-03-01 13:00:12,815::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`7b3bb0bd-3ad0-48e4-a693-b5b7185c338b`::Granted request >Thread-539::DEBUG::2013-03-01 13:00:12,815::task::794::TaskManager.Task::(resourceAcquired) Task=`2c3894a0-8031-42fd-b50c-5e3bf0bb6511`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-539::DEBUG::2013-03-01 13:00:12,816::task::957::TaskManager.Task::(_decref) Task=`2c3894a0-8031-42fd-b50c-5e3bf0bb6511`::ref 1 aborting False >Thread-539::DEBUG::2013-03-01 13:00:12,816::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-539::DEBUG::2013-03-01 13:00:12,817::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-539::DEBUG::2013-03-01 13:00:13,137::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-539::DEBUG::2013-03-01 13:00:13,139::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-539::INFO::2013-03-01 13:00:13,140::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-539::DEBUG::2013-03-01 13:00:13,141::task::1151::TaskManager.Task::(prepare) Task=`2c3894a0-8031-42fd-b50c-5e3bf0bb6511`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-539::DEBUG::2013-03-01 13:00:13,141::task::568::TaskManager.Task::(_updateState) Task=`2c3894a0-8031-42fd-b50c-5e3bf0bb6511`::moving from state preparing -> state finished >Thread-539::DEBUG::2013-03-01 13:00:13,141::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-539::DEBUG::2013-03-01 13:00:13,142::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-539::DEBUG::2013-03-01 13:00:13,142::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-539::DEBUG::2013-03-01 13:00:13,143::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-539::DEBUG::2013-03-01 13:00:13,143::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-539::DEBUG::2013-03-01 13:00:13,143::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-539::DEBUG::2013-03-01 13:00:13,144::task::957::TaskManager.Task::(_decref) Task=`2c3894a0-8031-42fd-b50c-5e3bf0bb6511`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:13,683::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:13,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484817 s, 21.1 MB/s\n'; <rc> = 0 >Thread-540::DEBUG::2013-03-01 13:00:14,809::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-540::DEBUG::2013-03-01 13:00:14,810::task::568::TaskManager.Task::(_updateState) Task=`0d1bccd4-8aca-436b-9b06-11327e52577f`::moving from state init -> state preparing >Thread-540::INFO::2013-03-01 13:00:14,810::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-540::DEBUG::2013-03-01 13:00:14,811::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-540::DEBUG::2013-03-01 13:00:14,811::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 172f931e-c2b1-409c-92e6-f0f43d5b99d1 >Thread-540::DEBUG::2013-03-01 13:00:14,811::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '172f931e-c2b1-409c-92e6-f0f43d5b99d1'} >Thread-540::DEBUG::2013-03-01 13:00:14,811::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e6b13302-0d36-43bc-ae19-2081d75c64f9 >Thread-540::DEBUG::2013-03-01 13:00:14,812::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e6b13302-0d36-43bc-ae19-2081d75c64f9'} >Thread-540::DEBUG::2013-03-01 13:00:14,812::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'172f931e-c2b1-409c-92e6-f0f43d5b99d1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '172f931e-c2b1-409c-92e6-f0f43d5b99d1'}, 'e6b13302-0d36-43bc-ae19-2081d75c64f9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e6b13302-0d36-43bc-ae19-2081d75c64f9'}} >Thread-540::INFO::2013-03-01 13:00:14,812::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'172f931e-c2b1-409c-92e6-f0f43d5b99d1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '172f931e-c2b1-409c-92e6-f0f43d5b99d1'}, 'e6b13302-0d36-43bc-ae19-2081d75c64f9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e6b13302-0d36-43bc-ae19-2081d75c64f9'}}} >Thread-540::DEBUG::2013-03-01 13:00:14,812::task::1151::TaskManager.Task::(prepare) Task=`0d1bccd4-8aca-436b-9b06-11327e52577f`::finished: {'allTasksStatus': {'172f931e-c2b1-409c-92e6-f0f43d5b99d1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '172f931e-c2b1-409c-92e6-f0f43d5b99d1'}, 'e6b13302-0d36-43bc-ae19-2081d75c64f9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e6b13302-0d36-43bc-ae19-2081d75c64f9'}}} >Thread-540::DEBUG::2013-03-01 13:00:14,813::task::568::TaskManager.Task::(_updateState) Task=`0d1bccd4-8aca-436b-9b06-11327e52577f`::moving from state preparing -> state finished >Thread-540::DEBUG::2013-03-01 13:00:14,813::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-540::DEBUG::2013-03-01 13:00:14,813::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-540::DEBUG::2013-03-01 13:00:14,813::task::957::TaskManager.Task::(_decref) Task=`0d1bccd4-8aca-436b-9b06-11327e52577f`::ref 0 aborting False >Thread-541::DEBUG::2013-03-01 13:00:14,926::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-541::DEBUG::2013-03-01 13:00:14,926::task::568::TaskManager.Task::(_updateState) Task=`9e41c72b-d96b-4451-af3d-544e85ed457d`::moving from state init -> state preparing >Thread-541::INFO::2013-03-01 13:00:14,927::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='172f931e-c2b1-409c-92e6-f0f43d5b99d1', spUUID=None, options=None) >Thread-541::DEBUG::2013-03-01 13:00:14,927::taskManager::161::TaskManager::(clearTask) Entry. taskID: 172f931e-c2b1-409c-92e6-f0f43d5b99d1 >Thread-541::DEBUG::2013-03-01 13:00:14,928::taskManager::166::TaskManager::(clearTask) Return. >Thread-541::INFO::2013-03-01 13:00:14,928::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-541::DEBUG::2013-03-01 13:00:14,928::task::1151::TaskManager.Task::(prepare) Task=`9e41c72b-d96b-4451-af3d-544e85ed457d`::finished: None >Thread-541::DEBUG::2013-03-01 13:00:14,929::task::568::TaskManager.Task::(_updateState) Task=`9e41c72b-d96b-4451-af3d-544e85ed457d`::moving from state preparing -> state finished >Thread-541::DEBUG::2013-03-01 13:00:14,929::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-541::DEBUG::2013-03-01 13:00:14,929::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-541::DEBUG::2013-03-01 13:00:14,929::task::957::TaskManager.Task::(_decref) Task=`9e41c72b-d96b-4451-af3d-544e85ed457d`::ref 0 aborting False >Thread-542::DEBUG::2013-03-01 13:00:14,957::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-542::DEBUG::2013-03-01 13:00:14,957::task::568::TaskManager.Task::(_updateState) Task=`fed32d44-55db-428d-80a2-9216a8d3485d`::moving from state init -> state preparing >Thread-542::INFO::2013-03-01 13:00:14,958::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='e6b13302-0d36-43bc-ae19-2081d75c64f9', spUUID=None, options=None) >Thread-542::DEBUG::2013-03-01 13:00:14,958::taskManager::161::TaskManager::(clearTask) Entry. taskID: e6b13302-0d36-43bc-ae19-2081d75c64f9 >Thread-542::DEBUG::2013-03-01 13:00:14,959::taskManager::166::TaskManager::(clearTask) Return. >Thread-542::INFO::2013-03-01 13:00:14,959::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-542::DEBUG::2013-03-01 13:00:14,959::task::1151::TaskManager.Task::(prepare) Task=`fed32d44-55db-428d-80a2-9216a8d3485d`::finished: None >Thread-542::DEBUG::2013-03-01 13:00:14,959::task::568::TaskManager.Task::(_updateState) Task=`fed32d44-55db-428d-80a2-9216a8d3485d`::moving from state preparing -> state finished >Thread-542::DEBUG::2013-03-01 13:00:14,960::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-542::DEBUG::2013-03-01 13:00:14,960::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-542::DEBUG::2013-03-01 13:00:14,960::task::957::TaskManager.Task::(_decref) Task=`fed32d44-55db-428d-80a2-9216a8d3485d`::ref 0 aborting False >Thread-543::DEBUG::2013-03-01 13:00:15,405::task::568::TaskManager.Task::(_updateState) Task=`59924852-e94f-470f-950f-65d1d04e26e3`::moving from state init -> state preparing >Thread-543::INFO::2013-03-01 13:00:15,405::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-543::INFO::2013-03-01 13:00:15,405::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.010547876358', 'lastCheck': '9.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0291128158569', 'lastCheck': '3.8', 'code': 0, 'valid': True}} >Thread-543::DEBUG::2013-03-01 13:00:15,406::task::1151::TaskManager.Task::(prepare) Task=`59924852-e94f-470f-950f-65d1d04e26e3`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.010547876358', 'lastCheck': '9.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0291128158569', 'lastCheck': '3.8', 'code': 0, 'valid': True}} >Thread-543::DEBUG::2013-03-01 13:00:15,406::task::568::TaskManager.Task::(_updateState) Task=`59924852-e94f-470f-950f-65d1d04e26e3`::moving from state preparing -> state finished >Thread-543::DEBUG::2013-03-01 13:00:15,406::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-543::DEBUG::2013-03-01 13:00:15,406::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-543::DEBUG::2013-03-01 13:00:15,407::task::957::TaskManager.Task::(_decref) Task=`59924852-e94f-470f-950f-65d1d04e26e3`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:00:15,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:15,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000332258 s, 12.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:15,803::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:15,909::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400824 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:17,928::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:18,035::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417636 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:20,054::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:20,146::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438002 s, 23.4 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:21,623::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:21,635::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000480244 s, 8.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:22,160::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:22,285::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498672 s, 20.5 MB/s\n'; <rc> = 0 >Thread-547::DEBUG::2013-03-01 13:00:23,227::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-547::DEBUG::2013-03-01 13:00:23,227::task::568::TaskManager.Task::(_updateState) Task=`f711c78d-a3d2-49d6-a2b9-4f0932462f2c`::moving from state init -> state preparing >Thread-547::INFO::2013-03-01 13:00:23,228::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-547::INFO::2013-03-01 13:00:23,228::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-547::DEBUG::2013-03-01 13:00:23,228::task::1151::TaskManager.Task::(prepare) Task=`f711c78d-a3d2-49d6-a2b9-4f0932462f2c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-547::DEBUG::2013-03-01 13:00:23,229::task::568::TaskManager.Task::(_updateState) Task=`f711c78d-a3d2-49d6-a2b9-4f0932462f2c`::moving from state preparing -> state finished >Thread-547::DEBUG::2013-03-01 13:00:23,229::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-547::DEBUG::2013-03-01 13:00:23,229::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-547::DEBUG::2013-03-01 13:00:23,230::task::957::TaskManager.Task::(_decref) Task=`f711c78d-a3d2-49d6-a2b9-4f0932462f2c`::ref 0 aborting False >Thread-548::DEBUG::2013-03-01 13:00:23,256::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-548::DEBUG::2013-03-01 13:00:23,257::task::568::TaskManager.Task::(_updateState) Task=`64128f9c-6505-497b-8fbf-e33022fb0883`::moving from state init -> state preparing >Thread-548::INFO::2013-03-01 13:00:23,257::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-548::DEBUG::2013-03-01 13:00:23,258::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`a26be1b8-1965-451e-b1b2-d9f4cb1a6412`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-548::DEBUG::2013-03-01 13:00:23,258::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-548::DEBUG::2013-03-01 13:00:23,258::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-548::DEBUG::2013-03-01 13:00:23,258::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`a26be1b8-1965-451e-b1b2-d9f4cb1a6412`::Granted request >Thread-548::DEBUG::2013-03-01 13:00:23,259::task::794::TaskManager.Task::(resourceAcquired) Task=`64128f9c-6505-497b-8fbf-e33022fb0883`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-548::DEBUG::2013-03-01 13:00:23,259::task::957::TaskManager.Task::(_decref) Task=`64128f9c-6505-497b-8fbf-e33022fb0883`::ref 1 aborting False >Thread-548::INFO::2013-03-01 13:00:23,261::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-548::DEBUG::2013-03-01 13:00:23,261::task::1151::TaskManager.Task::(prepare) Task=`64128f9c-6505-497b-8fbf-e33022fb0883`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-548::DEBUG::2013-03-01 13:00:23,262::task::568::TaskManager.Task::(_updateState) Task=`64128f9c-6505-497b-8fbf-e33022fb0883`::moving from state preparing -> state finished >Thread-548::DEBUG::2013-03-01 13:00:23,262::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-548::DEBUG::2013-03-01 13:00:23,262::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-548::DEBUG::2013-03-01 13:00:23,263::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-548::DEBUG::2013-03-01 13:00:23,263::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-548::DEBUG::2013-03-01 13:00:23,263::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-548::DEBUG::2013-03-01 13:00:23,264::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-548::DEBUG::2013-03-01 13:00:23,264::task::957::TaskManager.Task::(_decref) Task=`64128f9c-6505-497b-8fbf-e33022fb0883`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:24,304::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:24,411::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414574 s, 24.7 MB/s\n'; <rc> = 0 >Thread-550::DEBUG::2013-03-01 13:00:24,778::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-550::DEBUG::2013-03-01 13:00:24,778::task::568::TaskManager.Task::(_updateState) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::moving from state init -> state preparing >Thread-550::INFO::2013-03-01 13:00:24,779::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='8eaab457-8f02-4cff-9544-73d4e44a54e2', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-550::INFO::2013-03-01 13:00:24,779::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-550::DEBUG::2013-03-01 13:00:24,780::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-550::DEBUG::2013-03-01 13:00:25,031::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-550::DEBUG::2013-03-01 13:00:25,032::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-550::DEBUG::2013-03-01 13:00:25,032::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-550::DEBUG::2013-03-01 13:00:25,032::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-550::DEBUG::2013-03-01 13:00:25,033::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-550::DEBUG::2013-03-01 13:00:25,033::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-550::DEBUG::2013-03-01 13:00:25,034::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-550::DEBUG::2013-03-01 13:00:25,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-550::DEBUG::2013-03-01 13:00:25,268::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-550::DEBUG::2013-03-01 13:00:25,269::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-550::DEBUG::2013-03-01 13:00:25,270::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`16192d14-d9ea-47a2-ab47-e35a4162c776`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-550::DEBUG::2013-03-01 13:00:25,271::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-550::DEBUG::2013-03-01 13:00:25,271::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-550::DEBUG::2013-03-01 13:00:25,271::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`16192d14-d9ea-47a2-ab47-e35a4162c776`::Granted request >Thread-550::DEBUG::2013-03-01 13:00:25,272::task::794::TaskManager.Task::(resourceAcquired) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-550::DEBUG::2013-03-01 13:00:25,272::task::957::TaskManager.Task::(_decref) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::ref 1 aborting False >Thread-550::DEBUG::2013-03-01 13:00:25,274::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >Thread-550::DEBUG::2013-03-01 13:00:25,281::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 >Thread-550::INFO::2013-03-01 13:00:25,281::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-550::DEBUG::2013-03-01 13:00:25,281::task::1146::TaskManager.Task::(prepare) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::Prepare: 1 jobs exist, move to acquiring >Thread-550::DEBUG::2013-03-01 13:00:25,282::task::568::TaskManager.Task::(_updateState) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::moving from state preparing -> state acquiring >Thread-550::DEBUG::2013-03-01 13:00:25,282::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >Thread-550::DEBUG::2013-03-01 13:00:25,290::task::568::TaskManager.Task::(_updateState) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::moving from state acquiring -> state queued >Thread-550::DEBUG::2013-03-01 13:00:25,291::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >Thread-550::DEBUG::2013-03-01 13:00:25,298::taskManager::50::TaskManager::(_queueTask) queuing task: f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 >8fcf3a12-a991-4a10-81a2-8f1746cfb708::DEBUG::2013-03-01 13:00:25,299::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-550::DEBUG::2013-03-01 13:00:25,298::taskManager::56::TaskManager::(_queueTask) task queued: f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,300::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 running: <bound method Task.commit of <storage.task.Task instance at 0x17b3560>> with: None >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,302::task::1159::TaskManager.Task::(commit) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::committing task: f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 >Thread-550::DEBUG::2013-03-01 13:00:25,302::task::1148::TaskManager.Task::(prepare) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::returning >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,303::task::568::TaskManager.Task::(_updateState) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::moving from state queued -> state running >Thread-550::DEBUG::2013-03-01 13:00:25,305::task::957::TaskManager.Task::(_decref) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::ref 1 aborting False >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,309::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,318::task::872::TaskManager.Task::(_runJobs) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 12582912, 4, 2, 2, '8eaab457-8f02-4cff-9544-73d4e44a54e2', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,318::task::304::TaskManager.Task::(run) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 12582912, 4, 2, 2, '8eaab457-8f02-4cff-9544-73d4e44a54e2', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,319::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`e1c5a8a0-714d-4617-8332-a667db851c82`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,319::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' for lock type 'exclusive' >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,320::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,321::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,566::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,578::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,578::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image b4bf0747-2c4c-4d83-9f75-eb83759f5712 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,578::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free. Now locking as 'exclusive' (1 active user) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,579::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`e1c5a8a0-714d-4617-8332-a667db851c82`::Granted request >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::INFO::2013-03-01 13:00:25,580::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712 for image's volumes >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,581::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,596::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,597::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:25,715::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:25,724::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000350982 s, 11.7 MB/s\n'; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,843::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,855::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::WARNING::2013-03-01 13:00:25,856::lvm::593::Storage.LVM::(getLv) lv: 8eaab457-8f02-4cff-9544-73d4e44a54e2 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::INFO::2013-03-01 13:00:25,857::volume::457::Storage.Volume::(create) Creating volume 8eaab457-8f02-4cff-9544-73d4e44a54e2 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,858::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,869::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:25,880::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 8eaab457-8f02-4cff-9544-73d4e44a54e2 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:26,430::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:26,534::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488103 s, 21.0 MB/s\n'; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,670::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,671::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,678::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,678::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,678::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::INFO::2013-03-01 13:00:27,679::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 with size = 12582912 sectors >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,680::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 6291456K' (cwd None) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,692::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,693::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,694::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,904::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,915::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::WARNING::2013-03-01 13:00:27,916::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,916::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:27,917::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_b4bf0747-2c4c-4d83-9f75-eb83759f5712 --addtag MD_7 --addtag PU_00000000-0000-0000-0000-000000000000 a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,122::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,123::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,123::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,125::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,383::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,384::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,384::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,385::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,394::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=8eaab457-8f02-4cff-9544-73d4e44a54e2 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,399::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,407::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,408::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' (0 active users) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,408::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free, finding out if anyone is waiting for it. >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,408::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712', Clearing records. >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,409::task::568::TaskManager.Task::(_updateState) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::moving from state running -> state finished >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,409::task::719::TaskManager.Task::(_save) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f3b854ab-59eb-4cf1-a8e7-3f271a8539c0.temp >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,418::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,419::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,419::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,419::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,420::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,420::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,420::task::880::TaskManager.Task::(_runJobs) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::Task.run: exit - success: result {'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2'} >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,421::task::957::TaskManager.Task::(_decref) Task=`f3b854ab-59eb-4cf1-a8e7-3f271a8539c0`::ref 0 aborting False >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:28,421::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:00:28,548::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:28,646::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487501 s, 21.0 MB/s\n'; <rc> = 0 >Thread-552::DEBUG::2013-03-01 13:00:30,644::task::568::TaskManager.Task::(_updateState) Task=`0d901342-351d-45a6-baab-204a76ea2706`::moving from state init -> state preparing >Thread-552::INFO::2013-03-01 13:00:30,644::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-552::INFO::2013-03-01 13:00:30,645::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106551647186', 'lastCheck': '4.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129101276398', 'lastCheck': '9.0', 'code': 0, 'valid': True}} >Thread-552::DEBUG::2013-03-01 13:00:30,645::task::1151::TaskManager.Task::(prepare) Task=`0d901342-351d-45a6-baab-204a76ea2706`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106551647186', 'lastCheck': '4.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129101276398', 'lastCheck': '9.0', 'code': 0, 'valid': True}} >Thread-552::DEBUG::2013-03-01 13:00:30,645::task::568::TaskManager.Task::(_updateState) Task=`0d901342-351d-45a6-baab-204a76ea2706`::moving from state preparing -> state finished >Thread-552::DEBUG::2013-03-01 13:00:30,645::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-552::DEBUG::2013-03-01 13:00:30,646::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-552::DEBUG::2013-03-01 13:00:30,646::task::957::TaskManager.Task::(_decref) Task=`0d901342-351d-45a6-baab-204a76ea2706`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:30,659::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:30,766::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470429 s, 21.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:31,642::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:00:31,643::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:31,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:31,942::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:00:31,943::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:31,955::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000325785 s, 12.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:32,786::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:32,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426078 s, 24.0 MB/s\n'; <rc> = 0 >Thread-554::DEBUG::2013-03-01 13:00:33,304::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-554::DEBUG::2013-03-01 13:00:33,304::task::568::TaskManager.Task::(_updateState) Task=`7826085f-88bb-4133-b126-3d31f8c668be`::moving from state init -> state preparing >Thread-554::INFO::2013-03-01 13:00:33,305::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-554::INFO::2013-03-01 13:00:33,305::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-554::DEBUG::2013-03-01 13:00:33,306::task::1151::TaskManager.Task::(prepare) Task=`7826085f-88bb-4133-b126-3d31f8c668be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-554::DEBUG::2013-03-01 13:00:33,306::task::568::TaskManager.Task::(_updateState) Task=`7826085f-88bb-4133-b126-3d31f8c668be`::moving from state preparing -> state finished >Thread-554::DEBUG::2013-03-01 13:00:33,306::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-554::DEBUG::2013-03-01 13:00:33,306::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-554::DEBUG::2013-03-01 13:00:33,307::task::957::TaskManager.Task::(_decref) Task=`7826085f-88bb-4133-b126-3d31f8c668be`::ref 0 aborting False >Thread-555::DEBUG::2013-03-01 13:00:33,332::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-555::DEBUG::2013-03-01 13:00:33,332::task::568::TaskManager.Task::(_updateState) Task=`37960166-b6e9-4306-a5f0-bd0f700db62c`::moving from state init -> state preparing >Thread-555::INFO::2013-03-01 13:00:33,333::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-555::DEBUG::2013-03-01 13:00:33,333::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1a81f2f2-c989-4207-bc45-e9bf9e6f25cc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-555::DEBUG::2013-03-01 13:00:33,333::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-555::DEBUG::2013-03-01 13:00:33,334::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-555::DEBUG::2013-03-01 13:00:33,334::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1a81f2f2-c989-4207-bc45-e9bf9e6f25cc`::Granted request >Thread-555::DEBUG::2013-03-01 13:00:33,335::task::794::TaskManager.Task::(resourceAcquired) Task=`37960166-b6e9-4306-a5f0-bd0f700db62c`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-555::DEBUG::2013-03-01 13:00:33,335::task::957::TaskManager.Task::(_decref) Task=`37960166-b6e9-4306-a5f0-bd0f700db62c`::ref 1 aborting False >Thread-555::INFO::2013-03-01 13:00:33,337::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-555::DEBUG::2013-03-01 13:00:33,337::task::1151::TaskManager.Task::(prepare) Task=`37960166-b6e9-4306-a5f0-bd0f700db62c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-555::DEBUG::2013-03-01 13:00:33,337::task::568::TaskManager.Task::(_updateState) Task=`37960166-b6e9-4306-a5f0-bd0f700db62c`::moving from state preparing -> state finished >Thread-555::DEBUG::2013-03-01 13:00:33,338::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-555::DEBUG::2013-03-01 13:00:33,338::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-555::DEBUG::2013-03-01 13:00:33,338::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-555::DEBUG::2013-03-01 13:00:33,339::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-555::DEBUG::2013-03-01 13:00:33,339::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-555::DEBUG::2013-03-01 13:00:33,339::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-555::DEBUG::2013-03-01 13:00:33,340::task::957::TaskManager.Task::(_decref) Task=`37960166-b6e9-4306-a5f0-bd0f700db62c`::ref 0 aborting False >Thread-557::DEBUG::2013-03-01 13:00:34,856::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-557::DEBUG::2013-03-01 13:00:34,856::task::568::TaskManager.Task::(_updateState) Task=`363ade39-2ecf-48cc-b4c2-b2391fba4c91`::moving from state init -> state preparing >Thread-557::INFO::2013-03-01 13:00:34,857::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-557::DEBUG::2013-03-01 13:00:34,857::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-557::DEBUG::2013-03-01 13:00:34,857::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 >Thread-557::DEBUG::2013-03-01 13:00:34,858::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0'} >Thread-557::DEBUG::2013-03-01 13:00:34,858::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0'}} >Thread-557::INFO::2013-03-01 13:00:34,858::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0'}}} >Thread-557::DEBUG::2013-03-01 13:00:34,858::task::1151::TaskManager.Task::(prepare) Task=`363ade39-2ecf-48cc-b4c2-b2391fba4c91`::finished: {'allTasksStatus': {'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f3b854ab-59eb-4cf1-a8e7-3f271a8539c0'}}} >Thread-557::DEBUG::2013-03-01 13:00:34,859::task::568::TaskManager.Task::(_updateState) Task=`363ade39-2ecf-48cc-b4c2-b2391fba4c91`::moving from state preparing -> state finished >Thread-557::DEBUG::2013-03-01 13:00:34,859::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-557::DEBUG::2013-03-01 13:00:34,859::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-557::DEBUG::2013-03-01 13:00:34,860::task::957::TaskManager.Task::(_decref) Task=`363ade39-2ecf-48cc-b4c2-b2391fba4c91`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:34,911::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-558::DEBUG::2013-03-01 13:00:34,921::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-558::DEBUG::2013-03-01 13:00:34,923::task::568::TaskManager.Task::(_updateState) Task=`b4d09470-272f-47db-8e9c-1bd7b20a2acd`::moving from state init -> state preparing >Thread-558::INFO::2013-03-01 13:00:34,926::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', volUUID='8eaab457-8f02-4cff-9544-73d4e44a54e2', options=None) >Thread-558::DEBUG::2013-03-01 13:00:34,931::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`265ac364-c9e2-4984-85e6-3b61fec82a39`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-558::DEBUG::2013-03-01 13:00:34,933::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-558::DEBUG::2013-03-01 13:00:34,936::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-558::DEBUG::2013-03-01 13:00:34,939::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`265ac364-c9e2-4984-85e6-3b61fec82a39`::Granted request >Thread-558::DEBUG::2013-03-01 13:00:34,944::task::794::TaskManager.Task::(resourceAcquired) Task=`b4d09470-272f-47db-8e9c-1bd7b20a2acd`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-558::DEBUG::2013-03-01 13:00:34,946::task::957::TaskManager.Task::(_decref) Task=`b4d09470-272f-47db-8e9c-1bd7b20a2acd`::ref 1 aborting False >Thread-558::DEBUG::2013-03-01 13:00:34,952::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-558::DEBUG::2013-03-01 13:00:34,962::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:35,072::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0954793 s, 10.7 MB/s\n'; <rc> = 0 >Thread-558::DEBUG::2013-03-01 13:00:35,207::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-558::DEBUG::2013-03-01 13:00:35,217::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-558::INFO::2013-03-01 13:00:35,218::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 volUUID = 8eaab457-8f02-4cff-9544-73d4e44a54e2 >Thread-558::DEBUG::2013-03-01 13:00:35,218::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-558::DEBUG::2013-03-01 13:00:35,228::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339372 s, 1.5 MB/s\n'; <rc> = 0 >Thread-558::DEBUG::2013-03-01 13:00:35,228::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339372 s, 1.5 MB/s'], size: 512 >Thread-558::DEBUG::2013-03-01 13:00:35,229::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-558::DEBUG::2013-03-01 13:00:35,239::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000347354 s, 1.5 MB/s\n'; <rc> = 0 >Thread-558::DEBUG::2013-03-01 13:00:35,239::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000347354 s, 1.5 MB/s'], size: 512 >Thread-558::DEBUG::2013-03-01 13:00:35,240::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-558::DEBUG::2013-03-01 13:00:35,241::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-558::DEBUG::2013-03-01 13:00:35,487::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-558::DEBUG::2013-03-01 13:00:35,500::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-558::INFO::2013-03-01 13:00:35,500::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-558::INFO::2013-03-01 13:00:35,501::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-558::DEBUG::2013-03-01 13:00:35,501::task::1151::TaskManager.Task::(prepare) Task=`b4d09470-272f-47db-8e9c-1bd7b20a2acd`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-558::DEBUG::2013-03-01 13:00:35,501::task::568::TaskManager.Task::(_updateState) Task=`b4d09470-272f-47db-8e9c-1bd7b20a2acd`::moving from state preparing -> state finished >Thread-558::DEBUG::2013-03-01 13:00:35,502::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-558::DEBUG::2013-03-01 13:00:35,502::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-558::DEBUG::2013-03-01 13:00:35,503::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-558::DEBUG::2013-03-01 13:00:35,503::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-558::DEBUG::2013-03-01 13:00:35,503::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-558::DEBUG::2013-03-01 13:00:35,503::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-558::DEBUG::2013-03-01 13:00:35,504::task::957::TaskManager.Task::(_decref) Task=`b4d09470-272f-47db-8e9c-1bd7b20a2acd`::ref 0 aborting False >Thread-559::DEBUG::2013-03-01 13:00:35,554::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-559::DEBUG::2013-03-01 13:00:35,554::task::568::TaskManager.Task::(_updateState) Task=`a6a9dd60-c11a-4dff-b32f-905102c4134d`::moving from state init -> state preparing >Thread-559::INFO::2013-03-01 13:00:35,555::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='f3b854ab-59eb-4cf1-a8e7-3f271a8539c0', spUUID=None, options=None) >Thread-559::DEBUG::2013-03-01 13:00:35,555::taskManager::161::TaskManager::(clearTask) Entry. taskID: f3b854ab-59eb-4cf1-a8e7-3f271a8539c0 >Thread-559::DEBUG::2013-03-01 13:00:35,556::taskManager::166::TaskManager::(clearTask) Return. >Thread-559::INFO::2013-03-01 13:00:35,557::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-559::DEBUG::2013-03-01 13:00:35,557::task::1151::TaskManager.Task::(prepare) Task=`a6a9dd60-c11a-4dff-b32f-905102c4134d`::finished: None >Thread-559::DEBUG::2013-03-01 13:00:35,557::task::568::TaskManager.Task::(_updateState) Task=`a6a9dd60-c11a-4dff-b32f-905102c4134d`::moving from state preparing -> state finished >Thread-559::DEBUG::2013-03-01 13:00:35,557::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-559::DEBUG::2013-03-01 13:00:35,558::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-559::DEBUG::2013-03-01 13:00:35,558::task::957::TaskManager.Task::(_decref) Task=`a6a9dd60-c11a-4dff-b32f-905102c4134d`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:00:35,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:35,736::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292825 s, 14.0 MB/s\n'; <rc> = 0 >Thread-560::DEBUG::2013-03-01 13:00:36,337::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-560::DEBUG::2013-03-01 13:00:36,337::task::568::TaskManager.Task::(_updateState) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::moving from state init -> state preparing >Thread-560::INFO::2013-03-01 13:00:36,338::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='75df5092-6aca-42ec-9cfb-56a127ef2aa5', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-560::INFO::2013-03-01 13:00:36,338::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-560::DEBUG::2013-03-01 13:00:36,339::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-560::DEBUG::2013-03-01 13:00:36,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-560::DEBUG::2013-03-01 13:00:36,581::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-560::DEBUG::2013-03-01 13:00:36,582::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-560::DEBUG::2013-03-01 13:00:36,582::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-560::DEBUG::2013-03-01 13:00:36,582::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-560::DEBUG::2013-03-01 13:00:36,583::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-560::DEBUG::2013-03-01 13:00:36,583::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-560::DEBUG::2013-03-01 13:00:36,828::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-560::DEBUG::2013-03-01 13:00:36,830::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-560::DEBUG::2013-03-01 13:00:36,831::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-560::DEBUG::2013-03-01 13:00:36,832::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`132d7d85-9f36-406b-aa39-f62d6122e7c7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-560::DEBUG::2013-03-01 13:00:36,833::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-560::DEBUG::2013-03-01 13:00:36,833::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-560::DEBUG::2013-03-01 13:00:36,833::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`132d7d85-9f36-406b-aa39-f62d6122e7c7`::Granted request >Thread-560::DEBUG::2013-03-01 13:00:36,834::task::794::TaskManager.Task::(resourceAcquired) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-560::DEBUG::2013-03-01 13:00:36,834::task::957::TaskManager.Task::(_decref) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::ref 1 aborting False >Thread-560::DEBUG::2013-03-01 13:00:36,836::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >Thread-560::DEBUG::2013-03-01 13:00:36,843::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 7a299c41-6f96-4b93-b76d-796e99182815 >Thread-560::INFO::2013-03-01 13:00:36,843::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-560::DEBUG::2013-03-01 13:00:36,843::task::1146::TaskManager.Task::(prepare) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::Prepare: 1 jobs exist, move to acquiring >Thread-560::DEBUG::2013-03-01 13:00:36,844::task::568::TaskManager.Task::(_updateState) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::moving from state preparing -> state acquiring >Thread-560::DEBUG::2013-03-01 13:00:36,845::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >Thread-560::DEBUG::2013-03-01 13:00:36,852::task::568::TaskManager.Task::(_updateState) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::moving from state acquiring -> state queued >Thread-560::DEBUG::2013-03-01 13:00:36,853::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >Thread-560::DEBUG::2013-03-01 13:00:36,860::taskManager::50::TaskManager::(_queueTask) queuing task: 7a299c41-6f96-4b93-b76d-796e99182815 >f3b854ab-59eb-4cf1-a8e7-3f271a8539c0::DEBUG::2013-03-01 13:00:36,861::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-560::DEBUG::2013-03-01 13:00:36,861::taskManager::56::TaskManager::(_queueTask) task queued: 7a299c41-6f96-4b93-b76d-796e99182815 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,862::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 7a299c41-6f96-4b93-b76d-796e99182815 running: <bound method Task.commit of <storage.task.Task instance at 0x16e9518>> with: None >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,864::task::1159::TaskManager.Task::(commit) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::committing task: 7a299c41-6f96-4b93-b76d-796e99182815 >Thread-560::DEBUG::2013-03-01 13:00:36,864::task::1148::TaskManager.Task::(prepare) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::returning >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,866::task::568::TaskManager.Task::(_updateState) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::moving from state queued -> state running >Thread-560::DEBUG::2013-03-01 13:00:36,867::task::957::TaskManager.Task::(_decref) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::ref 1 aborting False >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,870::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,881::task::872::TaskManager.Task::(_runJobs) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a634d930-00cd-440a-887c-5b4d9418c125', 12582912, 4, 2, 2, '75df5092-6aca-42ec-9cfb-56a127ef2aa5', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,881::task::304::TaskManager.Task::(run) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a634d930-00cd-440a-887c-5b4d9418c125', 12582912, 4, 2, 2, '75df5092-6aca-42ec-9cfb-56a127ef2aa5', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,882::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`e9730c6f-411e-49ef-975e-4af65012a4a2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,882::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' for lock type 'exclusive' >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,883::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:36,884::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:37,091::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,148::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,185::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,188::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image a634d930-00cd-440a-887c-5b4d9418c125 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,190::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' is free. Now locking as 'exclusive' (1 active user) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,192::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`e9730c6f-411e-49ef-975e-4af65012a4a2`::Granted request >7a299c41-6f96-4b93-b76d-796e99182815::INFO::2013-03-01 13:00:37,198::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125 for image's volumes >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,203::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,241::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,245::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:37,317::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151065 s, 6.8 MB/s\n'; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,436::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,446::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::WARNING::2013-03-01 13:00:37,446::lvm::593::Storage.LVM::(getLv) lv: 75df5092-6aca-42ec-9cfb-56a127ef2aa5 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >7a299c41-6f96-4b93-b76d-796e99182815::INFO::2013-03-01 13:00:37,446::volume::457::Storage.Volume::(create) Creating volume 75df5092-6aca-42ec-9cfb-56a127ef2aa5 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,447::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,459::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:37,469::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 75df5092-6aca-42ec-9cfb-56a127ef2aa5 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,068::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,069::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,070::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,070::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,070::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::INFO::2013-03-01 13:00:39,072::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 with size = 12582912 sectors >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,072::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 6291456K' (cwd None) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,084::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,085::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,086::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,279::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,292::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::WARNING::2013-03-01 13:00:39,293::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,293::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 8 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,294::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_a634d930-00cd-440a-887c-5b4d9418c125 --addtag MD_8 a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:39,331::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:39,416::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039685 s, 25.8 MB/s\n'; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,505::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,506::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,507::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,508::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5' (cwd None) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,714::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,715::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,716::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,717::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,729::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=75df5092-6aca-42ec-9cfb-56a127ef2aa5 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,734::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,743::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,744::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' (0 active users) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,744::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' is free, finding out if anyone is waiting for it. >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,744::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125', Clearing records. >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,745::task::568::TaskManager.Task::(_updateState) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::moving from state running -> state finished >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,745::task::719::TaskManager.Task::(_save) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7a299c41-6f96-4b93-b76d-796e99182815.temp >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,755::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,755::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,756::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,756::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,756::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,757::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,757::task::880::TaskManager.Task::(_runJobs) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::Task.run: exit - success: result {'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5'} >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,757::task::957::TaskManager.Task::(_decref) Task=`7a299c41-6f96-4b93-b76d-796e99182815`::ref 0 aborting False >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:00:39,758::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:00:41,430::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:41,538::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444156 s, 23.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:41,963::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:00:41,964::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:42,321::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:42,323::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:00:42,324::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:42,337::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000376321 s, 10.9 MB/s\n'; <rc> = 0 >Thread-564::DEBUG::2013-03-01 13:00:43,399::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-564::DEBUG::2013-03-01 13:00:43,399::task::568::TaskManager.Task::(_updateState) Task=`c353a233-773b-45f3-b953-24b50d0ec454`::moving from state init -> state preparing >Thread-564::INFO::2013-03-01 13:00:43,400::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-564::INFO::2013-03-01 13:00:43,400::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-564::DEBUG::2013-03-01 13:00:43,401::task::1151::TaskManager.Task::(prepare) Task=`c353a233-773b-45f3-b953-24b50d0ec454`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-564::DEBUG::2013-03-01 13:00:43,401::task::568::TaskManager.Task::(_updateState) Task=`c353a233-773b-45f3-b953-24b50d0ec454`::moving from state preparing -> state finished >Thread-564::DEBUG::2013-03-01 13:00:43,401::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-564::DEBUG::2013-03-01 13:00:43,401::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-564::DEBUG::2013-03-01 13:00:43,402::task::957::TaskManager.Task::(_decref) Task=`c353a233-773b-45f3-b953-24b50d0ec454`::ref 0 aborting False >Thread-565::DEBUG::2013-03-01 13:00:43,427::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-565::DEBUG::2013-03-01 13:00:43,427::task::568::TaskManager.Task::(_updateState) Task=`072a8a06-0b26-4397-b33e-ff16ef8173d0`::moving from state init -> state preparing >Thread-565::INFO::2013-03-01 13:00:43,427::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-565::DEBUG::2013-03-01 13:00:43,428::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`261665d2-a14a-40ae-8a76-0da4b82e0a67`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-565::DEBUG::2013-03-01 13:00:43,428::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-565::DEBUG::2013-03-01 13:00:43,429::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-565::DEBUG::2013-03-01 13:00:43,429::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`261665d2-a14a-40ae-8a76-0da4b82e0a67`::Granted request >Thread-565::DEBUG::2013-03-01 13:00:43,430::task::794::TaskManager.Task::(resourceAcquired) Task=`072a8a06-0b26-4397-b33e-ff16ef8173d0`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-565::DEBUG::2013-03-01 13:00:43,430::task::957::TaskManager.Task::(_decref) Task=`072a8a06-0b26-4397-b33e-ff16ef8173d0`::ref 1 aborting False >Thread-565::INFO::2013-03-01 13:00:43,431::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-565::DEBUG::2013-03-01 13:00:43,432::task::1151::TaskManager.Task::(prepare) Task=`072a8a06-0b26-4397-b33e-ff16ef8173d0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-565::DEBUG::2013-03-01 13:00:43,432::task::568::TaskManager.Task::(_updateState) Task=`072a8a06-0b26-4397-b33e-ff16ef8173d0`::moving from state preparing -> state finished >Thread-565::DEBUG::2013-03-01 13:00:43,432::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-565::DEBUG::2013-03-01 13:00:43,433::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-565::DEBUG::2013-03-01 13:00:43,433::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-565::DEBUG::2013-03-01 13:00:43,433::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-565::DEBUG::2013-03-01 13:00:43,434::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-565::DEBUG::2013-03-01 13:00:43,434::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-565::DEBUG::2013-03-01 13:00:43,434::task::957::TaskManager.Task::(_decref) Task=`072a8a06-0b26-4397-b33e-ff16ef8173d0`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:43,558::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:43,662::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492095 s, 20.8 MB/s\n'; <rc> = 0 >Thread-566::DEBUG::2013-03-01 13:00:44,899::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-566::DEBUG::2013-03-01 13:00:44,900::task::568::TaskManager.Task::(_updateState) Task=`694a4dbd-c008-4847-b5a7-d1aa48089024`::moving from state init -> state preparing >Thread-566::INFO::2013-03-01 13:00:44,900::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-566::DEBUG::2013-03-01 13:00:44,900::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-566::DEBUG::2013-03-01 13:00:44,900::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7a299c41-6f96-4b93-b76d-796e99182815 >Thread-566::DEBUG::2013-03-01 13:00:44,901::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a299c41-6f96-4b93-b76d-796e99182815'} >Thread-566::DEBUG::2013-03-01 13:00:44,901::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7a299c41-6f96-4b93-b76d-796e99182815': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a299c41-6f96-4b93-b76d-796e99182815'}} >Thread-566::INFO::2013-03-01 13:00:44,901::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7a299c41-6f96-4b93-b76d-796e99182815': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a299c41-6f96-4b93-b76d-796e99182815'}}} >Thread-566::DEBUG::2013-03-01 13:00:44,901::task::1151::TaskManager.Task::(prepare) Task=`694a4dbd-c008-4847-b5a7-d1aa48089024`::finished: {'allTasksStatus': {'7a299c41-6f96-4b93-b76d-796e99182815': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a299c41-6f96-4b93-b76d-796e99182815'}}} >Thread-566::DEBUG::2013-03-01 13:00:44,902::task::568::TaskManager.Task::(_updateState) Task=`694a4dbd-c008-4847-b5a7-d1aa48089024`::moving from state preparing -> state finished >Thread-566::DEBUG::2013-03-01 13:00:44,902::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-566::DEBUG::2013-03-01 13:00:44,902::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-566::DEBUG::2013-03-01 13:00:44,902::task::957::TaskManager.Task::(_decref) Task=`694a4dbd-c008-4847-b5a7-d1aa48089024`::ref 0 aborting False >Thread-567::DEBUG::2013-03-01 13:00:44,952::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-567::DEBUG::2013-03-01 13:00:44,953::task::568::TaskManager.Task::(_updateState) Task=`2f2c591c-cfcd-4cab-90a3-82cc44c63ced`::moving from state init -> state preparing >Thread-567::INFO::2013-03-01 13:00:44,953::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', volUUID='75df5092-6aca-42ec-9cfb-56a127ef2aa5', options=None) >Thread-567::DEBUG::2013-03-01 13:00:44,954::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`b18dd3ef-3786-47e5-8956-5ef709e1d029`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-567::DEBUG::2013-03-01 13:00:44,954::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-567::DEBUG::2013-03-01 13:00:44,954::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-567::DEBUG::2013-03-01 13:00:44,954::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`b18dd3ef-3786-47e5-8956-5ef709e1d029`::Granted request >Thread-567::DEBUG::2013-03-01 13:00:44,955::task::794::TaskManager.Task::(resourceAcquired) Task=`2f2c591c-cfcd-4cab-90a3-82cc44c63ced`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-567::DEBUG::2013-03-01 13:00:44,955::task::957::TaskManager.Task::(_decref) Task=`2f2c591c-cfcd-4cab-90a3-82cc44c63ced`::ref 1 aborting False >Thread-567::DEBUG::2013-03-01 13:00:44,956::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-567::DEBUG::2013-03-01 13:00:44,957::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-567::DEBUG::2013-03-01 13:00:45,159::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-567::DEBUG::2013-03-01 13:00:45,172::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-567::INFO::2013-03-01 13:00:45,172::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 volUUID = 75df5092-6aca-42ec-9cfb-56a127ef2aa5 >Thread-567::DEBUG::2013-03-01 13:00:45,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-567::DEBUG::2013-03-01 13:00:45,183::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299828 s, 1.7 MB/s\n'; <rc> = 0 >Thread-567::DEBUG::2013-03-01 13:00:45,183::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299828 s, 1.7 MB/s'], size: 512 >Thread-567::DEBUG::2013-03-01 13:00:45,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-567::DEBUG::2013-03-01 13:00:45,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031217 s, 1.6 MB/s\n'; <rc> = 0 >Thread-567::DEBUG::2013-03-01 13:00:45,194::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031217 s, 1.6 MB/s'], size: 512 >Thread-567::DEBUG::2013-03-01 13:00:45,195::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-567::DEBUG::2013-03-01 13:00:45,196::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-567::DEBUG::2013-03-01 13:00:45,409::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-567::DEBUG::2013-03-01 13:00:45,418::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-567::INFO::2013-03-01 13:00:45,419::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-567::INFO::2013-03-01 13:00:45,419::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-567::DEBUG::2013-03-01 13:00:45,419::task::1151::TaskManager.Task::(prepare) Task=`2f2c591c-cfcd-4cab-90a3-82cc44c63ced`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-567::DEBUG::2013-03-01 13:00:45,420::task::568::TaskManager.Task::(_updateState) Task=`2f2c591c-cfcd-4cab-90a3-82cc44c63ced`::moving from state preparing -> state finished >Thread-567::DEBUG::2013-03-01 13:00:45,420::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-567::DEBUG::2013-03-01 13:00:45,420::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-567::DEBUG::2013-03-01 13:00:45,420::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-567::DEBUG::2013-03-01 13:00:45,421::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-567::DEBUG::2013-03-01 13:00:45,421::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-567::DEBUG::2013-03-01 13:00:45,421::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-567::DEBUG::2013-03-01 13:00:45,421::task::957::TaskManager.Task::(_decref) Task=`2f2c591c-cfcd-4cab-90a3-82cc44c63ced`::ref 0 aborting False >Thread-568::DEBUG::2013-03-01 13:00:45,477::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-568::DEBUG::2013-03-01 13:00:45,478::task::568::TaskManager.Task::(_updateState) Task=`729e02c4-b521-4cd0-8dd3-23cb7601b5b2`::moving from state init -> state preparing >Thread-568::INFO::2013-03-01 13:00:45,478::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='7a299c41-6f96-4b93-b76d-796e99182815', spUUID=None, options=None) >Thread-568::DEBUG::2013-03-01 13:00:45,479::taskManager::161::TaskManager::(clearTask) Entry. taskID: 7a299c41-6f96-4b93-b76d-796e99182815 >Thread-568::DEBUG::2013-03-01 13:00:45,480::taskManager::166::TaskManager::(clearTask) Return. >Thread-568::INFO::2013-03-01 13:00:45,480::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-568::DEBUG::2013-03-01 13:00:45,480::task::1151::TaskManager.Task::(prepare) Task=`729e02c4-b521-4cd0-8dd3-23cb7601b5b2`::finished: None >Thread-568::DEBUG::2013-03-01 13:00:45,481::task::568::TaskManager.Task::(_updateState) Task=`729e02c4-b521-4cd0-8dd3-23cb7601b5b2`::moving from state preparing -> state finished >Thread-568::DEBUG::2013-03-01 13:00:45,481::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-568::DEBUG::2013-03-01 13:00:45,481::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-568::DEBUG::2013-03-01 13:00:45,481::task::957::TaskManager.Task::(_decref) Task=`729e02c4-b521-4cd0-8dd3-23cb7601b5b2`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:45,678::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:45,741::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:45,766::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319709 s, 12.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:45,825::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492321 s, 20.8 MB/s\n'; <rc> = 0 >Thread-569::DEBUG::2013-03-01 13:00:45,875::task::568::TaskManager.Task::(_updateState) Task=`0ce9d5c0-fe58-4170-b0c8-649757bbaf76`::moving from state init -> state preparing >Thread-569::INFO::2013-03-01 13:00:45,875::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-569::INFO::2013-03-01 13:00:45,875::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0297920703888', 'lastCheck': '0.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0133409500122', 'lastCheck': '3.5', 'code': 0, 'valid': True}} >Thread-569::DEBUG::2013-03-01 13:00:45,876::task::1151::TaskManager.Task::(prepare) Task=`0ce9d5c0-fe58-4170-b0c8-649757bbaf76`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0297920703888', 'lastCheck': '0.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0133409500122', 'lastCheck': '3.5', 'code': 0, 'valid': True}} >Thread-569::DEBUG::2013-03-01 13:00:45,876::task::568::TaskManager.Task::(_updateState) Task=`0ce9d5c0-fe58-4170-b0c8-649757bbaf76`::moving from state preparing -> state finished >Thread-569::DEBUG::2013-03-01 13:00:45,876::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-569::DEBUG::2013-03-01 13:00:45,877::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-569::DEBUG::2013-03-01 13:00:45,877::task::957::TaskManager.Task::(_decref) Task=`0ce9d5c0-fe58-4170-b0c8-649757bbaf76`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:47,844::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:47,937::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041698 s, 24.6 MB/s\n'; <rc> = 0 >Thread-571::DEBUG::2013-03-01 13:00:48,778::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-571::DEBUG::2013-03-01 13:00:48,779::task::568::TaskManager.Task::(_updateState) Task=`4025562b-32ff-461f-a001-06d24c264ae4`::moving from state init -> state preparing >Thread-571::INFO::2013-03-01 13:00:48,779::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', volUUID='75df5092-6aca-42ec-9cfb-56a127ef2aa5', options=None) >Thread-571::DEBUG::2013-03-01 13:00:48,780::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e3f30720-dce5-4298-9a97-fb607af14993`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-571::DEBUG::2013-03-01 13:00:48,780::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-571::DEBUG::2013-03-01 13:00:48,781::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-571::DEBUG::2013-03-01 13:00:48,781::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e3f30720-dce5-4298-9a97-fb607af14993`::Granted request >Thread-571::DEBUG::2013-03-01 13:00:48,782::task::794::TaskManager.Task::(resourceAcquired) Task=`4025562b-32ff-461f-a001-06d24c264ae4`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-571::DEBUG::2013-03-01 13:00:48,782::task::957::TaskManager.Task::(_decref) Task=`4025562b-32ff-461f-a001-06d24c264ae4`::ref 1 aborting False >Thread-571::INFO::2013-03-01 13:00:48,783::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 volUUID = 75df5092-6aca-42ec-9cfb-56a127ef2aa5 >Thread-571::DEBUG::2013-03-01 13:00:48,783::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-571::DEBUG::2013-03-01 13:00:48,793::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000348204 s, 1.5 MB/s\n'; <rc> = 0 >Thread-571::DEBUG::2013-03-01 13:00:48,794::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000348204 s, 1.5 MB/s'], size: 512 >Thread-571::DEBUG::2013-03-01 13:00:48,795::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-571::DEBUG::2013-03-01 13:00:48,805::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000361636 s, 1.4 MB/s\n'; <rc> = 0 >Thread-571::DEBUG::2013-03-01 13:00:48,805::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000361636 s, 1.4 MB/s'], size: 512 >Thread-571::DEBUG::2013-03-01 13:00:48,806::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-571::DEBUG::2013-03-01 13:00:48,807::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-571::DEBUG::2013-03-01 13:00:48,998::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-571::DEBUG::2013-03-01 13:00:49,009::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-571::INFO::2013-03-01 13:00:49,010::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-571::INFO::2013-03-01 13:00:49,010::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-571::DEBUG::2013-03-01 13:00:49,010::task::1151::TaskManager.Task::(prepare) Task=`4025562b-32ff-461f-a001-06d24c264ae4`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-571::DEBUG::2013-03-01 13:00:49,010::task::568::TaskManager.Task::(_updateState) Task=`4025562b-32ff-461f-a001-06d24c264ae4`::moving from state preparing -> state finished >Thread-571::DEBUG::2013-03-01 13:00:49,010::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-571::DEBUG::2013-03-01 13:00:49,011::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-571::DEBUG::2013-03-01 13:00:49,011::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-571::DEBUG::2013-03-01 13:00:49,011::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-571::DEBUG::2013-03-01 13:00:49,011::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-571::DEBUG::2013-03-01 13:00:49,012::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-571::DEBUG::2013-03-01 13:00:49,012::task::957::TaskManager.Task::(_decref) Task=`4025562b-32ff-461f-a001-06d24c264ae4`::ref 0 aborting False >Thread-573::DEBUG::2013-03-01 13:00:49,040::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-573::DEBUG::2013-03-01 13:00:49,040::task::568::TaskManager.Task::(_updateState) Task=`8684ced5-b761-4ed2-a599-e12c84bf4629`::moving from state init -> state preparing >Thread-573::INFO::2013-03-01 13:00:49,041::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', volUUID='8eaab457-8f02-4cff-9544-73d4e44a54e2', options=None) >Thread-573::DEBUG::2013-03-01 13:00:49,041::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`2336126e-2512-4c47-8d8e-acfe96e0fd43`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-573::DEBUG::2013-03-01 13:00:49,041::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-573::DEBUG::2013-03-01 13:00:49,042::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-573::DEBUG::2013-03-01 13:00:49,042::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`2336126e-2512-4c47-8d8e-acfe96e0fd43`::Granted request >Thread-573::DEBUG::2013-03-01 13:00:49,043::task::794::TaskManager.Task::(resourceAcquired) Task=`8684ced5-b761-4ed2-a599-e12c84bf4629`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-573::DEBUG::2013-03-01 13:00:49,043::task::957::TaskManager.Task::(_decref) Task=`8684ced5-b761-4ed2-a599-e12c84bf4629`::ref 1 aborting False >Thread-573::INFO::2013-03-01 13:00:49,043::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 volUUID = 8eaab457-8f02-4cff-9544-73d4e44a54e2 >Thread-573::DEBUG::2013-03-01 13:00:49,044::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-573::DEBUG::2013-03-01 13:00:49,054::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000344609 s, 1.5 MB/s\n'; <rc> = 0 >Thread-573::DEBUG::2013-03-01 13:00:49,054::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000344609 s, 1.5 MB/s'], size: 512 >Thread-573::DEBUG::2013-03-01 13:00:49,055::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-573::DEBUG::2013-03-01 13:00:49,065::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000347164 s, 1.5 MB/s\n'; <rc> = 0 >Thread-573::DEBUG::2013-03-01 13:00:49,066::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000347164 s, 1.5 MB/s'], size: 512 >Thread-573::DEBUG::2013-03-01 13:00:49,066::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-573::DEBUG::2013-03-01 13:00:49,067::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-573::DEBUG::2013-03-01 13:00:49,258::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-573::DEBUG::2013-03-01 13:00:49,269::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-573::INFO::2013-03-01 13:00:49,269::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-573::INFO::2013-03-01 13:00:49,270::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-573::DEBUG::2013-03-01 13:00:49,270::task::1151::TaskManager.Task::(prepare) Task=`8684ced5-b761-4ed2-a599-e12c84bf4629`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-573::DEBUG::2013-03-01 13:00:49,270::task::568::TaskManager.Task::(_updateState) Task=`8684ced5-b761-4ed2-a599-e12c84bf4629`::moving from state preparing -> state finished >Thread-573::DEBUG::2013-03-01 13:00:49,270::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-573::DEBUG::2013-03-01 13:00:49,270::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-573::DEBUG::2013-03-01 13:00:49,271::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-573::DEBUG::2013-03-01 13:00:49,271::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-573::DEBUG::2013-03-01 13:00:49,271::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-573::DEBUG::2013-03-01 13:00:49,271::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-573::DEBUG::2013-03-01 13:00:49,272::task::957::TaskManager.Task::(_decref) Task=`8684ced5-b761-4ed2-a599-e12c84bf4629`::ref 0 aborting False >Thread-574::DEBUG::2013-03-01 13:00:49,359::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-574::DEBUG::2013-03-01 13:00:49,360::task::568::TaskManager.Task::(_updateState) Task=`86ae887a-5591-474a-ace6-7c23bb413983`::moving from state init -> state preparing >Thread-574::INFO::2013-03-01 13:00:49,360::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', volUUID='75df5092-6aca-42ec-9cfb-56a127ef2aa5', options=None) >Thread-574::DEBUG::2013-03-01 13:00:49,361::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`cba0c64f-b013-44ee-801d-aeae21b782d8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-574::DEBUG::2013-03-01 13:00:49,361::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-574::DEBUG::2013-03-01 13:00:49,362::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-574::DEBUG::2013-03-01 13:00:49,362::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`cba0c64f-b013-44ee-801d-aeae21b782d8`::Granted request >Thread-574::DEBUG::2013-03-01 13:00:49,363::task::794::TaskManager.Task::(resourceAcquired) Task=`86ae887a-5591-474a-ace6-7c23bb413983`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-574::DEBUG::2013-03-01 13:00:49,363::task::957::TaskManager.Task::(_decref) Task=`86ae887a-5591-474a-ace6-7c23bb413983`::ref 1 aborting False >Thread-574::INFO::2013-03-01 13:00:49,363::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 volUUID = 75df5092-6aca-42ec-9cfb-56a127ef2aa5 >Thread-574::DEBUG::2013-03-01 13:00:49,364::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-574::DEBUG::2013-03-01 13:00:49,374::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000368911 s, 1.4 MB/s\n'; <rc> = 0 >Thread-574::DEBUG::2013-03-01 13:00:49,374::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000368911 s, 1.4 MB/s'], size: 512 >Thread-574::DEBUG::2013-03-01 13:00:49,375::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-574::DEBUG::2013-03-01 13:00:49,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000368854 s, 1.4 MB/s\n'; <rc> = 0 >Thread-574::DEBUG::2013-03-01 13:00:49,386::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000368854 s, 1.4 MB/s'], size: 512 >Thread-574::DEBUG::2013-03-01 13:00:49,386::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-574::DEBUG::2013-03-01 13:00:49,387::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-574::DEBUG::2013-03-01 13:00:49,634::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-574::DEBUG::2013-03-01 13:00:49,649::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-574::INFO::2013-03-01 13:00:49,650::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-574::INFO::2013-03-01 13:00:49,650::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-574::DEBUG::2013-03-01 13:00:49,651::task::1151::TaskManager.Task::(prepare) Task=`86ae887a-5591-474a-ace6-7c23bb413983`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135639', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135639', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-574::DEBUG::2013-03-01 13:00:49,651::task::568::TaskManager.Task::(_updateState) Task=`86ae887a-5591-474a-ace6-7c23bb413983`::moving from state preparing -> state finished >Thread-574::DEBUG::2013-03-01 13:00:49,651::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-574::DEBUG::2013-03-01 13:00:49,652::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-574::DEBUG::2013-03-01 13:00:49,652::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-574::DEBUG::2013-03-01 13:00:49,652::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-574::DEBUG::2013-03-01 13:00:49,653::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-574::DEBUG::2013-03-01 13:00:49,653::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-574::DEBUG::2013-03-01 13:00:49,654::task::957::TaskManager.Task::(_decref) Task=`86ae887a-5591-474a-ace6-7c23bb413983`::ref 0 aborting False >Thread-575::DEBUG::2013-03-01 13:00:49,684::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-575::DEBUG::2013-03-01 13:00:49,685::task::568::TaskManager.Task::(_updateState) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::moving from state init -> state preparing >Thread-575::INFO::2013-03-01 13:00:49,686::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='673701ef-131b-4e14-84ef-1e03e542b4b8', desc='', srcImgUUID='a634d930-00cd-440a-887c-5b4d9418c125', srcVolUUID='75df5092-6aca-42ec-9cfb-56a127ef2aa5') >Thread-575::INFO::2013-03-01 13:00:49,686::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-575::DEBUG::2013-03-01 13:00:49,687::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-575::DEBUG::2013-03-01 13:00:49,933::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-575::DEBUG::2013-03-01 13:00:49,934::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-575::DEBUG::2013-03-01 13:00:49,935::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-575::DEBUG::2013-03-01 13:00:49,935::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-575::DEBUG::2013-03-01 13:00:49,935::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-575::DEBUG::2013-03-01 13:00:49,936::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-575::DEBUG::2013-03-01 13:00:49,936::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:49,956::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:50,041::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393595 s, 26.0 MB/s\n'; <rc> = 0 >Thread-575::DEBUG::2013-03-01 13:00:50,126::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-575::DEBUG::2013-03-01 13:00:50,128::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-575::DEBUG::2013-03-01 13:00:50,128::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-575::DEBUG::2013-03-01 13:00:50,129::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`140f18d3-8617-44ce-8db9-e95c59850a01`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-575::DEBUG::2013-03-01 13:00:50,129::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-575::DEBUG::2013-03-01 13:00:50,130::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-575::DEBUG::2013-03-01 13:00:50,130::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`140f18d3-8617-44ce-8db9-e95c59850a01`::Granted request >Thread-575::DEBUG::2013-03-01 13:00:50,130::task::794::TaskManager.Task::(resourceAcquired) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-575::DEBUG::2013-03-01 13:00:50,131::task::957::TaskManager.Task::(_decref) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::ref 1 aborting False >Thread-575::DEBUG::2013-03-01 13:00:50,132::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >Thread-575::DEBUG::2013-03-01 13:00:50,137::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task f7474b2c-7aa3-420d-944b-34b792bbd795 >Thread-575::INFO::2013-03-01 13:00:50,137::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-575::DEBUG::2013-03-01 13:00:50,138::task::1146::TaskManager.Task::(prepare) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::Prepare: 1 jobs exist, move to acquiring >Thread-575::DEBUG::2013-03-01 13:00:50,138::task::568::TaskManager.Task::(_updateState) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::moving from state preparing -> state acquiring >Thread-575::DEBUG::2013-03-01 13:00:50,138::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >Thread-575::DEBUG::2013-03-01 13:00:50,144::task::568::TaskManager.Task::(_updateState) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::moving from state acquiring -> state queued >Thread-575::DEBUG::2013-03-01 13:00:50,144::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >Thread-575::DEBUG::2013-03-01 13:00:50,150::taskManager::50::TaskManager::(_queueTask) queuing task: f7474b2c-7aa3-420d-944b-34b792bbd795 >Thread-575::DEBUG::2013-03-01 13:00:50,150::taskManager::56::TaskManager::(_queueTask) task queued: f7474b2c-7aa3-420d-944b-34b792bbd795 >e6b13302-0d36-43bc-ae19-2081d75c64f9::DEBUG::2013-03-01 13:00:50,150::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,152::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: f7474b2c-7aa3-420d-944b-34b792bbd795 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c012d098>> with: None >Thread-575::DEBUG::2013-03-01 13:00:50,152::task::1148::TaskManager.Task::(prepare) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::returning >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,153::task::1159::TaskManager.Task::(commit) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::committing task: f7474b2c-7aa3-420d-944b-34b792bbd795 >Thread-575::DEBUG::2013-03-01 13:00:50,154::task::957::TaskManager.Task::(_decref) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::ref 0 aborting False >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,154::task::568::TaskManager.Task::(_updateState) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::moving from state queued -> state running >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,159::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,166::task::872::TaskManager.Task::(_runJobs) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a634d930-00cd-440a-887c-5b4d9418c125', 12582912, 4, 2, 2, '673701ef-131b-4e14-84ef-1e03e542b4b8', '', 'a634d930-00cd-440a-887c-5b4d9418c125', '75df5092-6aca-42ec-9cfb-56a127ef2aa5') kwargs: {}) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,166::task::304::TaskManager.Task::(run) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a634d930-00cd-440a-887c-5b4d9418c125', 12582912, 4, 2, 2, '673701ef-131b-4e14-84ef-1e03e542b4b8', '', 'a634d930-00cd-440a-887c-5b4d9418c125', '75df5092-6aca-42ec-9cfb-56a127ef2aa5') kwargs: {}) callback None >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,167::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`726a616e-cf49-4a39-add0-9de8702848b4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,167::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' for lock type 'exclusive' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,168::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,169::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-576::DEBUG::2013-03-01 13:00:50,208::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-576::DEBUG::2013-03-01 13:00:50,209::task::568::TaskManager.Task::(_updateState) Task=`02f74ea8-b19c-4def-8afa-2fb05e2685db`::moving from state init -> state preparing >Thread-576::INFO::2013-03-01 13:00:50,210::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', volUUID='8eaab457-8f02-4cff-9544-73d4e44a54e2', options=None) >Thread-576::DEBUG::2013-03-01 13:00:50,210::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1b69731a-40d4-416e-838b-97cb24c1e9bc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-576::DEBUG::2013-03-01 13:00:50,211::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-576::DEBUG::2013-03-01 13:00:50,211::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-576::DEBUG::2013-03-01 13:00:50,211::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1b69731a-40d4-416e-838b-97cb24c1e9bc`::Granted request >Thread-576::DEBUG::2013-03-01 13:00:50,212::task::794::TaskManager.Task::(resourceAcquired) Task=`02f74ea8-b19c-4def-8afa-2fb05e2685db`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-576::DEBUG::2013-03-01 13:00:50,212::task::957::TaskManager.Task::(_decref) Task=`02f74ea8-b19c-4def-8afa-2fb05e2685db`::ref 1 aborting False >Thread-576::DEBUG::2013-03-01 13:00:50,213::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-576::DEBUG::2013-03-01 13:00:50,214::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,363::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,379::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,388::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000272287 s, 1.9 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,389::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000272287 s, 1.9 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,403::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299062 s, 1.7 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,405::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299062 s, 1.7 MB/s'], size: 512 >Thread-576::DEBUG::2013-03-01 13:00:50,406::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::INFO::2013-03-01 13:00:50,407::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec155310>] >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,412::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`fd0e2d53-29b2-4d3a-9ad7-66c5b24b4415`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,417::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' for lock type 'exclusive' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,420::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free. Now locking as 'exclusive' (1 active user) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,423::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`fd0e2d53-29b2-4d3a-9ad7-66c5b24b4415`::Granted request >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,428::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' is free. Now locking as 'exclusive' (1 active user) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,432::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`726a616e-cf49-4a39-add0-9de8702848b4`::Granted request >Thread-576::DEBUG::2013-03-01 13:00:50,436::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-576::INFO::2013-03-01 13:00:50,438::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 volUUID = 8eaab457-8f02-4cff-9544-73d4e44a54e2 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,439::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-576::DEBUG::2013-03-01 13:00:50,440::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-576::DEBUG::2013-03-01 13:00:50,467::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000368399 s, 1.4 MB/s\n'; <rc> = 0 >Thread-576::DEBUG::2013-03-01 13:00:50,468::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000368399 s, 1.4 MB/s'], size: 512 >Thread-576::DEBUG::2013-03-01 13:00:50,470::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-576::DEBUG::2013-03-01 13:00:50,479::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000292183 s, 1.8 MB/s\n'; <rc> = 0 >Thread-576::DEBUG::2013-03-01 13:00:50,480::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000292183 s, 1.8 MB/s'], size: 512 >Thread-576::DEBUG::2013-03-01 13:00:50,480::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-576::DEBUG::2013-03-01 13:00:50,481::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,646::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::WARNING::2013-03-01 13:00:50,656::lvm::593::Storage.LVM::(getLv) lv: 673701ef-131b-4e14-84ef-1e03e542b4b8 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,656::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,666::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000284602 s, 1.8 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,666::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000284602 s, 1.8 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,667::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-576::DEBUG::2013-03-01 13:00:50,682::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,688::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339829 s, 1.5 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,691::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339829 s, 1.5 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::INFO::2013-03-01 13:00:50,694::volume::457::Storage.Volume::(create) Creating volume 673701ef-131b-4e14-84ef-1e03e542b4b8 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,700::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >Thread-576::DEBUG::2013-03-01 13:00:50,715::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-576::INFO::2013-03-01 13:00:50,718::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-576::INFO::2013-03-01 13:00:50,718::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-576::DEBUG::2013-03-01 13:00:50,720::task::1151::TaskManager.Task::(prepare) Task=`02f74ea8-b19c-4def-8afa-2fb05e2685db`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135628', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135628', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-576::DEBUG::2013-03-01 13:00:50,721::task::568::TaskManager.Task::(_updateState) Task=`02f74ea8-b19c-4def-8afa-2fb05e2685db`::moving from state preparing -> state finished >Thread-576::DEBUG::2013-03-01 13:00:50,722::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-576::DEBUG::2013-03-01 13:00:50,723::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-576::DEBUG::2013-03-01 13:00:50,725::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-576::DEBUG::2013-03-01 13:00:50,727::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (1 active users) >Thread-576::DEBUG::2013-03-01 13:00:50,729::task::957::TaskManager.Task::(_decref) Task=`02f74ea8-b19c-4def-8afa-2fb05e2685db`::ref 0 aborting False >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,733::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:50,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 673701ef-131b-4e14-84ef-1e03e542b4b8 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-577::DEBUG::2013-03-01 13:00:50,761::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-577::DEBUG::2013-03-01 13:00:50,763::task::568::TaskManager.Task::(_updateState) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::moving from state init -> state preparing >Thread-577::INFO::2013-03-01 13:00:50,763::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='ab7680c7-9438-42eb-a6c4-29a77fca31ea', desc='', srcImgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', srcVolUUID='8eaab457-8f02-4cff-9544-73d4e44a54e2') >Thread-577::INFO::2013-03-01 13:00:50,764::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-577::DEBUG::2013-03-01 13:00:50,765::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:52,054::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:52,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326986 s, 31.3 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:00:52,343::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:00:52,358::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000387728 s, 10.6 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,451::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,451::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,451::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,452::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,452::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::INFO::2013-03-01 13:00:52,452::blockVolume::182::Storage.Volume::(_create) Request to create snapshot a634d930-00cd-440a-887c-5b4d9418c125/673701ef-131b-4e14-84ef-1e03e542b4b8 of volume a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,453::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,461::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,470::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000285441 s, 1.8 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,470::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000285441 s, 1.8 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,471::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-577::DEBUG::2013-03-01 13:00:52,480::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2013-03-01 13:00:52,483::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-577::DEBUG::2013-03-01 13:00:52,485::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-577::DEBUG::2013-03-01 13:00:52,488::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,491::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00028537 s, 1.8 MB/s\n'; <rc> = 0 >Thread-577::DEBUG::2013-03-01 13:00:52,491::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,492::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00028537 s, 1.8 MB/s'], size: 512 >Thread-577::DEBUG::2013-03-01 13:00:52,494::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,496::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-577::DEBUG::2013-03-01 13:00:52,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,699::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2013-03-01 13:00:52,786::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2013-03-01 13:00:52,787::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-577::DEBUG::2013-03-01 13:00:52,788::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >f7474b2c-7aa3-420d-944b-34b792bbd795::INFO::2013-03-01 13:00:52,789::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5 >Thread-577::DEBUG::2013-03-01 13:00:52,794::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`99fd4486-b2d3-4a06-8d75-8a0d0caad581`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-577::DEBUG::2013-03-01 13:00:52,795::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,795::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-577::DEBUG::2013-03-01 13:00:52,805::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-577::DEBUG::2013-03-01 13:00:52,809::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`99fd4486-b2d3-4a06-8d75-8a0d0caad581`::Granted request >Thread-577::DEBUG::2013-03-01 13:00:52,815::task::794::TaskManager.Task::(resourceAcquired) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-577::DEBUG::2013-03-01 13:00:52,818::task::957::TaskManager.Task::(_decref) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::ref 1 aborting False >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,822::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000351381 s, 1.5 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,824::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000351381 s, 1.5 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,828::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`acc4a833-def4-4cf1-91ed-662dfc2a199c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,829::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' for lock type 'shared' >Thread-577::DEBUG::2013-03-01 13:00:52,832::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:52,837::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5' (cwd None) >Thread-577::DEBUG::2013-03-01 13:00:52,854::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 48229b0d-fd66-42c2-8de4-a18a3c6d685b >Thread-577::INFO::2013-03-01 13:00:52,855::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-577::DEBUG::2013-03-01 13:00:52,855::task::1146::TaskManager.Task::(prepare) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::Prepare: 1 jobs exist, move to acquiring >Thread-577::DEBUG::2013-03-01 13:00:52,855::task::568::TaskManager.Task::(_updateState) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::moving from state preparing -> state acquiring >Thread-577::DEBUG::2013-03-01 13:00:52,856::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >Thread-577::DEBUG::2013-03-01 13:00:52,864::task::568::TaskManager.Task::(_updateState) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::moving from state acquiring -> state queued >Thread-577::DEBUG::2013-03-01 13:00:52,865::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >Thread-577::DEBUG::2013-03-01 13:00:52,872::taskManager::50::TaskManager::(_queueTask) queuing task: 48229b0d-fd66-42c2-8de4-a18a3c6d685b >Thread-577::DEBUG::2013-03-01 13:00:52,872::taskManager::56::TaskManager::(_queueTask) task queued: 48229b0d-fd66-42c2-8de4-a18a3c6d685b >Thread-1::DEBUG::2013-03-01 13:00:52,873::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-577::DEBUG::2013-03-01 13:00:52,874::task::1148::TaskManager.Task::(prepare) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::returning >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,874::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 48229b0d-fd66-42c2-8de4-a18a3c6d685b running: <bound method Task.commit of <storage.task.Task instance at 0x17bafc8>> with: None >Thread-577::DEBUG::2013-03-01 13:00:52,875::task::957::TaskManager.Task::(_decref) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::ref 0 aborting False >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,876::task::1159::TaskManager.Task::(commit) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::committing task: 48229b0d-fd66-42c2-8de4-a18a3c6d685b >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,879::task::568::TaskManager.Task::(_updateState) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::moving from state queued -> state running >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,881::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,887::task::872::TaskManager.Task::(_runJobs) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 12582912, 4, 2, 2, 'ab7680c7-9438-42eb-a6c4-29a77fca31ea', '', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', '8eaab457-8f02-4cff-9544-73d4e44a54e2') kwargs: {}) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,887::task::304::TaskManager.Task::(run) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 12582912, 4, 2, 2, 'ab7680c7-9438-42eb-a6c4-29a77fca31ea', '', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', '8eaab457-8f02-4cff-9544-73d4e44a54e2') kwargs: {}) callback None >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,887::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`9450b4dc-dd81-4564-ad36-ca16deb81648`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,888::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' for lock type 'exclusive' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,888::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:52,889::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,069::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,083::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,083::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000384486 s, 1.3 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,093::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000384486 s, 1.3 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,094::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,104::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000348899 s, 1.5 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,104::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000348899 s, 1.5 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::INFO::2013-03-01 13:00:53,105::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f8099450>] >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,106::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`b04c8128-45af-4db8-8aee-85b367ccfe5b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,106::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' for lock type 'exclusive' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,106::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free. Now locking as 'exclusive' (1 active user) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,107::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`b04c8128-45af-4db8-8aee-85b367ccfe5b`::Granted request >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,107::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free. Now locking as 'exclusive' (1 active user) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,108::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`9450b4dc-dd81-4564-ad36-ca16deb81648`::Granted request >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,109::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,110::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,311::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,322::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::WARNING::2013-03-01 13:00:53,323::lvm::593::Storage.LVM::(getLv) lv: ab7680c7-9438-42eb-a6c4-29a77fca31ea not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,334::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000337006 s, 1.5 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,334::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000337006 s, 1.5 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,335::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,345::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339632 s, 1.5 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,346::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339632 s, 1.5 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::INFO::2013-03-01 13:00:53,346::volume::457::Storage.Volume::(create) Creating volume ab7680c7-9438-42eb-a6c4-29a77fca31ea >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,347::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,356::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:53,366::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name ab7680c7-9438-42eb-a6c4-29a77fca31ea a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-579::DEBUG::2013-03-01 13:00:53,474::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-579::DEBUG::2013-03-01 13:00:53,475::task::568::TaskManager.Task::(_updateState) Task=`425977ae-73e9-430d-9504-e770ab9b3aad`::moving from state init -> state preparing >Thread-579::INFO::2013-03-01 13:00:53,475::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-579::INFO::2013-03-01 13:00:53,476::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-579::DEBUG::2013-03-01 13:00:53,476::task::1151::TaskManager.Task::(prepare) Task=`425977ae-73e9-430d-9504-e770ab9b3aad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-579::DEBUG::2013-03-01 13:00:53,477::task::568::TaskManager.Task::(_updateState) Task=`425977ae-73e9-430d-9504-e770ab9b3aad`::moving from state preparing -> state finished >Thread-579::DEBUG::2013-03-01 13:00:53,477::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-579::DEBUG::2013-03-01 13:00:53,477::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-579::DEBUG::2013-03-01 13:00:53,478::task::957::TaskManager.Task::(_decref) Task=`425977ae-73e9-430d-9504-e770ab9b3aad`::ref 0 aborting False >Thread-580::DEBUG::2013-03-01 13:00:53,502::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-580::DEBUG::2013-03-01 13:00:53,502::task::568::TaskManager.Task::(_updateState) Task=`61622594-2f2c-4ca4-830f-09789f46c805`::moving from state init -> state preparing >Thread-580::INFO::2013-03-01 13:00:53,503::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-580::DEBUG::2013-03-01 13:00:53,503::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2fac4cb1-c63e-4091-b1f7-7c3f8c1ea33b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-580::DEBUG::2013-03-01 13:00:53,503::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-580::DEBUG::2013-03-01 13:00:53,504::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-580::DEBUG::2013-03-01 13:00:53,504::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2fac4cb1-c63e-4091-b1f7-7c3f8c1ea33b`::Granted request >Thread-580::DEBUG::2013-03-01 13:00:53,504::task::794::TaskManager.Task::(resourceAcquired) Task=`61622594-2f2c-4ca4-830f-09789f46c805`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-580::DEBUG::2013-03-01 13:00:53,504::task::957::TaskManager.Task::(_decref) Task=`61622594-2f2c-4ca4-830f-09789f46c805`::ref 1 aborting False >Thread-580::INFO::2013-03-01 13:00:53,506::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-580::DEBUG::2013-03-01 13:00:53,506::task::1151::TaskManager.Task::(prepare) Task=`61622594-2f2c-4ca4-830f-09789f46c805`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-580::DEBUG::2013-03-01 13:00:53,506::task::568::TaskManager.Task::(_updateState) Task=`61622594-2f2c-4ca4-830f-09789f46c805`::moving from state preparing -> state finished >Thread-580::DEBUG::2013-03-01 13:00:53,506::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-580::DEBUG::2013-03-01 13:00:53,506::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-580::DEBUG::2013-03-01 13:00:53,507::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-580::DEBUG::2013-03-01 13:00:53,507::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-580::DEBUG::2013-03-01 13:00:53,507::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-580::DEBUG::2013-03-01 13:00:53,507::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-580::DEBUG::2013-03-01 13:00:53,508::task::957::TaskManager.Task::(_decref) Task=`61622594-2f2c-4ca4-830f-09789f46c805`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:00:54,164::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:54,259::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380015 s, 26.9 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,445::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,445::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,446::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,446::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free. Now locking as 'shared' (1 active user) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,447::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`acc4a833-def4-4cf1-91ed-662dfc2a199c`::Granted request >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,448::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:54,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-581::DEBUG::2013-03-01 13:00:54,940::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-581::DEBUG::2013-03-01 13:00:54,941::task::568::TaskManager.Task::(_updateState) Task=`999da5a3-7750-4f0c-be13-843c4dde4d15`::moving from state init -> state preparing >Thread-581::INFO::2013-03-01 13:00:54,941::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-581::DEBUG::2013-03-01 13:00:54,942::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-581::DEBUG::2013-03-01 13:00:54,942::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 48229b0d-fd66-42c2-8de4-a18a3c6d685b >Thread-581::DEBUG::2013-03-01 13:00:54,942::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'} >Thread-581::DEBUG::2013-03-01 13:00:54,942::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f7474b2c-7aa3-420d-944b-34b792bbd795 >Thread-581::DEBUG::2013-03-01 13:00:54,943::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'} >Thread-581::DEBUG::2013-03-01 13:00:54,943::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'48229b0d-fd66-42c2-8de4-a18a3c6d685b': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'}, 'f7474b2c-7aa3-420d-944b-34b792bbd795': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'}} >Thread-581::INFO::2013-03-01 13:00:54,943::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'48229b0d-fd66-42c2-8de4-a18a3c6d685b': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'}, 'f7474b2c-7aa3-420d-944b-34b792bbd795': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'}}} >Thread-581::DEBUG::2013-03-01 13:00:54,944::task::1151::TaskManager.Task::(prepare) Task=`999da5a3-7750-4f0c-be13-843c4dde4d15`::finished: {'allTasksStatus': {'48229b0d-fd66-42c2-8de4-a18a3c6d685b': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'}, 'f7474b2c-7aa3-420d-944b-34b792bbd795': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'}}} >Thread-581::DEBUG::2013-03-01 13:00:54,944::task::568::TaskManager.Task::(_updateState) Task=`999da5a3-7750-4f0c-be13-843c4dde4d15`::moving from state preparing -> state finished >Thread-581::DEBUG::2013-03-01 13:00:54,944::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-581::DEBUG::2013-03-01 13:00:54,944::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-581::DEBUG::2013-03-01 13:00:54,945::task::957::TaskManager.Task::(_decref) Task=`999da5a3-7750-4f0c-be13-843c4dde4d15`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:00:55,780::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:00:55,992::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00431459 s, 949 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:00:56,275::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:57,647::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.555017 s, 1.8 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,449::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,450::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,479::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,494::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,495::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/673701ef-131b-4e14-84ef-1e03e542b4b8 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,496::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,497::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,507::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,510::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,513::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,516::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308593 s, 1.7 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::INFO::2013-03-01 13:00:58,516::blockVolume::182::Storage.Volume::(_create) Request to create snapshot b4bf0747-2c4c-4d83-9f75-eb83759f5712/ab7680c7-9438-42eb-a6c4-29a77fca31ea of volume b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,517::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308593 s, 1.7 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,521::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,522::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,541::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000294674 s, 1.7 MB/s\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,544::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000294674 s, 1.7 MB/s'], size: 512 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/673701ef-131b-4e14-84ef-1e03e542b4b8' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,569::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::INFO::2013-03-01 13:00:58,571::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5 justme False >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,571::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,572::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' (0 active users) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,572::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free, finding out if anyone is waiting for it. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,575::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,576::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,596::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000325815 s, 1.6 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,596::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000325815 s, 1.6 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,597::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,607::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000306242 s, 1.7 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,607::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000306242 s, 1.7 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::INFO::2013-03-01 13:00:58,608::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,609::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,619::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000586329 s, 873 kB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,619::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000586329 s, 873 kB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,621::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`02bb902a-22a7-4768-8510-59685e9344a3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,621::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' for lock type 'shared' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,790::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,790::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,790::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5', Clearing records. >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,792::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:00:58,796::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:58,805::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,009::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,027::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,027::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,028::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,241::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,255::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::WARNING::2013-03-01 13:00:59,256::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/673701ef-131b-4e14-84ef-1e03e542b4b8 >f7474b2c-7aa3-420d-944b-34b792bbd795::WARNING::2013-03-01 13:00:59,256::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/ab7680c7-9438-42eb-a6c4-29a77fca31ea >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,256::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 9 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:00:59,257::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_75df5092-6aca-42ec-9cfb-56a127ef2aa5 --addtag IU_a634d930-00cd-440a-887c-5b4d9418c125 --addtag MD_9 a558fc2a-a4a3-4118-9b81-d1d601eaa295/673701ef-131b-4e14-84ef-1e03e542b4b8' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:59,723::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:00:59,834::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051814 s, 19.8 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,442::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,442::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,443::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,443::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free. Now locking as 'shared' (1 active user) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,443::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`02bb902a-22a7-4768-8510-59685e9344a3`::Granted request >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,444::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,445::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,482::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,482::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,682::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,699::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,700::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/ab7680c7-9438-42eb-a6c4-29a77fca31ea >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,700::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,703::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,704::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/673701ef-131b-4e14-84ef-1e03e542b4b8' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031067 s, 1.6 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,735::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031067 s, 1.6 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,736::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,746::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316139 s, 1.6 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,746::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316139 s, 1.6 MB/s'], size: 512 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,747::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/ab7680c7-9438-42eb-a6c4-29a77fca31ea' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,761::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::INFO::2013-03-01 13:01:00,761::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2 justme False >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,762::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,762::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' (0 active users) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,762::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free, finding out if anyone is waiting for it. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:00,763::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,976::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,976::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,976::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,977::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,987::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=673701ef-131b-4e14-84ef-1e03e542b4b8 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 9) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:00,993::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,001::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,001::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' (0 active users) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,002::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' is free, finding out if anyone is waiting for it. >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,003::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,004::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,004::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' (0 active users) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,005::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free, finding out if anyone is waiting for it. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,006::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,006::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5', Clearing records. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,008::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,008::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125', Clearing records. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,009::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2', Clearing records. >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,011::task::568::TaskManager.Task::(_updateState) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::moving from state running -> state finished >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,012::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,014::task::719::TaskManager.Task::(_save) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f7474b2c-7aa3-420d-944b-34b792bbd795.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,016::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,035::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,035::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,036::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,036::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (1 active users) >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,037::task::880::TaskManager.Task::(_runJobs) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::Task.run: exit - success: result {'uuid': '673701ef-131b-4e14-84ef-1e03e542b4b8'} >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,037::task::957::TaskManager.Task::(_decref) Task=`f7474b2c-7aa3-420d-944b-34b792bbd795`::ref 0 aborting False >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:01,037::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-584::DEBUG::2013-03-01 13:01:01,104::task::568::TaskManager.Task::(_updateState) Task=`66e94146-db0d-4a18-b2ad-1942dba8ba1c`::moving from state init -> state preparing >Thread-584::INFO::2013-03-01 13:01:01,105::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-584::INFO::2013-03-01 13:01:01,105::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.22345495224', 'lastCheck': '5.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0325889587402', 'lastCheck': '8.7', 'code': 0, 'valid': True}} >Thread-584::DEBUG::2013-03-01 13:01:01,105::task::1151::TaskManager.Task::(prepare) Task=`66e94146-db0d-4a18-b2ad-1942dba8ba1c`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.22345495224', 'lastCheck': '5.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0325889587402', 'lastCheck': '8.7', 'code': 0, 'valid': True}} >Thread-584::DEBUG::2013-03-01 13:01:01,106::task::568::TaskManager.Task::(_updateState) Task=`66e94146-db0d-4a18-b2ad-1942dba8ba1c`::moving from state preparing -> state finished >Thread-584::DEBUG::2013-03-01 13:01:01,106::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-584::DEBUG::2013-03-01 13:01:01,106::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-584::DEBUG::2013-03-01 13:01:01,106::task::957::TaskManager.Task::(_decref) Task=`66e94146-db0d-4a18-b2ad-1942dba8ba1c`::ref 0 aborting False >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,242::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,257::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,258::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,259::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,455::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,472::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::WARNING::2013-03-01 13:01:01,472::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/ab7680c7-9438-42eb-a6c4-29a77fca31ea >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,474::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 10 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_b4bf0747-2c4c-4d83-9f75-eb83759f5712 --addtag MD_10 --addtag PU_8eaab457-8f02-4cff-9544-73d4e44a54e2 a558fc2a-a4a3-4118-9b81-d1d601eaa295/ab7680c7-9438-42eb-a6c4-29a77fca31ea' (cwd None) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,679::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,680::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,681::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,682::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/ab7680c7-9438-42eb-a6c4-29a77fca31ea' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:01,843::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:01,942::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456121 s, 22.5 MB/s\n'; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,972::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,972::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,973::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,974::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,987::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=ab7680c7-9438-42eb-a6c4-29a77fca31ea sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 10) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:01,992::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,001::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,001::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' (0 active users) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,001::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free, finding out if anyone is waiting for it. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,002::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,002::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' (0 active users) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,002::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free, finding out if anyone is waiting for it. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,002::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2', Clearing records. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,003::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712', Clearing records. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,003::task::568::TaskManager.Task::(_updateState) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::moving from state running -> state finished >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,004::task::719::TaskManager.Task::(_save) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/48229b0d-fd66-42c2-8de4-a18a3c6d685b.temp >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,013::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,013::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,014::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,014::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,014::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,014::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,015::task::880::TaskManager.Task::(_runJobs) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::Task.run: exit - success: result {'uuid': 'ab7680c7-9438-42eb-a6c4-29a77fca31ea'} >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,015::task::957::TaskManager.Task::(_decref) Task=`48229b0d-fd66-42c2-8de4-a18a3c6d685b`::ref 0 aborting False >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:01:02,015::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-105::DEBUG::2013-03-01 13:01:02,381::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:01:02,382::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:02,727::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:01:02,729::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:01:02,729::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:02,742::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000337667 s, 12.1 MB/s\n'; <rc> = 0 >Thread-586::DEBUG::2013-03-01 13:01:03,554::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-586::DEBUG::2013-03-01 13:01:03,555::task::568::TaskManager.Task::(_updateState) Task=`4ea23e13-f35c-4643-ad31-610cb163fcf0`::moving from state init -> state preparing >Thread-586::INFO::2013-03-01 13:01:03,555::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-586::INFO::2013-03-01 13:01:03,555::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-586::DEBUG::2013-03-01 13:01:03,556::task::1151::TaskManager.Task::(prepare) Task=`4ea23e13-f35c-4643-ad31-610cb163fcf0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-586::DEBUG::2013-03-01 13:01:03,556::task::568::TaskManager.Task::(_updateState) Task=`4ea23e13-f35c-4643-ad31-610cb163fcf0`::moving from state preparing -> state finished >Thread-586::DEBUG::2013-03-01 13:01:03,556::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-586::DEBUG::2013-03-01 13:01:03,556::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-586::DEBUG::2013-03-01 13:01:03,557::task::957::TaskManager.Task::(_decref) Task=`4ea23e13-f35c-4643-ad31-610cb163fcf0`::ref 0 aborting False >Thread-587::DEBUG::2013-03-01 13:01:03,584::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-587::DEBUG::2013-03-01 13:01:03,585::task::568::TaskManager.Task::(_updateState) Task=`b1bc57ed-6e81-48a8-b1cb-f37eaefde501`::moving from state init -> state preparing >Thread-587::INFO::2013-03-01 13:01:03,585::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-587::DEBUG::2013-03-01 13:01:03,585::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`72288248-1ba9-4aaf-a3f7-eac3e7895b7c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-587::DEBUG::2013-03-01 13:01:03,586::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-587::DEBUG::2013-03-01 13:01:03,586::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-587::DEBUG::2013-03-01 13:01:03,586::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`72288248-1ba9-4aaf-a3f7-eac3e7895b7c`::Granted request >Thread-587::DEBUG::2013-03-01 13:01:03,587::task::794::TaskManager.Task::(resourceAcquired) Task=`b1bc57ed-6e81-48a8-b1cb-f37eaefde501`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-587::DEBUG::2013-03-01 13:01:03,587::task::957::TaskManager.Task::(_decref) Task=`b1bc57ed-6e81-48a8-b1cb-f37eaefde501`::ref 1 aborting False >Thread-587::INFO::2013-03-01 13:01:03,588::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-587::DEBUG::2013-03-01 13:01:03,589::task::1151::TaskManager.Task::(prepare) Task=`b1bc57ed-6e81-48a8-b1cb-f37eaefde501`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-587::DEBUG::2013-03-01 13:01:03,589::task::568::TaskManager.Task::(_updateState) Task=`b1bc57ed-6e81-48a8-b1cb-f37eaefde501`::moving from state preparing -> state finished >Thread-587::DEBUG::2013-03-01 13:01:03,589::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-587::DEBUG::2013-03-01 13:01:03,590::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-587::DEBUG::2013-03-01 13:01:03,590::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-587::DEBUG::2013-03-01 13:01:03,590::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-587::DEBUG::2013-03-01 13:01:03,590::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-587::DEBUG::2013-03-01 13:01:03,591::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-587::DEBUG::2013-03-01 13:01:03,591::task::957::TaskManager.Task::(_decref) Task=`b1bc57ed-6e81-48a8-b1cb-f37eaefde501`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:01:03,956::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:04,050::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414981 s, 24.7 MB/s\n'; <rc> = 0 >Thread-589::DEBUG::2013-03-01 13:01:04,975::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-589::DEBUG::2013-03-01 13:01:04,975::task::568::TaskManager.Task::(_updateState) Task=`11141279-efef-4733-a590-33835d3cd0b2`::moving from state init -> state preparing >Thread-589::INFO::2013-03-01 13:01:04,976::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-589::DEBUG::2013-03-01 13:01:04,976::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-589::DEBUG::2013-03-01 13:01:04,977::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 48229b0d-fd66-42c2-8de4-a18a3c6d685b >Thread-589::DEBUG::2013-03-01 13:01:04,977::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'} >Thread-589::DEBUG::2013-03-01 13:01:04,977::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f7474b2c-7aa3-420d-944b-34b792bbd795 >Thread-589::DEBUG::2013-03-01 13:01:04,978::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'} >Thread-589::DEBUG::2013-03-01 13:01:04,978::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'48229b0d-fd66-42c2-8de4-a18a3c6d685b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'}, 'f7474b2c-7aa3-420d-944b-34b792bbd795': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'}} >Thread-589::INFO::2013-03-01 13:01:04,978::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'48229b0d-fd66-42c2-8de4-a18a3c6d685b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'}, 'f7474b2c-7aa3-420d-944b-34b792bbd795': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'}}} >Thread-589::DEBUG::2013-03-01 13:01:04,978::task::1151::TaskManager.Task::(prepare) Task=`11141279-efef-4733-a590-33835d3cd0b2`::finished: {'allTasksStatus': {'48229b0d-fd66-42c2-8de4-a18a3c6d685b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48229b0d-fd66-42c2-8de4-a18a3c6d685b'}, 'f7474b2c-7aa3-420d-944b-34b792bbd795': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f7474b2c-7aa3-420d-944b-34b792bbd795'}}} >Thread-589::DEBUG::2013-03-01 13:01:04,979::task::568::TaskManager.Task::(_updateState) Task=`11141279-efef-4733-a590-33835d3cd0b2`::moving from state preparing -> state finished >Thread-589::DEBUG::2013-03-01 13:01:04,979::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-589::DEBUG::2013-03-01 13:01:04,979::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-589::DEBUG::2013-03-01 13:01:04,980::task::957::TaskManager.Task::(_decref) Task=`11141279-efef-4733-a590-33835d3cd0b2`::ref 0 aborting False >Thread-590::DEBUG::2013-03-01 13:01:05,044::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-590::DEBUG::2013-03-01 13:01:05,044::task::568::TaskManager.Task::(_updateState) Task=`90c9bd7d-222e-44cd-a018-bac0485ca008`::moving from state init -> state preparing >Thread-590::INFO::2013-03-01 13:01:05,045::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', volUUID='673701ef-131b-4e14-84ef-1e03e542b4b8', options=None) >Thread-590::DEBUG::2013-03-01 13:01:05,045::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`c8db7bd6-d9da-4f7f-95cb-36c76aeebfe5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-590::DEBUG::2013-03-01 13:01:05,046::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-590::DEBUG::2013-03-01 13:01:05,046::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-590::DEBUG::2013-03-01 13:01:05,046::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`c8db7bd6-d9da-4f7f-95cb-36c76aeebfe5`::Granted request >Thread-590::DEBUG::2013-03-01 13:01:05,047::task::794::TaskManager.Task::(resourceAcquired) Task=`90c9bd7d-222e-44cd-a018-bac0485ca008`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-590::DEBUG::2013-03-01 13:01:05,047::task::957::TaskManager.Task::(_decref) Task=`90c9bd7d-222e-44cd-a018-bac0485ca008`::ref 1 aborting False >Thread-590::INFO::2013-03-01 13:01:05,048::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 volUUID = 673701ef-131b-4e14-84ef-1e03e542b4b8 >Thread-590::DEBUG::2013-03-01 13:01:05,048::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-590::DEBUG::2013-03-01 13:01:05,059::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000338861 s, 1.5 MB/s\n'; <rc> = 0 >Thread-590::DEBUG::2013-03-01 13:01:05,059::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000338861 s, 1.5 MB/s'], size: 512 >Thread-590::DEBUG::2013-03-01 13:01:05,060::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-590::DEBUG::2013-03-01 13:01:05,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000399917 s, 1.3 MB/s\n'; <rc> = 0 >Thread-590::DEBUG::2013-03-01 13:01:05,071::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000399917 s, 1.3 MB/s'], size: 512 >Thread-590::DEBUG::2013-03-01 13:01:05,071::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-590::DEBUG::2013-03-01 13:01:05,072::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-590::DEBUG::2013-03-01 13:01:05,318::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-590::DEBUG::2013-03-01 13:01:05,332::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-590::INFO::2013-03-01 13:01:05,333::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a634d930-00cd-440a-887c-5b4d9418c125/673701ef-131b-4e14-84ef-1e03e542b4b8 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135660', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135660', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '673701ef-131b-4e14-84ef-1e03e542b4b8', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-590::INFO::2013-03-01 13:01:05,334::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135660', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135660', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '673701ef-131b-4e14-84ef-1e03e542b4b8', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-590::DEBUG::2013-03-01 13:01:05,334::task::1151::TaskManager.Task::(prepare) Task=`90c9bd7d-222e-44cd-a018-bac0485ca008`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'format': 'COW', 'image': 'a634d930-00cd-440a-887c-5b4d9418c125', 'ctime': '1362135660', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135660', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '673701ef-131b-4e14-84ef-1e03e542b4b8', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-590::DEBUG::2013-03-01 13:01:05,334::task::568::TaskManager.Task::(_updateState) Task=`90c9bd7d-222e-44cd-a018-bac0485ca008`::moving from state preparing -> state finished >Thread-590::DEBUG::2013-03-01 13:01:05,335::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-590::DEBUG::2013-03-01 13:01:05,335::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-590::DEBUG::2013-03-01 13:01:05,335::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-590::DEBUG::2013-03-01 13:01:05,336::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-590::DEBUG::2013-03-01 13:01:05,336::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-590::DEBUG::2013-03-01 13:01:05,336::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-590::DEBUG::2013-03-01 13:01:05,336::task::957::TaskManager.Task::(_decref) Task=`90c9bd7d-222e-44cd-a018-bac0485ca008`::ref 0 aborting False >Thread-591::DEBUG::2013-03-01 13:01:05,372::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-591::DEBUG::2013-03-01 13:01:05,373::task::568::TaskManager.Task::(_updateState) Task=`5c07aec6-4c69-40ab-93e5-e60924775606`::moving from state init -> state preparing >Thread-591::INFO::2013-03-01 13:01:05,373::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', volUUID='ab7680c7-9438-42eb-a6c4-29a77fca31ea', options=None) >Thread-591::DEBUG::2013-03-01 13:01:05,374::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`3fa6d21e-37bf-4513-8c5e-28a7e6f644fb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-591::DEBUG::2013-03-01 13:01:05,374::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-591::DEBUG::2013-03-01 13:01:05,374::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-591::DEBUG::2013-03-01 13:01:05,375::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`3fa6d21e-37bf-4513-8c5e-28a7e6f644fb`::Granted request >Thread-591::DEBUG::2013-03-01 13:01:05,375::task::794::TaskManager.Task::(resourceAcquired) Task=`5c07aec6-4c69-40ab-93e5-e60924775606`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-591::DEBUG::2013-03-01 13:01:05,375::task::957::TaskManager.Task::(_decref) Task=`5c07aec6-4c69-40ab-93e5-e60924775606`::ref 1 aborting False >Thread-591::INFO::2013-03-01 13:01:05,376::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 volUUID = ab7680c7-9438-42eb-a6c4-29a77fca31ea >Thread-591::DEBUG::2013-03-01 13:01:05,377::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-591::DEBUG::2013-03-01 13:01:05,387::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000389194 s, 1.3 MB/s\n'; <rc> = 0 >Thread-591::DEBUG::2013-03-01 13:01:05,387::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000389194 s, 1.3 MB/s'], size: 512 >Thread-591::DEBUG::2013-03-01 13:01:05,388::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-591::DEBUG::2013-03-01 13:01:05,398::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000399467 s, 1.3 MB/s\n'; <rc> = 0 >Thread-591::DEBUG::2013-03-01 13:01:05,399::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000399467 s, 1.3 MB/s'], size: 512 >Thread-591::DEBUG::2013-03-01 13:01:05,399::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-591::DEBUG::2013-03-01 13:01:05,400::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-591::DEBUG::2013-03-01 13:01:05,645::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-591::DEBUG::2013-03-01 13:01:05,659::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-591::INFO::2013-03-01 13:01:05,661::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/b4bf0747-2c4c-4d83-9f75-eb83759f5712/ab7680c7-9438-42eb-a6c4-29a77fca31ea info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135661', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135661', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'ab7680c7-9438-42eb-a6c4-29a77fca31ea', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-591::INFO::2013-03-01 13:01:05,661::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135661', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135661', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'ab7680c7-9438-42eb-a6c4-29a77fca31ea', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-591::DEBUG::2013-03-01 13:01:05,661::task::1151::TaskManager.Task::(prepare) Task=`5c07aec6-4c69-40ab-93e5-e60924775606`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'format': 'COW', 'image': 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', 'ctime': '1362135661', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135661', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'ab7680c7-9438-42eb-a6c4-29a77fca31ea', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-591::DEBUG::2013-03-01 13:01:05,661::task::568::TaskManager.Task::(_updateState) Task=`5c07aec6-4c69-40ab-93e5-e60924775606`::moving from state preparing -> state finished >Thread-591::DEBUG::2013-03-01 13:01:05,662::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-591::DEBUG::2013-03-01 13:01:05,662::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-591::DEBUG::2013-03-01 13:01:05,663::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-591::DEBUG::2013-03-01 13:01:05,663::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-591::DEBUG::2013-03-01 13:01:05,663::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-591::DEBUG::2013-03-01 13:01:05,663::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-591::DEBUG::2013-03-01 13:01:05,664::task::957::TaskManager.Task::(_decref) Task=`5c07aec6-4c69-40ab-93e5-e60924775606`::ref 0 aborting False >Thread-592::DEBUG::2013-03-01 13:01:05,723::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-592::DEBUG::2013-03-01 13:01:05,724::task::568::TaskManager.Task::(_updateState) Task=`dd55b0e1-ae2a-4f4d-a681-d097b0abc9bd`::moving from state init -> state preparing >Thread-592::INFO::2013-03-01 13:01:05,724::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='48229b0d-fd66-42c2-8de4-a18a3c6d685b', spUUID=None, options=None) >Thread-592::DEBUG::2013-03-01 13:01:05,724::taskManager::161::TaskManager::(clearTask) Entry. taskID: 48229b0d-fd66-42c2-8de4-a18a3c6d685b >Thread-592::DEBUG::2013-03-01 13:01:05,726::taskManager::166::TaskManager::(clearTask) Return. >Thread-592::INFO::2013-03-01 13:01:05,726::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-592::DEBUG::2013-03-01 13:01:05,726::task::1151::TaskManager.Task::(prepare) Task=`dd55b0e1-ae2a-4f4d-a681-d097b0abc9bd`::finished: None >Thread-592::DEBUG::2013-03-01 13:01:05,726::task::568::TaskManager.Task::(_updateState) Task=`dd55b0e1-ae2a-4f4d-a681-d097b0abc9bd`::moving from state preparing -> state finished >Thread-592::DEBUG::2013-03-01 13:01:05,727::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-592::DEBUG::2013-03-01 13:01:05,727::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-592::DEBUG::2013-03-01 13:01:05,727::task::957::TaskManager.Task::(_decref) Task=`dd55b0e1-ae2a-4f4d-a681-d097b0abc9bd`::ref 0 aborting False >Thread-593::DEBUG::2013-03-01 13:01:05,759::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-593::DEBUG::2013-03-01 13:01:05,759::task::568::TaskManager.Task::(_updateState) Task=`df791484-3544-4456-a7b5-01614de157ef`::moving from state init -> state preparing >Thread-593::INFO::2013-03-01 13:01:05,759::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='f7474b2c-7aa3-420d-944b-34b792bbd795', spUUID=None, options=None) >Thread-593::DEBUG::2013-03-01 13:01:05,760::taskManager::161::TaskManager::(clearTask) Entry. taskID: f7474b2c-7aa3-420d-944b-34b792bbd795 >Thread-593::DEBUG::2013-03-01 13:01:05,761::taskManager::166::TaskManager::(clearTask) Return. >Thread-593::INFO::2013-03-01 13:01:05,761::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-593::DEBUG::2013-03-01 13:01:05,761::task::1151::TaskManager.Task::(prepare) Task=`df791484-3544-4456-a7b5-01614de157ef`::finished: None >Thread-593::DEBUG::2013-03-01 13:01:05,761::task::568::TaskManager.Task::(_updateState) Task=`df791484-3544-4456-a7b5-01614de157ef`::moving from state preparing -> state finished >Thread-593::DEBUG::2013-03-01 13:01:05,762::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-593::DEBUG::2013-03-01 13:01:05,762::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-593::DEBUG::2013-03-01 13:01:05,762::task::957::TaskManager.Task::(_decref) Task=`df791484-3544-4456-a7b5-01614de157ef`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:01:06,010::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:06,020::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000454894 s, 9.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:06,066::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:06,173::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473843 s, 21.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:08,187::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:08,290::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413492 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:10,310::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:10,418::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0427264 s, 24.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:12,438::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:12,542::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416251 s, 24.6 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:01:12,749::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:12,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000368816 s, 11.1 MB/s\n'; <rc> = 0 >Thread-597::DEBUG::2013-03-01 13:01:13,632::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-597::DEBUG::2013-03-01 13:01:13,633::task::568::TaskManager.Task::(_updateState) Task=`1938ea10-7f5d-4e8d-b352-caac64f12fac`::moving from state init -> state preparing >Thread-597::INFO::2013-03-01 13:01:13,633::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-597::INFO::2013-03-01 13:01:13,634::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-597::DEBUG::2013-03-01 13:01:13,634::task::1151::TaskManager.Task::(prepare) Task=`1938ea10-7f5d-4e8d-b352-caac64f12fac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-597::DEBUG::2013-03-01 13:01:13,634::task::568::TaskManager.Task::(_updateState) Task=`1938ea10-7f5d-4e8d-b352-caac64f12fac`::moving from state preparing -> state finished >Thread-597::DEBUG::2013-03-01 13:01:13,634::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-597::DEBUG::2013-03-01 13:01:13,635::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-597::DEBUG::2013-03-01 13:01:13,635::task::957::TaskManager.Task::(_decref) Task=`1938ea10-7f5d-4e8d-b352-caac64f12fac`::ref 0 aborting False >Thread-598::DEBUG::2013-03-01 13:01:13,660::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-598::DEBUG::2013-03-01 13:01:13,660::task::568::TaskManager.Task::(_updateState) Task=`a19fe746-8790-4ee2-b7ad-50a4d2f31590`::moving from state init -> state preparing >Thread-598::INFO::2013-03-01 13:01:13,661::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-598::DEBUG::2013-03-01 13:01:13,661::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`77109d45-1ec9-4530-802f-92de53308590`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-598::DEBUG::2013-03-01 13:01:13,662::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-598::DEBUG::2013-03-01 13:01:13,662::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-598::DEBUG::2013-03-01 13:01:13,662::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`77109d45-1ec9-4530-802f-92de53308590`::Granted request >Thread-598::DEBUG::2013-03-01 13:01:13,663::task::794::TaskManager.Task::(resourceAcquired) Task=`a19fe746-8790-4ee2-b7ad-50a4d2f31590`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-598::DEBUG::2013-03-01 13:01:13,663::task::957::TaskManager.Task::(_decref) Task=`a19fe746-8790-4ee2-b7ad-50a4d2f31590`::ref 1 aborting False >Thread-598::INFO::2013-03-01 13:01:13,665::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-598::DEBUG::2013-03-01 13:01:13,665::task::1151::TaskManager.Task::(prepare) Task=`a19fe746-8790-4ee2-b7ad-50a4d2f31590`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-598::DEBUG::2013-03-01 13:01:13,665::task::568::TaskManager.Task::(_updateState) Task=`a19fe746-8790-4ee2-b7ad-50a4d2f31590`::moving from state preparing -> state finished >Thread-598::DEBUG::2013-03-01 13:01:13,666::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-598::DEBUG::2013-03-01 13:01:13,666::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-598::DEBUG::2013-03-01 13:01:13,666::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-598::DEBUG::2013-03-01 13:01:13,667::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-598::DEBUG::2013-03-01 13:01:13,667::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-598::DEBUG::2013-03-01 13:01:13,667::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-598::DEBUG::2013-03-01 13:01:13,668::task::957::TaskManager.Task::(_decref) Task=`a19fe746-8790-4ee2-b7ad-50a4d2f31590`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:01:14,557::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:14,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513171 s, 20.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:01:16,022::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:16,032::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000461623 s, 8.9 MB/s\n'; <rc> = 0 >Thread-599::DEBUG::2013-03-01 13:01:16,323::task::568::TaskManager.Task::(_updateState) Task=`b3129651-fd02-47c6-8ea1-9d633c1eed48`::moving from state init -> state preparing >Thread-599::INFO::2013-03-01 13:01:16,324::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-599::INFO::2013-03-01 13:01:16,324::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104198455811', 'lastCheck': '0.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0137560367584', 'lastCheck': '3.6', 'code': 0, 'valid': True}} >Thread-599::DEBUG::2013-03-01 13:01:16,325::task::1151::TaskManager.Task::(prepare) Task=`b3129651-fd02-47c6-8ea1-9d633c1eed48`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104198455811', 'lastCheck': '0.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0137560367584', 'lastCheck': '3.6', 'code': 0, 'valid': True}} >Thread-599::DEBUG::2013-03-01 13:01:16,325::task::568::TaskManager.Task::(_updateState) Task=`b3129651-fd02-47c6-8ea1-9d633c1eed48`::moving from state preparing -> state finished >Thread-599::DEBUG::2013-03-01 13:01:16,325::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-599::DEBUG::2013-03-01 13:01:16,325::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-599::DEBUG::2013-03-01 13:01:16,326::task::957::TaskManager.Task::(_decref) Task=`b3129651-fd02-47c6-8ea1-9d633c1eed48`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:01:16,668::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:16,759::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442072 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:18,773::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:18,870::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374051 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:20,890::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:20,992::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407217 s, 25.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:01:22,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:23,009::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473776 s, 865 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:23,050::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-603::DEBUG::2013-03-01 13:01:23,910::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-603::DEBUG::2013-03-01 13:01:23,926::task::568::TaskManager.Task::(_updateState) Task=`6095ab91-8112-436e-8280-dd129ca5aa2e`::moving from state init -> state preparing >Thread-603::INFO::2013-03-01 13:01:23,954::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-603::INFO::2013-03-01 13:01:23,965::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-603::DEBUG::2013-03-01 13:01:23,970::task::1151::TaskManager.Task::(prepare) Task=`6095ab91-8112-436e-8280-dd129ca5aa2e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-603::DEBUG::2013-03-01 13:01:23,976::task::568::TaskManager.Task::(_updateState) Task=`6095ab91-8112-436e-8280-dd129ca5aa2e`::moving from state preparing -> state finished >Thread-603::DEBUG::2013-03-01 13:01:23,982::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-603::DEBUG::2013-03-01 13:01:23,988::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-603::DEBUG::2013-03-01 13:01:23,993::task::957::TaskManager.Task::(_decref) Task=`6095ab91-8112-436e-8280-dd129ca5aa2e`::ref 0 aborting False >Thread-604::DEBUG::2013-03-01 13:01:24,142::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-604::DEBUG::2013-03-01 13:01:24,150::task::568::TaskManager.Task::(_updateState) Task=`de6228c1-b4ea-4775-a9cf-ac09fccc2960`::moving from state init -> state preparing >Thread-604::INFO::2013-03-01 13:01:24,155::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-604::DEBUG::2013-03-01 13:01:24,166::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f29746a4-313d-4dda-b89c-d5216e762ad1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-604::DEBUG::2013-03-01 13:01:24,171::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-604::DEBUG::2013-03-01 13:01:24,179::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-604::DEBUG::2013-03-01 13:01:24,183::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f29746a4-313d-4dda-b89c-d5216e762ad1`::Granted request >Thread-604::DEBUG::2013-03-01 13:01:24,193::task::794::TaskManager.Task::(resourceAcquired) Task=`de6228c1-b4ea-4775-a9cf-ac09fccc2960`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-604::DEBUG::2013-03-01 13:01:24,199::task::957::TaskManager.Task::(_decref) Task=`de6228c1-b4ea-4775-a9cf-ac09fccc2960`::ref 1 aborting False >Thread-604::INFO::2013-03-01 13:01:24,273::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-604::DEBUG::2013-03-01 13:01:24,286::task::1151::TaskManager.Task::(prepare) Task=`de6228c1-b4ea-4775-a9cf-ac09fccc2960`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-604::DEBUG::2013-03-01 13:01:24,299::task::568::TaskManager.Task::(_updateState) Task=`de6228c1-b4ea-4775-a9cf-ac09fccc2960`::moving from state preparing -> state finished >Thread-604::DEBUG::2013-03-01 13:01:24,309::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-604::DEBUG::2013-03-01 13:01:24,321::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-604::DEBUG::2013-03-01 13:01:24,343::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-604::DEBUG::2013-03-01 13:01:24,360::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-604::DEBUG::2013-03-01 13:01:24,373::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-604::DEBUG::2013-03-01 13:01:24,394::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-604::DEBUG::2013-03-01 13:01:24,416::task::957::TaskManager.Task::(_decref) Task=`de6228c1-b4ea-4775-a9cf-ac09fccc2960`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:01:24,946::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.990529 s, 1.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:01:26,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:26,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000302898 s, 13.5 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,070::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-606::DEBUG::2013-03-01 13:01:26,071::task::568::TaskManager.Task::(_updateState) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::moving from state init -> state preparing >Thread-606::INFO::2013-03-01 13:01:26,071::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='a634d930-00cd-440a-887c-5b4d9418c125', srcVolUUID='75df5092-6aca-42ec-9cfb-56a127ef2aa5', dstImgUUID='f3619dce-b683-4ae7-a623-29151a0b1040', dstVolUUID='b93f5065-9fc7-4f49-8380-221d30abf3ad', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-606::INFO::2013-03-01 13:01:26,072::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-606::DEBUG::2013-03-01 13:01:26,072::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,260::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,261::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,261::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,261::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,262::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,262::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,263::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,454::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,456::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,456::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-606::DEBUG::2013-03-01 13:01:26,458::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,694::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,709::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-606::INFO::2013-03-01 13:01:26,710::image::458::Storage.Image::(isLegal) image a634d930-00cd-440a-887c-5b4d9418c125 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['673701ef-131b-4e14-84ef-1e03e542b4b8', '75df5092-6aca-42ec-9cfb-56a127ef2aa5'] >Thread-606::DEBUG::2013-03-01 13:01:26,710::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,720::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000317544 s, 1.6 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,721::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000317544 s, 1.6 MB/s'], size: 512 >Thread-606::DEBUG::2013-03-01 13:01:26,721::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,731::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311119 s, 1.6 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,732::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311119 s, 1.6 MB/s'], size: 512 >Thread-606::DEBUG::2013-03-01 13:01:26,733::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,750::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000360991 s, 1.4 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,751::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000360991 s, 1.4 MB/s'], size: 512 >Thread-606::DEBUG::2013-03-01 13:01:26,751::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,761::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000398412 s, 1.3 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:26,762::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000398412 s, 1.3 MB/s'], size: 512 >Thread-606::DEBUG::2013-03-01 13:01:26,762::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:26,763::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,956::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:26,963::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:26,999::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-606::DEBUG::2013-03-01 13:01:27,003::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:27,023::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0003124 s, 1.6 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:27,025::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0003124 s, 1.6 MB/s'], size: 512 >Thread-606::DEBUG::2013-03-01 13:01:27,028::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-606::DEBUG::2013-03-01 13:01:27,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000317487 s, 1.6 MB/s\n'; <rc> = 0 >Thread-606::DEBUG::2013-03-01 13:01:27,047::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000317487 s, 1.6 MB/s'], size: 512 >Thread-606::INFO::2013-03-01 13:01:27,048::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f803b050>, <storage.blockVolume.BlockVolume object at 0x7f15f803bd90>] >Thread-606::DEBUG::2013-03-01 13:01:27,051::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a7674253-5ace-47cc-9372-b9d3382915ac`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-606::DEBUG::2013-03-01 13:01:27,053::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-606::DEBUG::2013-03-01 13:01:27,054::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-606::DEBUG::2013-03-01 13:01:27,056::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a7674253-5ace-47cc-9372-b9d3382915ac`::Granted request >Thread-606::DEBUG::2013-03-01 13:01:27,059::task::794::TaskManager.Task::(resourceAcquired) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-606::DEBUG::2013-03-01 13:01:27,060::task::957::TaskManager.Task::(_decref) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::ref 1 aborting False >Thread-606::DEBUG::2013-03-01 13:01:27,066::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >Thread-606::DEBUG::2013-03-01 13:01:27,085::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_f3619dce-b683-4ae7-a623-29151a0b1040 for task 90b71e4e-999a-4d41-acb8-ec5864b43b1e >Thread-606::INFO::2013-03-01 13:01:27,086::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-606::DEBUG::2013-03-01 13:01:27,088::task::1146::TaskManager.Task::(prepare) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::Prepare: 1 jobs exist, move to acquiring >Thread-606::DEBUG::2013-03-01 13:01:27,090::task::568::TaskManager.Task::(_updateState) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::moving from state preparing -> state acquiring >Thread-606::DEBUG::2013-03-01 13:01:27,093::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >Thread-606::DEBUG::2013-03-01 13:01:27,117::task::568::TaskManager.Task::(_updateState) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::moving from state acquiring -> state queued >Thread-606::DEBUG::2013-03-01 13:01:27,120::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >Thread-606::DEBUG::2013-03-01 13:01:27,142::taskManager::50::TaskManager::(_queueTask) queuing task: 90b71e4e-999a-4d41-acb8-ec5864b43b1e >Thread-606::DEBUG::2013-03-01 13:01:27,144::taskManager::56::TaskManager::(_queueTask) task queued: 90b71e4e-999a-4d41-acb8-ec5864b43b1e >172f931e-c2b1-409c-92e6-f0f43d5b99d1::DEBUG::2013-03-01 13:01:27,145::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-606::DEBUG::2013-03-01 13:01:27,146::task::1148::TaskManager.Task::(prepare) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::returning >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,148::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 90b71e4e-999a-4d41-acb8-ec5864b43b1e running: <bound method Task.commit of <storage.task.Task instance at 0x17b0bd8>> with: None >Thread-606::DEBUG::2013-03-01 13:01:27,149::task::957::TaskManager.Task::(_decref) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::ref 0 aborting False >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,150::task::1159::TaskManager.Task::(commit) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::committing task: 90b71e4e-999a-4d41-acb8-ec5864b43b1e >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,153::task::568::TaskManager.Task::(_updateState) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::moving from state queued -> state running >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,158::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,182::task::872::TaskManager.Task::(_runJobs) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::Task.run: running job 0: copyImage_f3619dce-b683-4ae7-a623-29151a0b1040: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'a634d930-00cd-440a-887c-5b4d9418c125', '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'f3619dce-b683-4ae7-a623-29151a0b1040', 'b93f5065-9fc7-4f49-8380-221d30abf3ad', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,184::task::304::TaskManager.Task::(run) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::Job.run: running copyImage_f3619dce-b683-4ae7-a623-29151a0b1040: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'a634d930-00cd-440a-887c-5b4d9418c125', '75df5092-6aca-42ec-9cfb-56a127ef2aa5', 'f3619dce-b683-4ae7-a623-29151a0b1040', 'b93f5065-9fc7-4f49-8380-221d30abf3ad', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,187::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`477e8c07-f79f-4771-93a7-4b287626d89b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,189::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' for lock type 'shared' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,192::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:27,248::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-607::DEBUG::2013-03-01 13:01:27,250::task::568::TaskManager.Task::(_updateState) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::moving from state init -> state preparing >Thread-607::INFO::2013-03-01 13:01:27,251::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', srcVolUUID='8eaab457-8f02-4cff-9544-73d4e44a54e2', dstImgUUID='dbdb8121-3e54-47d0-9a64-c02b9cc03c83', dstVolUUID='d23337b9-f9f7-4b74-bf30-a940bbd88c8e', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-607::INFO::2013-03-01 13:01:27,252::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-607::DEBUG::2013-03-01 13:01:27,255::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:27,270::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.237047 s, 4.3 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,394::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,405::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,406::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,414::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000275195 s, 1.9 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,415::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000275195 s, 1.9 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,416::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,425::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000271687 s, 1.9 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,425::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000271687 s, 1.9 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:27,425::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a634d930-00cd-440a-887c-5b4d9418c125 chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec18e350>, <storage.blockVolume.BlockVolume object at 0x7f15ec181a10>] >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,426::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8`ReqID=`eb0423ca-3fe6-46f2-83d9-f5a86262b407`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,427::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8' for lock type 'shared' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,427::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8' is free. Now locking as 'shared' (1 active user) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,427::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8`ReqID=`eb0423ca-3fe6-46f2-83d9-f5a86262b407`::Granted request >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,428::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`6d11089e-7839-4d4a-872d-f8bba965cfa6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,428::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' for lock type 'shared' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,429::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free. Now locking as 'shared' (1 active user) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,429::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`6d11089e-7839-4d4a-872d-f8bba965cfa6`::Granted request >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,429::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' is free. Now locking as 'shared' (1 active user) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,430::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`477e8c07-f79f-4771-93a7-4b287626d89b`::Granted request >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,431::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040`ReqID=`4b167042-9003-4929-bebd-fea38115f1aa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,431::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040' for lock type 'exclusive' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,432::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,432::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:27,450::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:27,450::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,690::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,691::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image f3619dce-b683-4ae7-a623-29151a0b1040 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,692::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040' is free. Now locking as 'exclusive' (1 active user) >Thread-607::DEBUG::2013-03-01 13:01:27,693::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,694::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040`ReqID=`4b167042-9003-4929-bebd-fea38115f1aa`::Granted request >Thread-607::DEBUG::2013-03-01 13:01:27,698::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:27,699::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=a634d930-00cd-440a-887c-5b4d9418c125 srcVolUUID=75df5092-6aca-42ec-9cfb-56a127ef2aa5 dstImgUUID=f3619dce-b683-4ae7-a623-29151a0b1040 dstVolUUID=b93f5065-9fc7-4f49-8380-221d30abf3ad dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >Thread-607::DEBUG::2013-03-01 13:01:27,702::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,704::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:27,715::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-607::DEBUG::2013-03-01 13:01:27,721::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,727::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000361439 s, 1.4 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,729::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000361439 s, 1.4 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,731::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-607::DEBUG::2013-03-01 13:01:27,735::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:27,977::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:27,979::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-607::DEBUG::2013-03-01 13:01:27,980::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-607::DEBUG::2013-03-01 13:01:27,980::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:27,989::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,014::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00032824 s, 1.6 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,015::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00032824 s, 1.6 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,016::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,026::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000363094 s, 1.4 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,027::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000363094 s, 1.4 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,037::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000346629 s, 1.5 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,037::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000346629 s, 1.5 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,038::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,048::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000333362 s, 1.5 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,048::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000333362 s, 1.5 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,060::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000349069 s, 1.5 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,061::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000349069 s, 1.5 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:28,062::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:a634d930-00cd-440a-887c-5b4d9418c125:75df5092-6aca-42ec-9cfb-56a127ef2aa5 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:f3619dce-b683-4ae7-a623-29151a0b1040:b93f5065-9fc7-4f49-8380-221d30abf3ad apparentsize 2097152 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,063::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,064::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,226::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-607::INFO::2013-03-01 13:01:28,238::image::458::Storage.Image::(isLegal) image b4bf0747-2c4c-4d83-9f75-eb83759f5712 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['ab7680c7-9438-42eb-a6c4-29a77fca31ea', '8eaab457-8f02-4cff-9544-73d4e44a54e2'] >Thread-607::DEBUG::2013-03-01 13:01:28,238::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,248::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000296073 s, 1.7 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,248::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000296073 s, 1.7 MB/s'], size: 512 >Thread-607::DEBUG::2013-03-01 13:01:28,249::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,259::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000358334 s, 1.4 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,260::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000358334 s, 1.4 MB/s'], size: 512 >Thread-607::DEBUG::2013-03-01 13:01:28,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,270::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000288027 s, 1.8 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,271::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000288027 s, 1.8 MB/s'], size: 512 >Thread-607::DEBUG::2013-03-01 13:01:28,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,280::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000208692 s, 2.5 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,281::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000208692 s, 2.5 MB/s'], size: 512 >Thread-607::DEBUG::2013-03-01 13:01:28,281::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-607::DEBUG::2013-03-01 13:01:28,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,291::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:28,307::image::458::Storage.Image::(isLegal) image f3619dce-b683-4ae7-a623-29151a0b1040 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:28,308::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040 for image's volumes >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,309::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,318::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,519::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,534::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-607::DEBUG::2013-03-01 13:01:28,545::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000209937 s, 2.4 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,545::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000209937 s, 2.4 MB/s'], size: 512 >Thread-607::DEBUG::2013-03-01 13:01:28,546::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,566::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,569::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000313958 s, 1.6 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2013-03-01 13:01:28,572::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000313958 s, 1.6 MB/s'], size: 512 >Thread-607::INFO::2013-03-01 13:01:28,575::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec1aee90>, <storage.blockVolume.BlockVolume object at 0x7f15882e7590>] >Thread-607::DEBUG::2013-03-01 13:01:28,578::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9dde96c4-bc6c-49c9-a84c-357979a1f8d9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-607::DEBUG::2013-03-01 13:01:28,580::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-607::DEBUG::2013-03-01 13:01:28,582::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-607::DEBUG::2013-03-01 13:01:28,584::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9dde96c4-bc6c-49c9-a84c-357979a1f8d9`::Granted request >Thread-607::DEBUG::2013-03-01 13:01:28,589::task::794::TaskManager.Task::(resourceAcquired) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-607::DEBUG::2013-03-01 13:01:28,592::task::957::TaskManager.Task::(_decref) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::ref 1 aborting False >Thread-607::DEBUG::2013-03-01 13:01:28,601::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,607::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::WARNING::2013-03-01 13:01:28,608::lvm::593::Storage.LVM::(getLv) lv: b93f5065-9fc7-4f49-8380-221d30abf3ad not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:28,610::volume::457::Storage.Volume::(create) Creating volume b93f5065-9fc7-4f49-8380-221d30abf3ad >Thread-607::DEBUG::2013-03-01 13:01:28,625::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_dbdb8121-3e54-47d0-9a64-c02b9cc03c83 for task 179bf76e-a9cb-4ace-a2f4-21043760b0df >Thread-607::INFO::2013-03-01 13:01:28,625::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-607::DEBUG::2013-03-01 13:01:28,626::task::1146::TaskManager.Task::(prepare) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::Prepare: 1 jobs exist, move to acquiring >Thread-607::DEBUG::2013-03-01 13:01:28,626::task::568::TaskManager.Task::(_updateState) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::moving from state preparing -> state acquiring >Thread-607::DEBUG::2013-03-01 13:01:28,627::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >Thread-607::DEBUG::2013-03-01 13:01:28,634::task::568::TaskManager.Task::(_updateState) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::moving from state acquiring -> state queued >Thread-607::DEBUG::2013-03-01 13:01:28,635::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >Thread-607::DEBUG::2013-03-01 13:01:28,642::taskManager::50::TaskManager::(_queueTask) queuing task: 179bf76e-a9cb-4ace-a2f4-21043760b0df >Thread-7::DEBUG::2013-03-01 13:01:28,643::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-607::DEBUG::2013-03-01 13:01:28,643::taskManager::56::TaskManager::(_queueTask) task queued: 179bf76e-a9cb-4ace-a2f4-21043760b0df >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,647::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 179bf76e-a9cb-4ace-a2f4-21043760b0df running: <bound method Task.commit of <storage.task.Task instance at 0x17c3b90>> with: None >Thread-607::DEBUG::2013-03-01 13:01:28,647::task::1148::TaskManager.Task::(prepare) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::returning >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,648::task::1159::TaskManager.Task::(commit) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::committing task: 179bf76e-a9cb-4ace-a2f4-21043760b0df >Thread-607::DEBUG::2013-03-01 13:01:28,648::task::957::TaskManager.Task::(_decref) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::ref 0 aborting False >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,650::task::568::TaskManager.Task::(_updateState) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::moving from state queued -> state running >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,654::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,661::task::872::TaskManager.Task::(_runJobs) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::Task.run: running job 0: copyImage_dbdb8121-3e54-47d0-9a64-c02b9cc03c83: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,661::task::304::TaskManager.Task::(run) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::Job.run: running copyImage_dbdb8121-3e54-47d0-9a64-c02b9cc03c83: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'b4bf0747-2c4c-4d83-9f75-eb83759f5712', '8eaab457-8f02-4cff-9544-73d4e44a54e2', 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,662::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`40b2d5d3-0bd4-4729-b9b1-7238f829167e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,662::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' for lock type 'shared' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,663::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,664::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,706::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,715::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:28,724::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name b93f5065-9fc7-4f49-8380-221d30abf3ad a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,890::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,902::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,902::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,911::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000227289 s, 2.3 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,911::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000227289 s, 2.3 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,912::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000276408 s, 1.9 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,923::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000276408 s, 1.9 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:28,924::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f80999d0>, <storage.blockVolume.BlockVolume object at 0x7f15f800a790>] >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,925::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`a5271382-6aa4-414a-95d2-86eb400bced5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,925::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' for lock type 'shared' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,925::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free. Now locking as 'shared' (1 active user) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,926::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`a5271382-6aa4-414a-95d2-86eb400bced5`::Granted request >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,926::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea`ReqID=`9026dbc6-e40c-41f2-bc38-2602d43d5723`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,927::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea' for lock type 'shared' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,927::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea' is free. Now locking as 'shared' (1 active user) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,927::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea`ReqID=`9026dbc6-e40c-41f2-bc38-2602d43d5723`::Granted request >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,928::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free. Now locking as 'shared' (1 active user) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,928::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`40b2d5d3-0bd4-4729-b9b1-7238f829167e`::Granted request >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,929::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83`ReqID=`36c8d379-5cc4-4e4c-a847-8e9204e6876d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,929::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' for lock type 'exclusive' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,953::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:28,953::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:29,283::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:29,371::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0427143 s, 24.0 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,385::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,414::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,428::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,429::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image dbdb8121-3e54-47d0-9a64-c02b9cc03c83 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,430::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,431::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' is free. Now locking as 'exclusive' (1 active user) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,433::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,434::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83`ReqID=`36c8d379-5cc4-4e4c-a847-8e9204e6876d`::Granted request >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,437::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:30,440::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=b4bf0747-2c4c-4d83-9f75-eb83759f5712 srcVolUUID=8eaab457-8f02-4cff-9544-73d4e44a54e2 dstImgUUID=dbdb8121-3e54-47d0-9a64-c02b9cc03c83 dstVolUUID=d23337b9-f9f7-4b74-bf30-a940bbd88c8e dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,441::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,444::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:30,444::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad with size = 20480 sectors >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,457::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad 10240K' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,476::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,478::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000362506 s, 1.4 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,481::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000362506 s, 1.4 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,482::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,486::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,498::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,510::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000313483 s, 1.6 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,510::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000313483 s, 1.6 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,511::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,520::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000321097 s, 1.6 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,521::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000321097 s, 1.6 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000384078 s, 1.3 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,532::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000384078 s, 1.3 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,543::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308648 s, 1.7 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,543::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308648 s, 1.7 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,544::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,552::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000329282 s, 1.6 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,553::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000329282 s, 1.6 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:30,553::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:b4bf0747-2c4c-4d83-9f75-eb83759f5712:8eaab457-8f02-4cff-9544-73d4e44a54e2 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:dbdb8121-3e54-47d0-9a64-c02b9cc03c83:d23337b9-f9f7-4b74-bf30-a940bbd88c8e apparentsize 2097152 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,553::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,695::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::WARNING::2013-03-01 13:01:30,710::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,710::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 11 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag MD_11 --addtag IU_f3619dce-b683-4ae7-a623-29151a0b1040 a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,739::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,768::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:30,768::image::458::Storage.Image::(isLegal) image dbdb8121-3e54-47d0-9a64-c02b9cc03c83 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:30,769::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83 for image's volumes >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,770::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,777::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,778::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,920::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,921::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,960::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,975::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::WARNING::2013-03-01 13:01:30,975::lvm::593::Storage.LVM::(getLv) lv: d23337b9-f9f7-4b74-bf30-a940bbd88c8e not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:30,977::volume::457::Storage.Volume::(create) Creating volume d23337b9-f9f7-4b74-bf30-a940bbd88c8e >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,977::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,979::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:30,979::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:30,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:31,002::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:31,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name d23337b9-f9f7-4b74-bf30-a940bbd88c8e a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,238::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,238::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,238::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,239::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,256::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=b93f5065-9fc7-4f49-8380-221d30abf3ad sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 11) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,262::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,272::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:31,273::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:31,385::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:31,472::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402782 s, 25.4 MB/s\n'; <rc> = 0 >Thread-609::DEBUG::2013-03-01 13:01:31,711::task::568::TaskManager.Task::(_updateState) Task=`b0c31865-d823-46a9-9fa4-fbb97f7f3e39`::moving from state init -> state preparing >Thread-609::INFO::2013-03-01 13:01:31,712::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-609::INFO::2013-03-01 13:01:31,712::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103168487549', 'lastCheck': '5.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.260210037231', 'lastCheck': '8.2', 'code': 0, 'valid': True}} >Thread-609::DEBUG::2013-03-01 13:01:31,712::task::1151::TaskManager.Task::(prepare) Task=`b0c31865-d823-46a9-9fa4-fbb97f7f3e39`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103168487549', 'lastCheck': '5.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.260210037231', 'lastCheck': '8.2', 'code': 0, 'valid': True}} >Thread-609::DEBUG::2013-03-01 13:01:31,712::task::568::TaskManager.Task::(_updateState) Task=`b0c31865-d823-46a9-9fa4-fbb97f7f3e39`::moving from state preparing -> state finished >Thread-609::DEBUG::2013-03-01 13:01:31,713::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-609::DEBUG::2013-03-01 13:01:31,713::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-609::DEBUG::2013-03-01 13:01:31,713::task::957::TaskManager.Task::(_decref) Task=`b0c31865-d823-46a9-9fa4-fbb97f7f3e39`::ref 0 aborting False >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,905::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,906::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:32,934::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:32,952::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:32,953::blockVolume::280::Storage.Volume::(extend) Request to extend LV b93f5065-9fc7-4f49-8380-221d30abf3ad of image f3619dce-b683-4ae7-a623-29151a0b1040 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,955::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,958::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:32,959::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,970::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,971::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:32,972::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e with size = 20480 sectors >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,972::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e 10240K' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,984::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,985::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:32,986::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,189::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,193::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,193::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,203::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00025318 s, 2.0 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,203::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00025318 s, 2.0 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:33,204::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,214::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000274116 s, 1.9 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,215::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000274116 s, 1.9 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,215::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`3b3f5b78-364f-4134-bda5-5e0081e1a2ce`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,216::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' for lock type 'shared' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:33,216::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:33,227::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:33,246::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::WARNING::2013-03-01 13:01:33,246::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:33,247::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 12 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:33,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag MD_12 --addtag IU_dbdb8121-3e54-47d0-9a64-c02b9cc03c83 a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:33,485::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:33,542::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:01:33,549::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:33,608::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056148 s, 18.2 MB/s\n'; <rc> = 0 >Thread-611::DEBUG::2013-03-01 13:01:34,560::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-611::DEBUG::2013-03-01 13:01:34,561::task::568::TaskManager.Task::(_updateState) Task=`6f61fb7f-583f-49ca-a4a5-c8bf5c822c8a`::moving from state init -> state preparing >Thread-611::INFO::2013-03-01 13:01:34,562::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-611::INFO::2013-03-01 13:01:34,562::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-611::DEBUG::2013-03-01 13:01:34,563::task::1151::TaskManager.Task::(prepare) Task=`6f61fb7f-583f-49ca-a4a5-c8bf5c822c8a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-611::DEBUG::2013-03-01 13:01:34,563::task::568::TaskManager.Task::(_updateState) Task=`6f61fb7f-583f-49ca-a4a5-c8bf5c822c8a`::moving from state preparing -> state finished >Thread-611::DEBUG::2013-03-01 13:01:34,563::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-611::DEBUG::2013-03-01 13:01:34,563::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-611::DEBUG::2013-03-01 13:01:34,564::task::957::TaskManager.Task::(_decref) Task=`6f61fb7f-583f-49ca-a4a5-c8bf5c822c8a`::ref 0 aborting False >Thread-612::DEBUG::2013-03-01 13:01:34,588::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-612::DEBUG::2013-03-01 13:01:34,589::task::568::TaskManager.Task::(_updateState) Task=`1c1ddfa0-a783-43fd-8a37-befc6f6b5743`::moving from state init -> state preparing >Thread-612::INFO::2013-03-01 13:01:34,589::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-612::DEBUG::2013-03-01 13:01:34,590::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`97fa4cc3-8364-4155-9982-b11a2ce03706`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-612::DEBUG::2013-03-01 13:01:34,590::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-612::DEBUG::2013-03-01 13:01:34,590::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-612::DEBUG::2013-03-01 13:01:34,590::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`97fa4cc3-8364-4155-9982-b11a2ce03706`::Granted request >Thread-612::DEBUG::2013-03-01 13:01:34,591::task::794::TaskManager.Task::(resourceAcquired) Task=`1c1ddfa0-a783-43fd-8a37-befc6f6b5743`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-612::DEBUG::2013-03-01 13:01:34,591::task::957::TaskManager.Task::(_decref) Task=`1c1ddfa0-a783-43fd-8a37-befc6f6b5743`::ref 1 aborting False >Thread-612::DEBUG::2013-03-01 13:01:34,592::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-612::DEBUG::2013-03-01 13:01:34,592::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:34,817::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:34,818::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:34,860::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:34,861::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-105::DEBUG::2013-03-01 13:01:35,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' /etc/lvm/archive/a558fc2a-a4a3-4118-9b81-d1d601eaa295_00000-477675418.vg: stat failed: No such file or directory\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:01:35,054::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:35,066::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000316438 s, 12.9 MB/s\n'; <rc> = 0 >Thread-612::DEBUG::2013-03-01 13:01:35,085::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-612::DEBUG::2013-03-01 13:01:35,087::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,089::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,091::lvm::498::OperationMutex::(_invalidatelvs) Got the operational mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,094::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free. Now locking as 'shared' (1 active user) >Thread-612::INFO::2013-03-01 13:01:35,094::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '39460012032', 'alerts': [], 'disktotal': '53284438016'}}} >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,095::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,096::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5`ReqID=`3b3f5b78-364f-4134-bda5-5e0081e1a2ce`::Granted request >Thread-612::DEBUG::2013-03-01 13:01:35,097::task::1151::TaskManager.Task::(prepare) Task=`1c1ddfa0-a783-43fd-8a37-befc6f6b5743`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '39460012032', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-612::DEBUG::2013-03-01 13:01:35,100::task::568::TaskManager.Task::(_updateState) Task=`1c1ddfa0-a783-43fd-8a37-befc6f6b5743`::moving from state preparing -> state finished >Thread-612::DEBUG::2013-03-01 13:01:35,102::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,103::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-612::DEBUG::2013-03-01 13:01:35,104::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,107::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >Thread-612::DEBUG::2013-03-01 13:01:35,108::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-612::DEBUG::2013-03-01 13:01:35,119::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-612::DEBUG::2013-03-01 13:01:35,121::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-612::DEBUG::2013-03-01 13:01:35,122::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,123::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-612::DEBUG::2013-03-01 13:01:35,135::task::957::TaskManager.Task::(_decref) Task=`1c1ddfa0-a783-43fd-8a37-befc6f6b5743`::ref 0 aborting False >Thread-614::DEBUG::2013-03-01 13:01:35,213::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-614::DEBUG::2013-03-01 13:01:35,213::task::568::TaskManager.Task::(_updateState) Task=`d6a78d39-1bea-429c-834d-ebd75e07d8bb`::moving from state init -> state preparing >Thread-614::INFO::2013-03-01 13:01:35,214::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-614::DEBUG::2013-03-01 13:01:35,214::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-614::DEBUG::2013-03-01 13:01:35,214::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 179bf76e-a9cb-4ace-a2f4-21043760b0df >Thread-614::DEBUG::2013-03-01 13:01:35,214::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'} >Thread-614::DEBUG::2013-03-01 13:01:35,214::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 90b71e4e-999a-4d41-acb8-ec5864b43b1e >Thread-614::DEBUG::2013-03-01 13:01:35,215::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'} >Thread-614::DEBUG::2013-03-01 13:01:35,215::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'179bf76e-a9cb-4ace-a2f4-21043760b0df': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'}, '90b71e4e-999a-4d41-acb8-ec5864b43b1e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'}} >Thread-614::INFO::2013-03-01 13:01:35,215::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'179bf76e-a9cb-4ace-a2f4-21043760b0df': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'}, '90b71e4e-999a-4d41-acb8-ec5864b43b1e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'}}} >Thread-614::DEBUG::2013-03-01 13:01:35,215::task::1151::TaskManager.Task::(prepare) Task=`d6a78d39-1bea-429c-834d-ebd75e07d8bb`::finished: {'allTasksStatus': {'179bf76e-a9cb-4ace-a2f4-21043760b0df': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'}, '90b71e4e-999a-4d41-acb8-ec5864b43b1e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'}}} >Thread-614::DEBUG::2013-03-01 13:01:35,215::task::568::TaskManager.Task::(_updateState) Task=`d6a78d39-1bea-429c-834d-ebd75e07d8bb`::moving from state preparing -> state finished >Thread-614::DEBUG::2013-03-01 13:01:35,216::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-614::DEBUG::2013-03-01 13:01:35,216::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-614::DEBUG::2013-03-01 13:01:35,216::task::957::TaskManager.Task::(_decref) Task=`d6a78d39-1bea-429c-834d-ebd75e07d8bb`::ref 0 aborting False >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,317::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,325::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,329::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,337::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:35,338::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,339::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,341::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,341::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,353::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,362::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000329116 s, 1.6 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,365::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000329116 s, 1.6 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,368::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,393::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0003342 s, 1.5 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,395::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0003342 s, 1.5 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,400::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad`ReqID=`c842be55-434a-442e-ac63-ae1797ae2610`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,403::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad' for lock type 'exclusive' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:35,409::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,425::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=d23337b9-f9f7-4b74-bf30-a940bbd88c8e sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 12) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,431::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,441::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,442::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:35,621::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,632::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,672::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:35,673::blockVolume::280::Storage.Volume::(extend) Request to extend LV d23337b9-f9f7-4b74-bf30-a940bbd88c8e of image dbdb8121-3e54-47d0-9a64-c02b9cc03c83 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:35,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:35,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905122 s, 11.3 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:01:36,045::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-255::DEBUG::2013-03-01 13:01:36,045::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-255::DEBUG::2013-03-01 13:01:36,046::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:36,055::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000293375 s, 7.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:01:36,056::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000293375 s, 7.0 MB/s'], size: 2048 >Thread-255::DEBUG::2013-03-01 13:01:36,056::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-255::WARNING::2013-03-01 13:01:36,056::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-255::DEBUG::2013-03-01 13:01:36,057::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-255::DEBUG::2013-03-01 13:01:36,057::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 13:01:36,058::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:01:36,058::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 13:01:36,059::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:01:36,059::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 13:01:36,060::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:36,250::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:01:36,252::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:01:36,252::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-255::WARNING::2013-03-01 13:01:36,253::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-255::WARNING::2013-03-01 13:01:36,253::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-255::WARNING::2013-03-01 13:01:36,254::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-255::DEBUG::2013-03-01 13:01:36,255::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:36,483::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:01:36,483::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:36,494::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000337602 s, 12.1 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,006::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,007::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,008::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,008::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad' is free. Now locking as 'exclusive' (1 active user) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,009::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad`ReqID=`c842be55-434a-442e-ac63-ae1797ae2610`::Granted request >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,010::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,035::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,037::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,038::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,048::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000354911 s, 1.4 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,049::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000354911 s, 1.4 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:37,050::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,050::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,060::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000315167 s, 1.6 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,061::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000315167 s, 1.6 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,062::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`a3f5c6f2-a495-4570-b3df-f2afa052e640`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,062::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' for lock type 'shared' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:37,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,226::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,239::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,239::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,250::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000233089 s, 2.2 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,251::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000233089 s, 2.2 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,253::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,261::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000207998 s, 2.5 MB/s\n'; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,262::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000207998 s, 2.5 MB/s'], size: 512 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,262::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad (qcow2) START >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,263::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:37,272::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >Dummy-173::DEBUG::2013-03-01 13:01:37,775::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:37,862::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347205 s, 29.5 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,449::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,449::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,450::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,450::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free. Now locking as 'shared' (1 active user) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,450::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2`ReqID=`a3f5c6f2-a495-4570-b3df-f2afa052e640`::Granted request >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,451::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,452::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,638::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,651::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:38,651::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,652::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,661::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000305285 s, 1.7 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,662::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000305285 s, 1.7 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,662::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,671::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000294213 s, 1.7 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,671::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000294213 s, 1.7 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,672::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e`ReqID=`8abf781c-65f5-4b13-b74e-27a13351daec`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,673::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e' for lock type 'exclusive' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:38,673::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:39,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:39,195::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/75df5092-6aca-42ec-9cfb-56a127ef2aa5 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad DONE >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:39,195::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:75df5092-6aca-42ec-9cfb-56a127ef2aa5 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:b93f5065-9fc7-4f49-8380-221d30abf3ad >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:39,195::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5 justme False >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:39,195::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' >Dummy-173::DEBUG::2013-03-01 13:01:39,881::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:39,995::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0495642 s, 20.7 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,341::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,342::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,342::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,342::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e' is free. Now locking as 'exclusive' (1 active user) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,342::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e`ReqID=`8abf781c-65f5-4b13-b74e-27a13351daec`::Granted request >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,343::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' (0 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,345::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,346::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,351::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,604::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,618::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,618::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,629::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319395 s, 1.6 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,630::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319395 s, 1.6 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,631::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,643::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000314112 s, 1.6 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,643::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000314112 s, 1.6 MB/s'], size: 512 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,644::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e (qcow2) START >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,645::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:40,655::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,661::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,663::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,665::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,665::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,667::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,669::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,867::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,880::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::INFO::2013-03-01 13:01:40,880::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad justme False >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,880::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,880::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad' (0 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,881::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad' is free, finding out if anyone is waiting for it. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:40,882::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,121::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,121::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,122::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,122::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.b93f5065-9fc7-4f49-8380-221d30abf3ad', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,122::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,123::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,377::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,389::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,390::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,390::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040' (0 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,390::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040' is free, finding out if anyone is waiting for it. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,391::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.f3619dce-b683-4ae7-a623-29151a0b1040', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,391::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,391::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' (0 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,391::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125' is free, finding out if anyone is waiting for it. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,392::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,392::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8' (0 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,392::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8' is free, finding out if anyone is waiting for it. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,392::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.673701ef-131b-4e14-84ef-1e03e542b4b8', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,392::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,393::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' (0 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,393::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5' is free, finding out if anyone is waiting for it. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,393::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.75df5092-6aca-42ec-9cfb-56a127ef2aa5', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,393::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a634d930-00cd-440a-887c-5b4d9418c125', Clearing records. >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,394::task::568::TaskManager.Task::(_updateState) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::moving from state running -> state finished >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,394::task::719::TaskManager.Task::(_save) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/90b71e4e-999a-4d41-acb8-ec5864b43b1e.temp >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,403::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,403::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,403::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,404::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (1 active users) >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,404::task::880::TaskManager.Task::(_runJobs) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::Task.run: exit - success: result {'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad'} >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,404::task::957::TaskManager.Task::(_decref) Task=`90b71e4e-999a-4d41-acb8-ec5864b43b1e`::ref 0 aborting False >90b71e4e-999a-4d41-acb8-ec5864b43b1e::DEBUG::2013-03-01 13:01:41,404::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Dummy-173::DEBUG::2013-03-01 13:01:42,013::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:42,096::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359457 s, 28.5 MB/s\n'; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,393::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,394::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e DONE >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:42,394::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:8eaab457-8f02-4cff-9544-73d4e44a54e2 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:d23337b9-f9f7-4b74-bf30-a940bbd88c8e >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:42,394::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2 justme False >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,395::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,395::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,395::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,397::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,655::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,656::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,656::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.8eaab457-8f02-4cff-9544-73d4e44a54e2', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,656::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,657::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,900::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,917::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::INFO::2013-03-01 13:01:42,917::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e justme False >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,917::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,918::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,918::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:42,919::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,176::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,177::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,177::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,177::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.d23337b9-f9f7-4b74-bf30-a940bbd88c8e', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,177::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,402::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,420::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,421::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,421::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,422::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,422::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.dbdb8121-3e54-47d0-9a64-c02b9cc03c83', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,422::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,423::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,423::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,423::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,424::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,424::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,424::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8eaab457-8f02-4cff-9544-73d4e44a54e2', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,425::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,425::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,425::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,425::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.ab7680c7-9438-42eb-a6c4-29a77fca31ea', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,426::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.b4bf0747-2c4c-4d83-9f75-eb83759f5712', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,426::task::568::TaskManager.Task::(_updateState) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::moving from state running -> state finished >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,427::task::719::TaskManager.Task::(_save) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/179bf76e-a9cb-4ace-a2f4-21043760b0df.temp >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,437::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,437::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,438::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,438::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,438::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,438::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,438::task::880::TaskManager.Task::(_runJobs) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::Task.run: exit - success: result {'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e'} >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,439::task::957::TaskManager.Task::(_decref) Task=`179bf76e-a9cb-4ace-a2f4-21043760b0df`::ref 0 aborting False >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:43,439::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:01:44,110::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:44,216::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494895 s, 20.7 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:01:45,071::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:45,084::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000431157 s, 9.5 MB/s\n'; <rc> = 0 >Thread-618::DEBUG::2013-03-01 13:01:45,212::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-618::DEBUG::2013-03-01 13:01:45,213::task::568::TaskManager.Task::(_updateState) Task=`1d947430-b0b4-482b-952e-9e8ac9c5739e`::moving from state init -> state preparing >Thread-618::INFO::2013-03-01 13:01:45,213::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-618::INFO::2013-03-01 13:01:45,214::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-618::DEBUG::2013-03-01 13:01:45,214::task::1151::TaskManager.Task::(prepare) Task=`1d947430-b0b4-482b-952e-9e8ac9c5739e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-618::DEBUG::2013-03-01 13:01:45,214::task::568::TaskManager.Task::(_updateState) Task=`1d947430-b0b4-482b-952e-9e8ac9c5739e`::moving from state preparing -> state finished >Thread-618::DEBUG::2013-03-01 13:01:45,215::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-618::DEBUG::2013-03-01 13:01:45,215::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-618::DEBUG::2013-03-01 13:01:45,215::task::957::TaskManager.Task::(_decref) Task=`1d947430-b0b4-482b-952e-9e8ac9c5739e`::ref 0 aborting False >Thread-619::DEBUG::2013-03-01 13:01:45,241::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-619::DEBUG::2013-03-01 13:01:45,241::task::568::TaskManager.Task::(_updateState) Task=`cd6500b9-a36c-4170-a869-5c0f2eb49519`::moving from state init -> state preparing >Thread-619::INFO::2013-03-01 13:01:45,241::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-619::DEBUG::2013-03-01 13:01:45,242::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`ae805321-c633-43d8-a0e9-b1f7eecb2f8b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-619::DEBUG::2013-03-01 13:01:45,242::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-619::DEBUG::2013-03-01 13:01:45,243::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-619::DEBUG::2013-03-01 13:01:45,243::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`ae805321-c633-43d8-a0e9-b1f7eecb2f8b`::Granted request >Thread-619::DEBUG::2013-03-01 13:01:45,244::task::794::TaskManager.Task::(resourceAcquired) Task=`cd6500b9-a36c-4170-a869-5c0f2eb49519`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-619::DEBUG::2013-03-01 13:01:45,244::task::957::TaskManager.Task::(_decref) Task=`cd6500b9-a36c-4170-a869-5c0f2eb49519`::ref 1 aborting False >Thread-619::INFO::2013-03-01 13:01:45,245::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '39460012032', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-619::DEBUG::2013-03-01 13:01:45,246::task::1151::TaskManager.Task::(prepare) Task=`cd6500b9-a36c-4170-a869-5c0f2eb49519`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '39460012032', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-619::DEBUG::2013-03-01 13:01:45,246::task::568::TaskManager.Task::(_updateState) Task=`cd6500b9-a36c-4170-a869-5c0f2eb49519`::moving from state preparing -> state finished >Thread-619::DEBUG::2013-03-01 13:01:45,246::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-619::DEBUG::2013-03-01 13:01:45,247::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-619::DEBUG::2013-03-01 13:01:45,247::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-619::DEBUG::2013-03-01 13:01:45,247::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-619::DEBUG::2013-03-01 13:01:45,248::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-619::DEBUG::2013-03-01 13:01:45,248::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-619::DEBUG::2013-03-01 13:01:45,248::task::957::TaskManager.Task::(_decref) Task=`cd6500b9-a36c-4170-a869-5c0f2eb49519`::ref 0 aborting False >Thread-620::DEBUG::2013-03-01 13:01:45,288::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-620::DEBUG::2013-03-01 13:01:45,289::task::568::TaskManager.Task::(_updateState) Task=`065fdc83-4486-4cbb-8018-90a1f8596f77`::moving from state init -> state preparing >Thread-620::INFO::2013-03-01 13:01:45,289::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-620::DEBUG::2013-03-01 13:01:45,289::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-620::DEBUG::2013-03-01 13:01:45,290::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 179bf76e-a9cb-4ace-a2f4-21043760b0df >Thread-620::DEBUG::2013-03-01 13:01:45,290::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'} >Thread-620::DEBUG::2013-03-01 13:01:45,290::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 90b71e4e-999a-4d41-acb8-ec5864b43b1e >Thread-620::DEBUG::2013-03-01 13:01:45,290::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'} >Thread-620::DEBUG::2013-03-01 13:01:45,291::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'179bf76e-a9cb-4ace-a2f4-21043760b0df': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'}, '90b71e4e-999a-4d41-acb8-ec5864b43b1e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'}} >Thread-620::INFO::2013-03-01 13:01:45,291::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'179bf76e-a9cb-4ace-a2f4-21043760b0df': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'}, '90b71e4e-999a-4d41-acb8-ec5864b43b1e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'}}} >Thread-620::DEBUG::2013-03-01 13:01:45,291::task::1151::TaskManager.Task::(prepare) Task=`065fdc83-4486-4cbb-8018-90a1f8596f77`::finished: {'allTasksStatus': {'179bf76e-a9cb-4ace-a2f4-21043760b0df': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '179bf76e-a9cb-4ace-a2f4-21043760b0df'}, '90b71e4e-999a-4d41-acb8-ec5864b43b1e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '90b71e4e-999a-4d41-acb8-ec5864b43b1e'}}} >Thread-620::DEBUG::2013-03-01 13:01:45,292::task::568::TaskManager.Task::(_updateState) Task=`065fdc83-4486-4cbb-8018-90a1f8596f77`::moving from state preparing -> state finished >Thread-620::DEBUG::2013-03-01 13:01:45,292::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-620::DEBUG::2013-03-01 13:01:45,292::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-620::DEBUG::2013-03-01 13:01:45,292::task::957::TaskManager.Task::(_decref) Task=`065fdc83-4486-4cbb-8018-90a1f8596f77`::ref 0 aborting False >Thread-621::DEBUG::2013-03-01 13:01:45,367::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-621::DEBUG::2013-03-01 13:01:45,367::task::568::TaskManager.Task::(_updateState) Task=`9f65b050-b4a4-48a7-8f5e-dbeb239d3633`::moving from state init -> state preparing >Thread-621::INFO::2013-03-01 13:01:45,396::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='f3619dce-b683-4ae7-a623-29151a0b1040', volUUID='b93f5065-9fc7-4f49-8380-221d30abf3ad', options=None) >Thread-621::DEBUG::2013-03-01 13:01:45,397::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`689d37c5-2fa5-416c-bacc-86944b9d8213`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-621::DEBUG::2013-03-01 13:01:45,397::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-621::DEBUG::2013-03-01 13:01:45,397::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-621::DEBUG::2013-03-01 13:01:45,398::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`689d37c5-2fa5-416c-bacc-86944b9d8213`::Granted request >Thread-621::DEBUG::2013-03-01 13:01:45,398::task::794::TaskManager.Task::(resourceAcquired) Task=`9f65b050-b4a4-48a7-8f5e-dbeb239d3633`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-621::DEBUG::2013-03-01 13:01:45,399::task::957::TaskManager.Task::(_decref) Task=`9f65b050-b4a4-48a7-8f5e-dbeb239d3633`::ref 1 aborting False >Thread-621::INFO::2013-03-01 13:01:45,399::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=f3619dce-b683-4ae7-a623-29151a0b1040 volUUID = b93f5065-9fc7-4f49-8380-221d30abf3ad >Thread-621::DEBUG::2013-03-01 13:01:45,400::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-621::DEBUG::2013-03-01 13:01:45,409::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000318972 s, 1.6 MB/s\n'; <rc> = 0 >Thread-621::DEBUG::2013-03-01 13:01:45,409::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000318972 s, 1.6 MB/s'], size: 512 >Thread-621::DEBUG::2013-03-01 13:01:45,410::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-621::DEBUG::2013-03-01 13:01:45,420::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000401737 s, 1.3 MB/s\n'; <rc> = 0 >Thread-621::DEBUG::2013-03-01 13:01:45,421::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000401737 s, 1.3 MB/s'], size: 512 >Thread-621::DEBUG::2013-03-01 13:01:45,421::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-621::DEBUG::2013-03-01 13:01:45,422::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-621::DEBUG::2013-03-01 13:01:45,671::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-621::DEBUG::2013-03-01 13:01:45,689::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-621::INFO::2013-03-01 13:01:45,689::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'f3619dce-b683-4ae7-a623-29151a0b1040', 'ctime': '1362135691', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135697', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-621::INFO::2013-03-01 13:01:45,690::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'f3619dce-b683-4ae7-a623-29151a0b1040', 'ctime': '1362135691', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135697', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-621::DEBUG::2013-03-01 13:01:45,690::task::1151::TaskManager.Task::(prepare) Task=`9f65b050-b4a4-48a7-8f5e-dbeb239d3633`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'f3619dce-b683-4ae7-a623-29151a0b1040', 'ctime': '1362135691', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135697', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-621::DEBUG::2013-03-01 13:01:45,690::task::568::TaskManager.Task::(_updateState) Task=`9f65b050-b4a4-48a7-8f5e-dbeb239d3633`::moving from state preparing -> state finished >Thread-621::DEBUG::2013-03-01 13:01:45,690::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-621::DEBUG::2013-03-01 13:01:45,690::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-621::DEBUG::2013-03-01 13:01:45,691::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-621::DEBUG::2013-03-01 13:01:45,691::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-621::DEBUG::2013-03-01 13:01:45,691::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-621::DEBUG::2013-03-01 13:01:45,691::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-621::DEBUG::2013-03-01 13:01:45,692::task::957::TaskManager.Task::(_decref) Task=`9f65b050-b4a4-48a7-8f5e-dbeb239d3633`::ref 0 aborting False >Thread-622::DEBUG::2013-03-01 13:01:45,727::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-622::DEBUG::2013-03-01 13:01:45,728::task::568::TaskManager.Task::(_updateState) Task=`ce8af351-4455-4c17-956a-caf812d92469`::moving from state init -> state preparing >Thread-622::INFO::2013-03-01 13:01:45,728::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='dbdb8121-3e54-47d0-9a64-c02b9cc03c83', volUUID='d23337b9-f9f7-4b74-bf30-a940bbd88c8e', options=None) >Thread-622::DEBUG::2013-03-01 13:01:45,729::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d07aa7ed-3f18-4c2e-9a1b-6b14b73a9845`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-622::DEBUG::2013-03-01 13:01:45,729::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-622::DEBUG::2013-03-01 13:01:45,729::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-622::DEBUG::2013-03-01 13:01:45,730::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d07aa7ed-3f18-4c2e-9a1b-6b14b73a9845`::Granted request >Thread-622::DEBUG::2013-03-01 13:01:45,730::task::794::TaskManager.Task::(resourceAcquired) Task=`ce8af351-4455-4c17-956a-caf812d92469`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-622::DEBUG::2013-03-01 13:01:45,731::task::957::TaskManager.Task::(_decref) Task=`ce8af351-4455-4c17-956a-caf812d92469`::ref 1 aborting False >Thread-622::INFO::2013-03-01 13:01:45,731::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=dbdb8121-3e54-47d0-9a64-c02b9cc03c83 volUUID = d23337b9-f9f7-4b74-bf30-a940bbd88c8e >Thread-622::DEBUG::2013-03-01 13:01:45,732::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-622::DEBUG::2013-03-01 13:01:45,742::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000356437 s, 1.4 MB/s\n'; <rc> = 0 >Thread-622::DEBUG::2013-03-01 13:01:45,742::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000356437 s, 1.4 MB/s'], size: 512 >Thread-622::DEBUG::2013-03-01 13:01:45,743::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-622::DEBUG::2013-03-01 13:01:45,753::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000304198 s, 1.7 MB/s\n'; <rc> = 0 >Thread-622::DEBUG::2013-03-01 13:01:45,754::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000304198 s, 1.7 MB/s'], size: 512 >Thread-622::DEBUG::2013-03-01 13:01:45,754::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-622::DEBUG::2013-03-01 13:01:45,755::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-622::DEBUG::2013-03-01 13:01:45,946::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-622::DEBUG::2013-03-01 13:01:45,963::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-622::INFO::2013-03-01 13:01:45,964::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'ctime': '1362135695', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135700', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-622::INFO::2013-03-01 13:01:45,964::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'ctime': '1362135695', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135700', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-622::DEBUG::2013-03-01 13:01:45,964::task::1151::TaskManager.Task::(prepare) Task=`ce8af351-4455-4c17-956a-caf812d92469`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'ctime': '1362135695', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135700', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-622::DEBUG::2013-03-01 13:01:45,965::task::568::TaskManager.Task::(_updateState) Task=`ce8af351-4455-4c17-956a-caf812d92469`::moving from state preparing -> state finished >Thread-622::DEBUG::2013-03-01 13:01:45,965::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-622::DEBUG::2013-03-01 13:01:45,965::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-622::DEBUG::2013-03-01 13:01:45,966::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-622::DEBUG::2013-03-01 13:01:45,966::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-622::DEBUG::2013-03-01 13:01:45,966::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-622::DEBUG::2013-03-01 13:01:45,966::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-622::DEBUG::2013-03-01 13:01:45,967::task::957::TaskManager.Task::(_decref) Task=`ce8af351-4455-4c17-956a-caf812d92469`::ref 0 aborting False >Thread-623::DEBUG::2013-03-01 13:01:46,041::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-623::DEBUG::2013-03-01 13:01:46,042::task::568::TaskManager.Task::(_updateState) Task=`13a0af13-adcc-42bc-8a42-1fdece1ada98`::moving from state init -> state preparing >Thread-623::INFO::2013-03-01 13:01:46,042::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='f3619dce-b683-4ae7-a623-29151a0b1040', volUUID='b93f5065-9fc7-4f49-8380-221d30abf3ad', options=None) >Thread-623::DEBUG::2013-03-01 13:01:46,043::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1fa0fbcd-a714-4dd6-a02d-50059fae0f30`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-623::DEBUG::2013-03-01 13:01:46,043::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-623::DEBUG::2013-03-01 13:01:46,044::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-623::DEBUG::2013-03-01 13:01:46,044::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`1fa0fbcd-a714-4dd6-a02d-50059fae0f30`::Granted request >Thread-623::DEBUG::2013-03-01 13:01:46,044::task::794::TaskManager.Task::(resourceAcquired) Task=`13a0af13-adcc-42bc-8a42-1fdece1ada98`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-623::DEBUG::2013-03-01 13:01:46,045::task::957::TaskManager.Task::(_decref) Task=`13a0af13-adcc-42bc-8a42-1fdece1ada98`::ref 1 aborting False >Thread-623::INFO::2013-03-01 13:01:46,045::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=f3619dce-b683-4ae7-a623-29151a0b1040 volUUID = b93f5065-9fc7-4f49-8380-221d30abf3ad >Thread-623::DEBUG::2013-03-01 13:01:46,046::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-623::DEBUG::2013-03-01 13:01:46,056::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000351838 s, 1.5 MB/s\n'; <rc> = 0 >Thread-623::DEBUG::2013-03-01 13:01:46,057::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000351838 s, 1.5 MB/s'], size: 512 >Thread-623::DEBUG::2013-03-01 13:01:46,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-623::DEBUG::2013-03-01 13:01:46,067::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000356132 s, 1.4 MB/s\n'; <rc> = 0 >Thread-623::DEBUG::2013-03-01 13:01:46,068::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000356132 s, 1.4 MB/s'], size: 512 >Thread-623::DEBUG::2013-03-01 13:01:46,069::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-623::DEBUG::2013-03-01 13:01:46,070::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:46,231::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-623::DEBUG::2013-03-01 13:01:46,274::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-623::DEBUG::2013-03-01 13:01:46,318::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-623::INFO::2013-03-01 13:01:46,321::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'f3619dce-b683-4ae7-a623-29151a0b1040', 'ctime': '1362135691', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135697', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-623::INFO::2013-03-01 13:01:46,322::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'f3619dce-b683-4ae7-a623-29151a0b1040', 'ctime': '1362135691', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135697', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-623::DEBUG::2013-03-01 13:01:46,324::task::1151::TaskManager.Task::(prepare) Task=`13a0af13-adcc-42bc-8a42-1fdece1ada98`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'f3619dce-b683-4ae7-a623-29151a0b1040', 'ctime': '1362135691', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135697', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'b93f5065-9fc7-4f49-8380-221d30abf3ad', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-623::DEBUG::2013-03-01 13:01:46,325::task::568::TaskManager.Task::(_updateState) Task=`13a0af13-adcc-42bc-8a42-1fdece1ada98`::moving from state preparing -> state finished >Thread-623::DEBUG::2013-03-01 13:01:46,326::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-623::DEBUG::2013-03-01 13:01:46,328::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-623::DEBUG::2013-03-01 13:01:46,330::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-623::DEBUG::2013-03-01 13:01:46,332::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-623::DEBUG::2013-03-01 13:01:46,333::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-623::DEBUG::2013-03-01 13:01:46,334::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-623::DEBUG::2013-03-01 13:01:46,336::task::957::TaskManager.Task::(_decref) Task=`13a0af13-adcc-42bc-8a42-1fdece1ada98`::ref 0 aborting False >Thread-624::DEBUG::2013-03-01 13:01:46,380::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-624::DEBUG::2013-03-01 13:01:46,382::task::568::TaskManager.Task::(_updateState) Task=`7029c414-de8d-4816-ac27-fca78f397e68`::moving from state init -> state preparing >Thread-624::INFO::2013-03-01 13:01:46,384::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='179bf76e-a9cb-4ace-a2f4-21043760b0df', spUUID=None, options=None) >Thread-624::DEBUG::2013-03-01 13:01:46,385::taskManager::161::TaskManager::(clearTask) Entry. taskID: 179bf76e-a9cb-4ace-a2f4-21043760b0df >Thread-624::DEBUG::2013-03-01 13:01:46,388::taskManager::166::TaskManager::(clearTask) Return. >Thread-624::INFO::2013-03-01 13:01:46,389::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-624::DEBUG::2013-03-01 13:01:46,390::task::1151::TaskManager.Task::(prepare) Task=`7029c414-de8d-4816-ac27-fca78f397e68`::finished: None >Thread-624::DEBUG::2013-03-01 13:01:46,391::task::568::TaskManager.Task::(_updateState) Task=`7029c414-de8d-4816-ac27-fca78f397e68`::moving from state preparing -> state finished >Thread-624::DEBUG::2013-03-01 13:01:46,392::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-624::DEBUG::2013-03-01 13:01:46,393::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-624::DEBUG::2013-03-01 13:01:46,395::task::957::TaskManager.Task::(_decref) Task=`7029c414-de8d-4816-ac27-fca78f397e68`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:01:46,422::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112177 s, 9.1 MB/s\n'; <rc> = 0 >Thread-625::DEBUG::2013-03-01 13:01:46,426::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-625::DEBUG::2013-03-01 13:01:46,428::task::568::TaskManager.Task::(_updateState) Task=`f15c5c98-e794-4c3a-8e6e-011ea15cc704`::moving from state init -> state preparing >Thread-625::INFO::2013-03-01 13:01:46,429::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='dbdb8121-3e54-47d0-9a64-c02b9cc03c83', volUUID='d23337b9-f9f7-4b74-bf30-a940bbd88c8e', options=None) >Thread-625::DEBUG::2013-03-01 13:01:46,431::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9a712c67-9633-4c9b-8a67-ada8d8817cd5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-625::DEBUG::2013-03-01 13:01:46,432::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-625::DEBUG::2013-03-01 13:01:46,434::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-625::DEBUG::2013-03-01 13:01:46,435::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9a712c67-9633-4c9b-8a67-ada8d8817cd5`::Granted request >Thread-625::DEBUG::2013-03-01 13:01:46,437::task::794::TaskManager.Task::(resourceAcquired) Task=`f15c5c98-e794-4c3a-8e6e-011ea15cc704`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-625::DEBUG::2013-03-01 13:01:46,438::task::957::TaskManager.Task::(_decref) Task=`f15c5c98-e794-4c3a-8e6e-011ea15cc704`::ref 1 aborting False >Thread-625::INFO::2013-03-01 13:01:46,440::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=dbdb8121-3e54-47d0-9a64-c02b9cc03c83 volUUID = d23337b9-f9f7-4b74-bf30-a940bbd88c8e >Thread-625::DEBUG::2013-03-01 13:01:46,441::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-625::DEBUG::2013-03-01 13:01:46,461::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000332365 s, 1.5 MB/s\n'; <rc> = 0 >Thread-625::DEBUG::2013-03-01 13:01:46,463::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000332365 s, 1.5 MB/s'], size: 512 >Thread-625::DEBUG::2013-03-01 13:01:46,467::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-625::DEBUG::2013-03-01 13:01:46,484::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031536 s, 1.6 MB/s\n'; <rc> = 0 >Thread-625::DEBUG::2013-03-01 13:01:46,486::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031536 s, 1.6 MB/s'], size: 512 >Thread-625::DEBUG::2013-03-01 13:01:46,488::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-625::DEBUG::2013-03-01 13:01:46,492::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:46,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:46,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000330105 s, 12.4 MB/s\n'; <rc> = 0 >Thread-625::DEBUG::2013-03-01 13:01:46,740::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-625::DEBUG::2013-03-01 13:01:46,756::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-625::INFO::2013-03-01 13:01:46,757::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'ctime': '1362135695', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135700', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-625::INFO::2013-03-01 13:01:46,758::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'ctime': '1362135695', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135700', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-625::DEBUG::2013-03-01 13:01:46,758::task::1151::TaskManager.Task::(prepare) Task=`f15c5c98-e794-4c3a-8e6e-011ea15cc704`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'dbdb8121-3e54-47d0-9a64-c02b9cc03c83', 'ctime': '1362135695', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135700', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'd23337b9-f9f7-4b74-bf30-a940bbd88c8e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-625::DEBUG::2013-03-01 13:01:46,758::task::568::TaskManager.Task::(_updateState) Task=`f15c5c98-e794-4c3a-8e6e-011ea15cc704`::moving from state preparing -> state finished >Thread-625::DEBUG::2013-03-01 13:01:46,759::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-625::DEBUG::2013-03-01 13:01:46,759::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-625::DEBUG::2013-03-01 13:01:46,759::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-625::DEBUG::2013-03-01 13:01:46,760::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-625::DEBUG::2013-03-01 13:01:46,760::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-625::DEBUG::2013-03-01 13:01:46,760::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-625::DEBUG::2013-03-01 13:01:46,761::task::957::TaskManager.Task::(_decref) Task=`f15c5c98-e794-4c3a-8e6e-011ea15cc704`::ref 0 aborting False >Thread-626::DEBUG::2013-03-01 13:01:46,822::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-626::DEBUG::2013-03-01 13:01:46,823::task::568::TaskManager.Task::(_updateState) Task=`7bcd308b-2e35-4e8b-aade-64fc73fb0d11`::moving from state init -> state preparing >Thread-626::INFO::2013-03-01 13:01:46,824::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='90b71e4e-999a-4d41-acb8-ec5864b43b1e', spUUID=None, options=None) >Thread-626::DEBUG::2013-03-01 13:01:46,824::taskManager::161::TaskManager::(clearTask) Entry. taskID: 90b71e4e-999a-4d41-acb8-ec5864b43b1e >Thread-626::DEBUG::2013-03-01 13:01:46,825::taskManager::166::TaskManager::(clearTask) Return. >Thread-626::INFO::2013-03-01 13:01:46,826::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-626::DEBUG::2013-03-01 13:01:46,826::task::1151::TaskManager.Task::(prepare) Task=`7bcd308b-2e35-4e8b-aade-64fc73fb0d11`::finished: None >Thread-626::DEBUG::2013-03-01 13:01:46,826::task::568::TaskManager.Task::(_updateState) Task=`7bcd308b-2e35-4e8b-aade-64fc73fb0d11`::moving from state preparing -> state finished >Thread-626::DEBUG::2013-03-01 13:01:46,826::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-626::DEBUG::2013-03-01 13:01:46,827::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-626::DEBUG::2013-03-01 13:01:46,827::task::957::TaskManager.Task::(_decref) Task=`7bcd308b-2e35-4e8b-aade-64fc73fb0d11`::ref 0 aborting False >Thread-627::DEBUG::2013-03-01 13:01:47,159::task::568::TaskManager.Task::(_updateState) Task=`a13062f8-b705-47d0-8b8c-4b1b02b0cd74`::moving from state init -> state preparing >Thread-627::INFO::2013-03-01 13:01:47,159::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-627::INFO::2013-03-01 13:01:47,160::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0235359668732', 'lastCheck': '0.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0128688812256', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-627::DEBUG::2013-03-01 13:01:47,160::task::1151::TaskManager.Task::(prepare) Task=`a13062f8-b705-47d0-8b8c-4b1b02b0cd74`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0235359668732', 'lastCheck': '0.6', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0128688812256', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-627::DEBUG::2013-03-01 13:01:47,160::task::568::TaskManager.Task::(_updateState) Task=`a13062f8-b705-47d0-8b8c-4b1b02b0cd74`::moving from state preparing -> state finished >Thread-627::DEBUG::2013-03-01 13:01:47,160::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-627::DEBUG::2013-03-01 13:01:47,161::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-627::DEBUG::2013-03-01 13:01:47,161::task::957::TaskManager.Task::(_decref) Task=`a13062f8-b705-47d0-8b8c-4b1b02b0cd74`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:01:48,538::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:48,642::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412661 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:50,662::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:50,746::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385867 s, 26.5 MB/s\n'; <rc> = 0 >Thread-630::DEBUG::2013-03-01 13:01:51,567::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-630::DEBUG::2013-03-01 13:01:51,567::task::568::TaskManager.Task::(_updateState) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::moving from state init -> state preparing >Thread-630::INFO::2013-03-01 13:01:51,568::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='dbdb8121-3e54-47d0-9a64-c02b9cc03c83', postZero='false', force='false') >Thread-630::INFO::2013-03-01 13:01:51,568::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-630::DEBUG::2013-03-01 13:01:51,569::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-630::DEBUG::2013-03-01 13:01:51,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-630::DEBUG::2013-03-01 13:01:51,758::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,759::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,759::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,759::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,760::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-630::DEBUG::2013-03-01 13:01:51,955::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-630::DEBUG::2013-03-01 13:01:51,958::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,958::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-630::DEBUG::2013-03-01 13:01:51,960::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83`ReqID=`870eb203-92cf-44a6-ba72-e672587dbf76`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-630::DEBUG::2013-03-01 13:01:51,960::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' for lock type 'exclusive' >Thread-630::DEBUG::2013-03-01 13:01:51,960::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' is free. Now locking as 'exclusive' (1 active user) >Thread-630::DEBUG::2013-03-01 13:01:51,961::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83`ReqID=`870eb203-92cf-44a6-ba72-e672587dbf76`::Granted request >Thread-630::DEBUG::2013-03-01 13:01:51,961::task::794::TaskManager.Task::(resourceAcquired) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_resourcesAcquired: Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83 (exclusive) >Thread-630::DEBUG::2013-03-01 13:01:51,962::task::957::TaskManager.Task::(_decref) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::ref 1 aborting False >Thread-630::DEBUG::2013-03-01 13:01:51,962::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`711110b1-1c1f-4a8c-9ec5-4f2bf95b4b5b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-630::DEBUG::2013-03-01 13:01:51,963::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-630::DEBUG::2013-03-01 13:01:51,963::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-630::DEBUG::2013-03-01 13:01:51,963::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`711110b1-1c1f-4a8c-9ec5-4f2bf95b4b5b`::Granted request >Thread-630::DEBUG::2013-03-01 13:01:51,964::task::794::TaskManager.Task::(resourceAcquired) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-630::DEBUG::2013-03-01 13:01:51,964::task::957::TaskManager.Task::(_decref) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::ref 1 aborting False >Thread-630::DEBUG::2013-03-01 13:01:51,965::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:51,965::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-630::DEBUG::2013-03-01 13:01:52,189::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-630::DEBUG::2013-03-01 13:01:52,208::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:52,210::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/d23337b9-f9f7-4b74-bf30-a940bbd88c8e' (cwd None) >Thread-630::DEBUG::2013-03-01 13:01:52,412::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-630::DEBUG::2013-03-01 13:01:52,413::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:52,413::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-630::DEBUG::2013-03-01 13:01:52,414::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83/d23337b9-f9f7-4b74-bf30-a940bbd88c8e'] >Thread-630::DEBUG::2013-03-01 13:01:52,414::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/dbdb8121-3e54-47d0-9a64-c02b9cc03c83 >Thread-630::DEBUG::2013-03-01 13:01:52,416::task::719::TaskManager.Task::(_save) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985.temp >Thread-630::DEBUG::2013-03-01 13:01:52,422::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_dbdb8121-3e54-47d0-9a64-c02b9cc03c83 for task bc2c49f8-2929-4ea7-8d09-4420d7b21985 >Thread-630::INFO::2013-03-01 13:01:52,423::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-630::DEBUG::2013-03-01 13:01:52,423::task::1146::TaskManager.Task::(prepare) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::Prepare: 1 jobs exist, move to acquiring >Thread-630::DEBUG::2013-03-01 13:01:52,423::task::568::TaskManager.Task::(_updateState) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::moving from state preparing -> state acquiring >Thread-630::DEBUG::2013-03-01 13:01:52,424::task::719::TaskManager.Task::(_save) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985.temp >Thread-630::DEBUG::2013-03-01 13:01:52,431::task::568::TaskManager.Task::(_updateState) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::moving from state acquiring -> state queued >Thread-630::DEBUG::2013-03-01 13:01:52,432::task::719::TaskManager.Task::(_save) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985.temp >Thread-630::DEBUG::2013-03-01 13:01:52,439::taskManager::50::TaskManager::(_queueTask) queuing task: bc2c49f8-2929-4ea7-8d09-4420d7b21985 >Thread-630::DEBUG::2013-03-01 13:01:52,439::taskManager::56::TaskManager::(_queueTask) task queued: bc2c49f8-2929-4ea7-8d09-4420d7b21985 >179bf76e-a9cb-4ace-a2f4-21043760b0df::DEBUG::2013-03-01 13:01:52,440::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,441::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: bc2c49f8-2929-4ea7-8d09-4420d7b21985 running: <bound method Task.commit of <storage.task.Task instance at 0x178fe18>> with: None >Thread-630::DEBUG::2013-03-01 13:01:52,441::task::1148::TaskManager.Task::(prepare) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::returning >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,442::task::1159::TaskManager.Task::(commit) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::committing task: bc2c49f8-2929-4ea7-8d09-4420d7b21985 >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,443::task::568::TaskManager.Task::(_updateState) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::moving from state queued -> state running >Thread-630::DEBUG::2013-03-01 13:01:52,443::task::957::TaskManager.Task::(_decref) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::ref 0 aborting False >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,447::task::719::TaskManager.Task::(_save) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985.temp >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,457::task::872::TaskManager.Task::(_runJobs) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::Task.run: running job 0: deleteImage_dbdb8121-3e54-47d0-9a64-c02b9cc03c83: <function <lambda> at 0x7f15f0044b18> (args: () kwargs: {}) >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,457::task::304::TaskManager.Task::(run) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::Job.run: running deleteImage_dbdb8121-3e54-47d0-9a64-c02b9cc03c83: <function <lambda> at 0x7f15f0044b18> (args: () kwargs: {}) callback None >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,458::task::568::TaskManager.Task::(_updateState) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::moving from state running -> state finished >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,458::task::719::TaskManager.Task::(_save) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/bc2c49f8-2929-4ea7-8d09-4420d7b21985.temp >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,466::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83': < ResourceRef 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83', isValid: 'True' obj: 'None'>} >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,467::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,467::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,468::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,468::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,468::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,469::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,469::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' (0 active users) >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,469::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83' is free, finding out if anyone is waiting for it. >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,469::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbdb8121-3e54-47d0-9a64-c02b9cc03c83', Clearing records. >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,470::task::880::TaskManager.Task::(_runJobs) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::Task.run: exit - success: result True >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,470::task::957::TaskManager.Task::(_decref) Task=`bc2c49f8-2929-4ea7-8d09-4420d7b21985`::ref 0 aborting False >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:01:52,470::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-631::DEBUG::2013-03-01 13:01:52,480::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-631::DEBUG::2013-03-01 13:01:52,481::task::568::TaskManager.Task::(_updateState) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::moving from state init -> state preparing >Thread-631::INFO::2013-03-01 13:01:52,481::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a634d930-00cd-440a-887c-5b4d9418c125', postZero='false', force='false') >Thread-631::INFO::2013-03-01 13:01:52,482::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-631::DEBUG::2013-03-01 13:01:52,482::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-631::DEBUG::2013-03-01 13:01:52,677::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-631::DEBUG::2013-03-01 13:01:52,677::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:52,677::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:52,678::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:52,678::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:52,678::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:52,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:52,759::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:52,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058403 s, 17.5 MB/s\n'; <rc> = 0 >Thread-631::DEBUG::2013-03-01 13:01:53,030::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-631::DEBUG::2013-03-01 13:01:53,031::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,032::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-631::DEBUG::2013-03-01 13:01:53,033::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`9022d9c3-df51-46f3-86aa-a8856bff6a09`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-631::DEBUG::2013-03-01 13:01:53,033::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a634d930-00cd-440a-887c-5b4d9418c125' for lock type 'exclusive' >Thread-631::DEBUG::2013-03-01 13:01:53,034::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a634d930-00cd-440a-887c-5b4d9418c125' is free. Now locking as 'exclusive' (1 active user) >Thread-631::DEBUG::2013-03-01 13:01:53,034::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a634d930-00cd-440a-887c-5b4d9418c125`ReqID=`9022d9c3-df51-46f3-86aa-a8856bff6a09`::Granted request >Thread-631::DEBUG::2013-03-01 13:01:53,035::task::794::TaskManager.Task::(resourceAcquired) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_resourcesAcquired: Storage.a634d930-00cd-440a-887c-5b4d9418c125 (exclusive) >Thread-631::DEBUG::2013-03-01 13:01:53,035::task::957::TaskManager.Task::(_decref) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::ref 1 aborting False >Thread-631::DEBUG::2013-03-01 13:01:53,035::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`70a375aa-932e-4a98-98f4-82ad2ea63fec`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-631::DEBUG::2013-03-01 13:01:53,036::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-631::DEBUG::2013-03-01 13:01:53,036::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-631::DEBUG::2013-03-01 13:01:53,036::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`70a375aa-932e-4a98-98f4-82ad2ea63fec`::Granted request >Thread-631::DEBUG::2013-03-01 13:01:53,037::task::794::TaskManager.Task::(resourceAcquired) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-631::DEBUG::2013-03-01 13:01:53,037::task::957::TaskManager.Task::(_decref) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::ref 1 aborting False >Thread-631::DEBUG::2013-03-01 13:01:53,037::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,038::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-631::DEBUG::2013-03-01 13:01:53,285::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-631::DEBUG::2013-03-01 13:01:53,315::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,316::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/75df5092-6aca-42ec-9cfb-56a127ef2aa5 a558fc2a-a4a3-4118-9b81-d1d601eaa295/673701ef-131b-4e14-84ef-1e03e542b4b8' (cwd None) >Thread-631::DEBUG::2013-03-01 13:01:53,585::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-631::DEBUG::2013-03-01 13:01:53,586::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,587::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,587::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,587::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-631::DEBUG::2013-03-01 13:01:53,588::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125/673701ef-131b-4e14-84ef-1e03e542b4b8'] >Thread-631::DEBUG::2013-03-01 13:01:53,588::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a634d930-00cd-440a-887c-5b4d9418c125 >Thread-631::DEBUG::2013-03-01 13:01:53,590::task::719::TaskManager.Task::(_save) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d.temp >Thread-631::DEBUG::2013-03-01 13:01:53,597::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_a634d930-00cd-440a-887c-5b4d9418c125 for task 6d0efd51-9c31-40a0-b9f7-951957fc189d >Thread-631::INFO::2013-03-01 13:01:53,597::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-631::DEBUG::2013-03-01 13:01:53,597::task::1146::TaskManager.Task::(prepare) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::Prepare: 1 jobs exist, move to acquiring >Thread-631::DEBUG::2013-03-01 13:01:53,598::task::568::TaskManager.Task::(_updateState) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::moving from state preparing -> state acquiring >Thread-631::DEBUG::2013-03-01 13:01:53,598::task::719::TaskManager.Task::(_save) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d.temp >Thread-631::DEBUG::2013-03-01 13:01:53,605::task::568::TaskManager.Task::(_updateState) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::moving from state acquiring -> state queued >Thread-631::DEBUG::2013-03-01 13:01:53,606::task::719::TaskManager.Task::(_save) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d.temp >Thread-631::DEBUG::2013-03-01 13:01:53,613::taskManager::50::TaskManager::(_queueTask) queuing task: 6d0efd51-9c31-40a0-b9f7-951957fc189d >7a299c41-6f96-4b93-b76d-796e99182815::DEBUG::2013-03-01 13:01:53,614::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-631::DEBUG::2013-03-01 13:01:53,613::taskManager::56::TaskManager::(_queueTask) task queued: 6d0efd51-9c31-40a0-b9f7-951957fc189d >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,615::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 6d0efd51-9c31-40a0-b9f7-951957fc189d running: <bound method Task.commit of <storage.task.Task instance at 0x17c0e18>> with: None >Thread-631::DEBUG::2013-03-01 13:01:53,616::task::1148::TaskManager.Task::(prepare) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::returning >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,617::task::1159::TaskManager.Task::(commit) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::committing task: 6d0efd51-9c31-40a0-b9f7-951957fc189d >Thread-631::DEBUG::2013-03-01 13:01:53,619::task::957::TaskManager.Task::(_decref) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::ref 0 aborting False >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,619::task::568::TaskManager.Task::(_updateState) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::moving from state queued -> state running >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,625::task::719::TaskManager.Task::(_save) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d.temp >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,634::task::872::TaskManager.Task::(_runJobs) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::Task.run: running job 0: deleteImage_a634d930-00cd-440a-887c-5b4d9418c125: <function <lambda> at 0x7f15f0046500> (args: () kwargs: {}) >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,634::task::304::TaskManager.Task::(run) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::Job.run: running deleteImage_a634d930-00cd-440a-887c-5b4d9418c125: <function <lambda> at 0x7f15f0046500> (args: () kwargs: {}) callback None >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,635::task::568::TaskManager.Task::(_updateState) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::moving from state running -> state finished >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,635::task::719::TaskManager.Task::(_save) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/6d0efd51-9c31-40a0-b9f7-951957fc189d.temp >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,644::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.a634d930-00cd-440a-887c-5b4d9418c125': < ResourceRef 'Storage.a634d930-00cd-440a-887c-5b4d9418c125', isValid: 'True' obj: 'None'>} >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,644::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,645::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,645::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,645::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,645::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,646::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a634d930-00cd-440a-887c-5b4d9418c125' >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,646::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a634d930-00cd-440a-887c-5b4d9418c125' (0 active users) >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,647::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a634d930-00cd-440a-887c-5b4d9418c125' is free, finding out if anyone is waiting for it. >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,647::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a634d930-00cd-440a-887c-5b4d9418c125', Clearing records. >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,647::task::880::TaskManager.Task::(_runJobs) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::Task.run: exit - success: result True >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,648::task::957::TaskManager.Task::(_decref) Task=`6d0efd51-9c31-40a0-b9f7-951957fc189d`::ref 0 aborting False >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:01:53,648::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-633::DEBUG::2013-03-01 13:01:53,649::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-633::DEBUG::2013-03-01 13:01:53,650::task::568::TaskManager.Task::(_updateState) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::moving from state init -> state preparing >Thread-633::INFO::2013-03-01 13:01:53,650::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='f3619dce-b683-4ae7-a623-29151a0b1040', postZero='false', force='false') >Thread-633::INFO::2013-03-01 13:01:53,651::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-633::DEBUG::2013-03-01 13:01:53,651::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-633::DEBUG::2013-03-01 13:01:53,896::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-633::DEBUG::2013-03-01 13:01:53,897::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:53,897::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:53,897::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:53,898::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:53,898::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:53,899::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-633::DEBUG::2013-03-01 13:01:54,240::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-633::DEBUG::2013-03-01 13:01:54,243::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:54,243::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-633::DEBUG::2013-03-01 13:01:54,245::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f3619dce-b683-4ae7-a623-29151a0b1040`ReqID=`6c2a2467-0308-45fd-8a5a-a5fda47777b5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-633::DEBUG::2013-03-01 13:01:54,245::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040' for lock type 'exclusive' >Thread-633::DEBUG::2013-03-01 13:01:54,246::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040' is free. Now locking as 'exclusive' (1 active user) >Thread-633::DEBUG::2013-03-01 13:01:54,246::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f3619dce-b683-4ae7-a623-29151a0b1040`ReqID=`6c2a2467-0308-45fd-8a5a-a5fda47777b5`::Granted request >Thread-633::DEBUG::2013-03-01 13:01:54,247::task::794::TaskManager.Task::(resourceAcquired) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_resourcesAcquired: Storage.f3619dce-b683-4ae7-a623-29151a0b1040 (exclusive) >Thread-633::DEBUG::2013-03-01 13:01:54,247::task::957::TaskManager.Task::(_decref) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::ref 1 aborting False >Thread-633::DEBUG::2013-03-01 13:01:54,248::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`755b5487-a991-40d2-9374-a991ca02e24b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-633::DEBUG::2013-03-01 13:01:54,248::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-633::DEBUG::2013-03-01 13:01:54,248::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-633::DEBUG::2013-03-01 13:01:54,248::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`755b5487-a991-40d2-9374-a991ca02e24b`::Granted request >Thread-633::DEBUG::2013-03-01 13:01:54,249::task::794::TaskManager.Task::(resourceAcquired) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-633::DEBUG::2013-03-01 13:01:54,249::task::957::TaskManager.Task::(_decref) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::ref 1 aborting False >Thread-633::DEBUG::2013-03-01 13:01:54,250::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:54,251::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-633::DEBUG::2013-03-01 13:01:54,499::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-633::DEBUG::2013-03-01 13:01:54,515::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:54,517::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/b93f5065-9fc7-4f49-8380-221d30abf3ad' (cwd None) >Thread-633::DEBUG::2013-03-01 13:01:54,772::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-633::DEBUG::2013-03-01 13:01:54,773::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:54,774::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-633::DEBUG::2013-03-01 13:01:54,774::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040/b93f5065-9fc7-4f49-8380-221d30abf3ad'] >Thread-633::DEBUG::2013-03-01 13:01:54,774::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/f3619dce-b683-4ae7-a623-29151a0b1040 >Thread-633::DEBUG::2013-03-01 13:01:54,776::task::719::TaskManager.Task::(_save) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634.temp >Thread-633::DEBUG::2013-03-01 13:01:54,783::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_f3619dce-b683-4ae7-a623-29151a0b1040 for task 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 >Thread-633::INFO::2013-03-01 13:01:54,783::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-633::DEBUG::2013-03-01 13:01:54,784::task::1146::TaskManager.Task::(prepare) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::Prepare: 1 jobs exist, move to acquiring >Thread-633::DEBUG::2013-03-01 13:01:54,784::task::568::TaskManager.Task::(_updateState) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::moving from state preparing -> state acquiring >Thread-633::DEBUG::2013-03-01 13:01:54,785::task::719::TaskManager.Task::(_save) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634.temp >Thread-633::DEBUG::2013-03-01 13:01:54,792::task::568::TaskManager.Task::(_updateState) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::moving from state acquiring -> state queued >Thread-633::DEBUG::2013-03-01 13:01:54,793::task::719::TaskManager.Task::(_save) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634.temp >Thread-633::DEBUG::2013-03-01 13:01:54,800::taskManager::50::TaskManager::(_queueTask) queuing task: 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 >Thread-633::DEBUG::2013-03-01 13:01:54,800::taskManager::56::TaskManager::(_queueTask) task queued: 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 >f7474b2c-7aa3-420d-944b-34b792bbd795::DEBUG::2013-03-01 13:01:54,801::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-633::DEBUG::2013-03-01 13:01:54,801::task::1148::TaskManager.Task::(prepare) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::returning >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,802::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 running: <bound method Task.commit of <storage.task.Task instance at 0x16ebcb0>> with: None >Thread-633::DEBUG::2013-03-01 13:01:54,803::task::957::TaskManager.Task::(_decref) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::ref 0 aborting False >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,804::task::1159::TaskManager.Task::(commit) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::committing task: 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,806::task::568::TaskManager.Task::(_updateState) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::moving from state queued -> state running >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,808::task::719::TaskManager.Task::(_save) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634.temp >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,823::task::872::TaskManager.Task::(_runJobs) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::Task.run: running job 0: deleteImage_f3619dce-b683-4ae7-a623-29151a0b1040: <function <lambda> at 0x7f15f005c0c8> (args: () kwargs: {}) >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,823::task::304::TaskManager.Task::(run) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::Job.run: running deleteImage_f3619dce-b683-4ae7-a623-29151a0b1040: <function <lambda> at 0x7f15f005c0c8> (args: () kwargs: {}) callback None >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,824::task::568::TaskManager.Task::(_updateState) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::moving from state running -> state finished >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,825::task::719::TaskManager.Task::(_save) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1cde5706-72b6-4774-bb7d-4d8aa7ff0634.temp >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,832::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040': < ResourceRef 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040', isValid: 'True' obj: 'None'>} >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,832::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,833::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,833::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,834::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,834::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,834::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040' >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,835::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040' (0 active users) >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,835::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040' is free, finding out if anyone is waiting for it. >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,835::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f3619dce-b683-4ae7-a623-29151a0b1040', Clearing records. >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,836::task::880::TaskManager.Task::(_runJobs) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::Task.run: exit - success: result True >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,836::task::957::TaskManager.Task::(_decref) Task=`1cde5706-72b6-4774-bb7d-4d8aa7ff0634`::ref 0 aborting False >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:01:54,836::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-634::DEBUG::2013-03-01 13:01:54,838::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-634::DEBUG::2013-03-01 13:01:54,839::task::568::TaskManager.Task::(_updateState) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::moving from state init -> state preparing >Thread-634::INFO::2013-03-01 13:01:54,839::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='b4bf0747-2c4c-4d83-9f75-eb83759f5712', postZero='false', force='false') >Thread-634::INFO::2013-03-01 13:01:54,839::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-634::DEBUG::2013-03-01 13:01:54,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:54,901::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:55,014::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0486175 s, 21.1 MB/s\n'; <rc> = 0 >Thread-634::DEBUG::2013-03-01 13:01:55,081::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-634::DEBUG::2013-03-01 13:01:55,082::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,082::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,082::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,083::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,083::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,084::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:55,094::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:01:55,095::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-634::DEBUG::2013-03-01 13:01:55,492::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-634::DEBUG::2013-03-01 13:01:55,494::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-634::DEBUG::2013-03-01 13:01:55,495::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`fb63a425-0e0a-4277-a082-ff2403db8c7c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-634::DEBUG::2013-03-01 13:01:55,495::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712' for lock type 'exclusive' >Thread-634::DEBUG::2013-03-01 13:01:55,496::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free. Now locking as 'exclusive' (1 active user) >Thread-634::DEBUG::2013-03-01 13:01:55,496::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712`ReqID=`fb63a425-0e0a-4277-a082-ff2403db8c7c`::Granted request >Thread-634::DEBUG::2013-03-01 13:01:55,496::task::794::TaskManager.Task::(resourceAcquired) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_resourcesAcquired: Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712 (exclusive) >Thread-634::DEBUG::2013-03-01 13:01:55,497::task::957::TaskManager.Task::(_decref) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::ref 1 aborting False >Thread-634::DEBUG::2013-03-01 13:01:55,497::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`39fe5990-2186-4c0b-9c29-a038a80bae78`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-634::DEBUG::2013-03-01 13:01:55,498::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-634::DEBUG::2013-03-01 13:01:55,498::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-634::DEBUG::2013-03-01 13:01:55,498::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`39fe5990-2186-4c0b-9c29-a038a80bae78`::Granted request >Thread-634::DEBUG::2013-03-01 13:01:55,498::task::794::TaskManager.Task::(resourceAcquired) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-634::DEBUG::2013-03-01 13:01:55,499::task::957::TaskManager.Task::(_decref) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::ref 1 aborting False >Thread-634::DEBUG::2013-03-01 13:01:55,499::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-634::DEBUG::2013-03-01 13:01:55,500::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:55,518::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:01:55,520::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:01:55,534::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000332795 s, 12.3 MB/s\n'; <rc> = 0 >Thread-634::DEBUG::2013-03-01 13:01:55,691::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-634::DEBUG::2013-03-01 13:01:55,704::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/ab7680c7-9438-42eb-a6c4-29a77fca31ea a558fc2a-a4a3-4118-9b81-d1d601eaa295/8eaab457-8f02-4cff-9544-73d4e44a54e2' (cwd None) >Thread-634::DEBUG::2013-03-01 13:01:55,918::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-634::DEBUG::2013-03-01 13:01:55,919::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,919::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,920::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,920::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-634::DEBUG::2013-03-01 13:01:55,920::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712/8eaab457-8f02-4cff-9544-73d4e44a54e2'] >Thread-634::DEBUG::2013-03-01 13:01:55,921::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/b4bf0747-2c4c-4d83-9f75-eb83759f5712 >Thread-634::DEBUG::2013-03-01 13:01:55,922::task::719::TaskManager.Task::(_save) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937.temp >Thread-634::DEBUG::2013-03-01 13:01:55,929::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_b4bf0747-2c4c-4d83-9f75-eb83759f5712 for task 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >Thread-634::INFO::2013-03-01 13:01:55,929::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-634::DEBUG::2013-03-01 13:01:55,930::task::1146::TaskManager.Task::(prepare) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::Prepare: 1 jobs exist, move to acquiring >Thread-634::DEBUG::2013-03-01 13:01:55,930::task::568::TaskManager.Task::(_updateState) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::moving from state preparing -> state acquiring >Thread-634::DEBUG::2013-03-01 13:01:55,931::task::719::TaskManager.Task::(_save) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937.temp >Thread-634::DEBUG::2013-03-01 13:01:55,938::task::568::TaskManager.Task::(_updateState) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::moving from state acquiring -> state queued >Thread-634::DEBUG::2013-03-01 13:01:55,939::task::719::TaskManager.Task::(_save) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937.temp >Thread-634::DEBUG::2013-03-01 13:01:55,946::taskManager::50::TaskManager::(_queueTask) queuing task: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >Thread-634::DEBUG::2013-03-01 13:01:55,946::taskManager::56::TaskManager::(_queueTask) task queued: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >Thread-2::DEBUG::2013-03-01 13:01:55,947::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-634::DEBUG::2013-03-01 13:01:55,947::task::1148::TaskManager.Task::(prepare) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::returning >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,948::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c0274d40>> with: None >Thread-634::DEBUG::2013-03-01 13:01:55,949::task::957::TaskManager.Task::(_decref) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::ref 0 aborting False >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,949::task::1159::TaskManager.Task::(commit) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::committing task: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,951::task::568::TaskManager.Task::(_updateState) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::moving from state queued -> state running >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,954::task::719::TaskManager.Task::(_save) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937.temp >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,962::task::872::TaskManager.Task::(_runJobs) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::Task.run: running job 0: deleteImage_b4bf0747-2c4c-4d83-9f75-eb83759f5712: <function <lambda> at 0x7f15f0048c08> (args: () kwargs: {}) >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,962::task::304::TaskManager.Task::(run) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::Job.run: running deleteImage_b4bf0747-2c4c-4d83-9f75-eb83759f5712: <function <lambda> at 0x7f15f0048c08> (args: () kwargs: {}) callback None >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,962::task::568::TaskManager.Task::(_updateState) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::moving from state running -> state finished >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,963::task::719::TaskManager.Task::(_save) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937.temp >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,971::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712': < ResourceRef 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712', isValid: 'True' obj: 'None'>} >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,971::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,971::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,972::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,972::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,972::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,973::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712' >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,973::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712' (0 active users) >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,973::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712' is free, finding out if anyone is waiting for it. >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,974::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b4bf0747-2c4c-4d83-9f75-eb83759f5712', Clearing records. >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,974::task::880::TaskManager.Task::(_runJobs) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::Task.run: exit - success: result True >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,974::task::957::TaskManager.Task::(_decref) Task=`1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937`::ref 0 aborting False >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:01:55,975::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-635::DEBUG::2013-03-01 13:01:55,988::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-635::DEBUG::2013-03-01 13:01:55,989::task::568::TaskManager.Task::(_updateState) Task=`42a64f24-13f2-4cb9-a6f3-577e4d4035aa`::moving from state init -> state preparing >Thread-635::INFO::2013-03-01 13:01:55,989::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-635::DEBUG::2013-03-01 13:01:55,989::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-635::DEBUG::2013-03-01 13:01:55,990::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 >Thread-635::DEBUG::2013-03-01 13:01:55,990::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1cde5706-72b6-4774-bb7d-4d8aa7ff0634'} >Thread-635::DEBUG::2013-03-01 13:01:55,990::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >Thread-635::DEBUG::2013-03-01 13:01:55,990::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'} >Thread-635::DEBUG::2013-03-01 13:01:55,991::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: bc2c49f8-2929-4ea7-8d09-4420d7b21985 >Thread-635::DEBUG::2013-03-01 13:01:55,991::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'bc2c49f8-2929-4ea7-8d09-4420d7b21985'} >Thread-635::DEBUG::2013-03-01 13:01:55,991::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 6d0efd51-9c31-40a0-b9f7-951957fc189d >Thread-635::DEBUG::2013-03-01 13:01:55,992::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'} >Thread-635::DEBUG::2013-03-01 13:01:55,992::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'1cde5706-72b6-4774-bb7d-4d8aa7ff0634': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1cde5706-72b6-4774-bb7d-4d8aa7ff0634'}, '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'}, '6d0efd51-9c31-40a0-b9f7-951957fc189d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'}, 'bc2c49f8-2929-4ea7-8d09-4420d7b21985': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'bc2c49f8-2929-4ea7-8d09-4420d7b21985'}} >Thread-635::INFO::2013-03-01 13:01:55,993::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'1cde5706-72b6-4774-bb7d-4d8aa7ff0634': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1cde5706-72b6-4774-bb7d-4d8aa7ff0634'}, '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'}, '6d0efd51-9c31-40a0-b9f7-951957fc189d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'}, 'bc2c49f8-2929-4ea7-8d09-4420d7b21985': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'bc2c49f8-2929-4ea7-8d09-4420d7b21985'}}} >Thread-635::DEBUG::2013-03-01 13:01:55,993::task::1151::TaskManager.Task::(prepare) Task=`42a64f24-13f2-4cb9-a6f3-577e4d4035aa`::finished: {'allTasksStatus': {'1cde5706-72b6-4774-bb7d-4d8aa7ff0634': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1cde5706-72b6-4774-bb7d-4d8aa7ff0634'}, '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'}, '6d0efd51-9c31-40a0-b9f7-951957fc189d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'}, 'bc2c49f8-2929-4ea7-8d09-4420d7b21985': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'bc2c49f8-2929-4ea7-8d09-4420d7b21985'}}} >Thread-635::DEBUG::2013-03-01 13:01:55,993::task::568::TaskManager.Task::(_updateState) Task=`42a64f24-13f2-4cb9-a6f3-577e4d4035aa`::moving from state preparing -> state finished >Thread-635::DEBUG::2013-03-01 13:01:55,994::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-635::DEBUG::2013-03-01 13:01:55,994::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-635::DEBUG::2013-03-01 13:01:55,994::task::957::TaskManager.Task::(_decref) Task=`42a64f24-13f2-4cb9-a6f3-577e4d4035aa`::ref 0 aborting False >Thread-636::DEBUG::2013-03-01 13:01:56,038::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-636::DEBUG::2013-03-01 13:01:56,038::task::568::TaskManager.Task::(_updateState) Task=`40bcafaf-ba20-464d-83e4-a6b78a8ac70a`::moving from state init -> state preparing >Thread-636::INFO::2013-03-01 13:01:56,039::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-636::INFO::2013-03-01 13:01:56,039::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-636::DEBUG::2013-03-01 13:01:56,039::task::1151::TaskManager.Task::(prepare) Task=`40bcafaf-ba20-464d-83e4-a6b78a8ac70a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-636::DEBUG::2013-03-01 13:01:56,040::task::568::TaskManager.Task::(_updateState) Task=`40bcafaf-ba20-464d-83e4-a6b78a8ac70a`::moving from state preparing -> state finished >Thread-636::DEBUG::2013-03-01 13:01:56,040::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-636::DEBUG::2013-03-01 13:01:56,040::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-636::DEBUG::2013-03-01 13:01:56,041::task::957::TaskManager.Task::(_decref) Task=`40bcafaf-ba20-464d-83e4-a6b78a8ac70a`::ref 0 aborting False >Thread-637::DEBUG::2013-03-01 13:01:56,093::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-637::DEBUG::2013-03-01 13:01:56,094::task::568::TaskManager.Task::(_updateState) Task=`2e997a4d-290b-476c-923a-05fd263918bd`::moving from state init -> state preparing >Thread-637::INFO::2013-03-01 13:01:56,094::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-637::DEBUG::2013-03-01 13:01:56,095::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`40115cf1-4f6f-4199-8857-10820531bce9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-637::DEBUG::2013-03-01 13:01:56,095::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-637::DEBUG::2013-03-01 13:01:56,095::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-637::DEBUG::2013-03-01 13:01:56,096::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`40115cf1-4f6f-4199-8857-10820531bce9`::Granted request >Thread-637::DEBUG::2013-03-01 13:01:56,096::task::794::TaskManager.Task::(resourceAcquired) Task=`2e997a4d-290b-476c-923a-05fd263918bd`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-637::DEBUG::2013-03-01 13:01:56,097::task::957::TaskManager.Task::(_decref) Task=`2e997a4d-290b-476c-923a-05fd263918bd`::ref 1 aborting False >Thread-637::DEBUG::2013-03-01 13:01:56,097::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-637::DEBUG::2013-03-01 13:01:56,098::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-637::DEBUG::2013-03-01 13:01:56,418::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-637::DEBUG::2013-03-01 13:01:56,420::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-637::INFO::2013-03-01 13:01:56,422::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-637::DEBUG::2013-03-01 13:01:56,422::task::1151::TaskManager.Task::(prepare) Task=`2e997a4d-290b-476c-923a-05fd263918bd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-637::DEBUG::2013-03-01 13:01:56,422::task::568::TaskManager.Task::(_updateState) Task=`2e997a4d-290b-476c-923a-05fd263918bd`::moving from state preparing -> state finished >Thread-637::DEBUG::2013-03-01 13:01:56,423::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-637::DEBUG::2013-03-01 13:01:56,423::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-637::DEBUG::2013-03-01 13:01:56,423::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-637::DEBUG::2013-03-01 13:01:56,424::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-637::DEBUG::2013-03-01 13:01:56,424::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-637::DEBUG::2013-03-01 13:01:56,424::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-637::DEBUG::2013-03-01 13:01:56,425::task::957::TaskManager.Task::(_decref) Task=`2e997a4d-290b-476c-923a-05fd263918bd`::ref 0 aborting False >Thread-639::DEBUG::2013-03-01 13:01:56,467::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-639::DEBUG::2013-03-01 13:01:56,467::task::568::TaskManager.Task::(_updateState) Task=`4022b3b3-9697-471e-b68b-4fd310e411c5`::moving from state init -> state preparing >Thread-639::INFO::2013-03-01 13:01:56,468::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='bc2c49f8-2929-4ea7-8d09-4420d7b21985', spUUID=None, options=None) >Thread-639::DEBUG::2013-03-01 13:01:56,468::taskManager::161::TaskManager::(clearTask) Entry. taskID: bc2c49f8-2929-4ea7-8d09-4420d7b21985 >Thread-639::DEBUG::2013-03-01 13:01:56,469::taskManager::166::TaskManager::(clearTask) Return. >Thread-639::INFO::2013-03-01 13:01:56,470::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-639::DEBUG::2013-03-01 13:01:56,470::task::1151::TaskManager.Task::(prepare) Task=`4022b3b3-9697-471e-b68b-4fd310e411c5`::finished: None >Thread-639::DEBUG::2013-03-01 13:01:56,470::task::568::TaskManager.Task::(_updateState) Task=`4022b3b3-9697-471e-b68b-4fd310e411c5`::moving from state preparing -> state finished >Thread-639::DEBUG::2013-03-01 13:01:56,470::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-639::DEBUG::2013-03-01 13:01:56,471::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-639::DEBUG::2013-03-01 13:01:56,471::task::957::TaskManager.Task::(_decref) Task=`4022b3b3-9697-471e-b68b-4fd310e411c5`::ref 0 aborting False >Thread-640::DEBUG::2013-03-01 13:01:56,501::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-640::DEBUG::2013-03-01 13:01:56,502::task::568::TaskManager.Task::(_updateState) Task=`816f2881-371a-4156-a2d4-2477be42f421`::moving from state init -> state preparing >Thread-640::INFO::2013-03-01 13:01:56,502::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1cde5706-72b6-4774-bb7d-4d8aa7ff0634', spUUID=None, options=None) >Thread-640::DEBUG::2013-03-01 13:01:56,502::taskManager::161::TaskManager::(clearTask) Entry. taskID: 1cde5706-72b6-4774-bb7d-4d8aa7ff0634 >Thread-640::DEBUG::2013-03-01 13:01:56,503::taskManager::166::TaskManager::(clearTask) Return. >Thread-640::INFO::2013-03-01 13:01:56,504::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-640::DEBUG::2013-03-01 13:01:56,504::task::1151::TaskManager.Task::(prepare) Task=`816f2881-371a-4156-a2d4-2477be42f421`::finished: None >Thread-640::DEBUG::2013-03-01 13:01:56,504::task::568::TaskManager.Task::(_updateState) Task=`816f2881-371a-4156-a2d4-2477be42f421`::moving from state preparing -> state finished >Thread-640::DEBUG::2013-03-01 13:01:56,504::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-640::DEBUG::2013-03-01 13:01:56,505::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-640::DEBUG::2013-03-01 13:01:56,505::task::957::TaskManager.Task::(_decref) Task=`816f2881-371a-4156-a2d4-2477be42f421`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:01:56,527::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:01:56,537::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000285668 s, 14.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:57,034::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:57,118::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392975 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:01:59,132::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:01:59,243::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455815 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:01,262::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:01,371::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442186 s, 23.2 MB/s\n'; <rc> = 0 >Thread-642::DEBUG::2013-03-01 13:02:02,420::task::568::TaskManager.Task::(_updateState) Task=`7a91a153-794a-4660-bb89-44e5d93aeb8d`::moving from state init -> state preparing >Thread-642::INFO::2013-03-01 13:02:02,420::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-642::INFO::2013-03-01 13:02:02,421::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104169845581', 'lastCheck': '5.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0145509243011', 'lastCheck': '6.9', 'code': 0, 'valid': True}} >Thread-642::DEBUG::2013-03-01 13:02:02,421::task::1151::TaskManager.Task::(prepare) Task=`7a91a153-794a-4660-bb89-44e5d93aeb8d`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104169845581', 'lastCheck': '5.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0145509243011', 'lastCheck': '6.9', 'code': 0, 'valid': True}} >Thread-642::DEBUG::2013-03-01 13:02:02,421::task::568::TaskManager.Task::(_updateState) Task=`7a91a153-794a-4660-bb89-44e5d93aeb8d`::moving from state preparing -> state finished >Thread-642::DEBUG::2013-03-01 13:02:02,422::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-642::DEBUG::2013-03-01 13:02:02,422::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-642::DEBUG::2013-03-01 13:02:02,422::task::957::TaskManager.Task::(_decref) Task=`7a91a153-794a-4660-bb89-44e5d93aeb8d`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:03,386::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:03,467::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294712 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:05,480::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:05,542::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:05,580::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000377513 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:05,650::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0832218 s, 12.3 MB/s\n'; <rc> = 0 >Thread-645::DEBUG::2013-03-01 13:02:06,038::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-645::DEBUG::2013-03-01 13:02:06,045::task::568::TaskManager.Task::(_updateState) Task=`57f43fb9-d210-42b0-9a7c-09192bc7d933`::moving from state init -> state preparing >Thread-645::INFO::2013-03-01 13:02:06,046::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-645::DEBUG::2013-03-01 13:02:06,046::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-645::DEBUG::2013-03-01 13:02:06,046::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >Thread-645::DEBUG::2013-03-01 13:02:06,046::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'} >Thread-645::DEBUG::2013-03-01 13:02:06,047::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 6d0efd51-9c31-40a0-b9f7-951957fc189d >Thread-645::DEBUG::2013-03-01 13:02:06,047::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'} >Thread-645::DEBUG::2013-03-01 13:02:06,047::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'}, '6d0efd51-9c31-40a0-b9f7-951957fc189d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'}} >Thread-645::INFO::2013-03-01 13:02:06,047::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'}, '6d0efd51-9c31-40a0-b9f7-951957fc189d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'}}} >Thread-645::DEBUG::2013-03-01 13:02:06,048::task::1151::TaskManager.Task::(prepare) Task=`57f43fb9-d210-42b0-9a7c-09192bc7d933`::finished: {'allTasksStatus': {'1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937'}, '6d0efd51-9c31-40a0-b9f7-951957fc189d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d0efd51-9c31-40a0-b9f7-951957fc189d'}}} >Thread-645::DEBUG::2013-03-01 13:02:06,048::task::568::TaskManager.Task::(_updateState) Task=`57f43fb9-d210-42b0-9a7c-09192bc7d933`::moving from state preparing -> state finished >Thread-645::DEBUG::2013-03-01 13:02:06,048::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-645::DEBUG::2013-03-01 13:02:06,048::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-645::DEBUG::2013-03-01 13:02:06,049::task::957::TaskManager.Task::(_decref) Task=`57f43fb9-d210-42b0-9a7c-09192bc7d933`::ref 0 aborting False >Thread-646::DEBUG::2013-03-01 13:02:06,129::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-646::DEBUG::2013-03-01 13:02:06,130::task::568::TaskManager.Task::(_updateState) Task=`ee122c37-3114-481a-a52d-d2269d146ebe`::moving from state init -> state preparing >Thread-646::INFO::2013-03-01 13:02:06,130::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='6d0efd51-9c31-40a0-b9f7-951957fc189d', spUUID=None, options=None) >Thread-646::DEBUG::2013-03-01 13:02:06,130::taskManager::161::TaskManager::(clearTask) Entry. taskID: 6d0efd51-9c31-40a0-b9f7-951957fc189d >Thread-646::DEBUG::2013-03-01 13:02:06,132::taskManager::166::TaskManager::(clearTask) Return. >Thread-646::INFO::2013-03-01 13:02:06,132::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-646::DEBUG::2013-03-01 13:02:06,132::task::1151::TaskManager.Task::(prepare) Task=`ee122c37-3114-481a-a52d-d2269d146ebe`::finished: None >Thread-646::DEBUG::2013-03-01 13:02:06,132::task::568::TaskManager.Task::(_updateState) Task=`ee122c37-3114-481a-a52d-d2269d146ebe`::moving from state preparing -> state finished >Thread-646::DEBUG::2013-03-01 13:02:06,132::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-646::DEBUG::2013-03-01 13:02:06,133::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-646::DEBUG::2013-03-01 13:02:06,133::task::957::TaskManager.Task::(_decref) Task=`ee122c37-3114-481a-a52d-d2269d146ebe`::ref 0 aborting False >Thread-647::DEBUG::2013-03-01 13:02:06,163::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-647::DEBUG::2013-03-01 13:02:06,164::task::568::TaskManager.Task::(_updateState) Task=`4374c7cc-b0b8-4ccc-a887-2cc7d1ebbd51`::moving from state init -> state preparing >Thread-647::INFO::2013-03-01 13:02:06,164::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937', spUUID=None, options=None) >Thread-647::DEBUG::2013-03-01 13:02:06,164::taskManager::161::TaskManager::(clearTask) Entry. taskID: 1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937 >Thread-647::DEBUG::2013-03-01 13:02:06,165::taskManager::166::TaskManager::(clearTask) Return. >Thread-647::INFO::2013-03-01 13:02:06,165::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-647::DEBUG::2013-03-01 13:02:06,166::task::1151::TaskManager.Task::(prepare) Task=`4374c7cc-b0b8-4ccc-a887-2cc7d1ebbd51`::finished: None >Thread-647::DEBUG::2013-03-01 13:02:06,166::task::568::TaskManager.Task::(_updateState) Task=`4374c7cc-b0b8-4ccc-a887-2cc7d1ebbd51`::moving from state preparing -> state finished >Thread-647::DEBUG::2013-03-01 13:02:06,166::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-647::DEBUG::2013-03-01 13:02:06,166::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-647::DEBUG::2013-03-01 13:02:06,166::task::957::TaskManager.Task::(_decref) Task=`4374c7cc-b0b8-4ccc-a887-2cc7d1ebbd51`::ref 0 aborting False >Thread-648::DEBUG::2013-03-01 13:02:06,467::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-648::DEBUG::2013-03-01 13:02:06,468::task::568::TaskManager.Task::(_updateState) Task=`8b9e63ef-8847-4b49-9b8f-1e89ac202eed`::moving from state init -> state preparing >Thread-648::INFO::2013-03-01 13:02:06,468::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-648::INFO::2013-03-01 13:02:06,468::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-648::DEBUG::2013-03-01 13:02:06,469::task::1151::TaskManager.Task::(prepare) Task=`8b9e63ef-8847-4b49-9b8f-1e89ac202eed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-648::DEBUG::2013-03-01 13:02:06,469::task::568::TaskManager.Task::(_updateState) Task=`8b9e63ef-8847-4b49-9b8f-1e89ac202eed`::moving from state preparing -> state finished >Thread-648::DEBUG::2013-03-01 13:02:06,469::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-648::DEBUG::2013-03-01 13:02:06,470::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-648::DEBUG::2013-03-01 13:02:06,470::task::957::TaskManager.Task::(_decref) Task=`8b9e63ef-8847-4b49-9b8f-1e89ac202eed`::ref 0 aborting False >Thread-649::DEBUG::2013-03-01 13:02:06,494::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-649::DEBUG::2013-03-01 13:02:06,495::task::568::TaskManager.Task::(_updateState) Task=`27f0e501-2f84-4378-a510-8783e314543f`::moving from state init -> state preparing >Thread-649::INFO::2013-03-01 13:02:06,495::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-649::DEBUG::2013-03-01 13:02:06,496::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`dffabf56-aa9e-4b7a-bacc-dab01807f337`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-649::DEBUG::2013-03-01 13:02:06,496::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-649::DEBUG::2013-03-01 13:02:06,496::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-649::DEBUG::2013-03-01 13:02:06,496::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`dffabf56-aa9e-4b7a-bacc-dab01807f337`::Granted request >Thread-649::DEBUG::2013-03-01 13:02:06,497::task::794::TaskManager.Task::(resourceAcquired) Task=`27f0e501-2f84-4378-a510-8783e314543f`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-649::DEBUG::2013-03-01 13:02:06,497::task::957::TaskManager.Task::(_decref) Task=`27f0e501-2f84-4378-a510-8783e314543f`::ref 1 aborting False >Thread-649::INFO::2013-03-01 13:02:06,498::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-649::DEBUG::2013-03-01 13:02:06,499::task::1151::TaskManager.Task::(prepare) Task=`27f0e501-2f84-4378-a510-8783e314543f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-649::DEBUG::2013-03-01 13:02:06,499::task::568::TaskManager.Task::(_updateState) Task=`27f0e501-2f84-4378-a510-8783e314543f`::moving from state preparing -> state finished >Thread-649::DEBUG::2013-03-01 13:02:06,499::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-649::DEBUG::2013-03-01 13:02:06,499::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-649::DEBUG::2013-03-01 13:02:06,500::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-649::DEBUG::2013-03-01 13:02:06,500::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-649::DEBUG::2013-03-01 13:02:06,500::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-649::DEBUG::2013-03-01 13:02:06,500::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-649::DEBUG::2013-03-01 13:02:06,501::task::957::TaskManager.Task::(_decref) Task=`27f0e501-2f84-4378-a510-8783e314543f`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:02:06,538::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:06,548::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000362254 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:07,666::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:07,778::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468135 s, 21.9 MB/s\n'; <rc> = 0 >Thread-650::DEBUG::2013-03-01 13:02:07,971::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-650::DEBUG::2013-03-01 13:02:07,972::task::568::TaskManager.Task::(_updateState) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::moving from state init -> state preparing >Thread-650::INFO::2013-03-01 13:02:07,972::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='174418c8-73dd-4b93-9059-6ba35d2db54b', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-650::INFO::2013-03-01 13:02:07,973::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-650::DEBUG::2013-03-01 13:02:07,973::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-650::DEBUG::2013-03-01 13:02:08,192::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-650::DEBUG::2013-03-01 13:02:08,193::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-650::DEBUG::2013-03-01 13:02:08,193::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-650::DEBUG::2013-03-01 13:02:08,194::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-650::DEBUG::2013-03-01 13:02:08,194::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-650::DEBUG::2013-03-01 13:02:08,194::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-650::DEBUG::2013-03-01 13:02:08,195::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-650::DEBUG::2013-03-01 13:02:08,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-650::DEBUG::2013-03-01 13:02:08,388::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-650::DEBUG::2013-03-01 13:02:08,388::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-650::DEBUG::2013-03-01 13:02:08,390::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`58c53d24-23bd-4913-950b-fde3cd2bc343`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-650::DEBUG::2013-03-01 13:02:08,390::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-650::DEBUG::2013-03-01 13:02:08,391::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-650::DEBUG::2013-03-01 13:02:08,391::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`58c53d24-23bd-4913-950b-fde3cd2bc343`::Granted request >Thread-650::DEBUG::2013-03-01 13:02:08,391::task::794::TaskManager.Task::(resourceAcquired) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-650::DEBUG::2013-03-01 13:02:08,392::task::957::TaskManager.Task::(_decref) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::ref 1 aborting False >Thread-650::DEBUG::2013-03-01 13:02:08,393::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >Thread-650::DEBUG::2013-03-01 13:02:08,400::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 >Thread-650::INFO::2013-03-01 13:02:08,401::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-650::DEBUG::2013-03-01 13:02:08,401::task::1146::TaskManager.Task::(prepare) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::Prepare: 1 jobs exist, move to acquiring >Thread-650::DEBUG::2013-03-01 13:02:08,401::task::568::TaskManager.Task::(_updateState) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::moving from state preparing -> state acquiring >Thread-650::DEBUG::2013-03-01 13:02:08,402::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >Thread-650::DEBUG::2013-03-01 13:02:08,409::task::568::TaskManager.Task::(_updateState) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::moving from state acquiring -> state queued >Thread-650::DEBUG::2013-03-01 13:02:08,410::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >Thread-650::DEBUG::2013-03-01 13:02:08,417::taskManager::50::TaskManager::(_queueTask) queuing task: b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 >6d0efd51-9c31-40a0-b9f7-951957fc189d::DEBUG::2013-03-01 13:02:08,418::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-650::DEBUG::2013-03-01 13:02:08,418::taskManager::56::TaskManager::(_queueTask) task queued: b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,419::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c0274050>> with: None >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,421::task::1159::TaskManager.Task::(commit) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::committing task: b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 >Thread-650::DEBUG::2013-03-01 13:02:08,421::task::1148::TaskManager.Task::(prepare) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::returning >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,423::task::568::TaskManager.Task::(_updateState) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::moving from state queued -> state running >Thread-650::DEBUG::2013-03-01 13:02:08,424::task::957::TaskManager.Task::(_decref) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::ref 1 aborting False >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,427::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,439::task::872::TaskManager.Task::(_runJobs) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'bc7e8a03-5152-493a-a0b5-55c04543214f', 12582912, 4, 2, 2, '174418c8-73dd-4b93-9059-6ba35d2db54b', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,439::task::304::TaskManager.Task::(run) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'bc7e8a03-5152-493a-a0b5-55c04543214f', 12582912, 4, 2, 2, '174418c8-73dd-4b93-9059-6ba35d2db54b', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,440::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`cc7d4ab7-5bbe-4b10-b635-35baf618ac69`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,440::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' for lock type 'exclusive' >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,441::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,442::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,639::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,650::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,650::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image bc7e8a03-5152-493a-a0b5-55c04543214f does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,651::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' is free. Now locking as 'exclusive' (1 active user) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,651::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`cc7d4ab7-5bbe-4b10-b635-35baf618ac69`::Granted request >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::INFO::2013-03-01 13:02:08,652::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f for image's volumes >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,653::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,662::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:08,663::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:09,080::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:09,226::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::WARNING::2013-03-01 13:02:09,232::lvm::593::Storage.LVM::(getLv) lv: 174418c8-73dd-4b93-9059-6ba35d2db54b not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::INFO::2013-03-01 13:02:09,240::volume::457::Storage.Volume::(create) Creating volume 174418c8-73dd-4b93-9059-6ba35d2db54b >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:09,262::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:09,361::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:09,470::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 174418c8-73dd-4b93-9059-6ba35d2db54b a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:09,803::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:11,182::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.491049 s, 2.1 MB/s\n'; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,920::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,921::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,921::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,922::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,922::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::INFO::2013-03-01 13:02:12,923::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b with size = 12582912 sectors >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,923::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b 6291456K' (cwd None) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,935::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,936::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:12,937::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,187::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,197::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::WARNING::2013-03-01 13:02:13,197::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,198::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,199::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_7 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_bc7e8a03-5152-493a-a0b5-55c04543214f a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:13,362::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,416::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,418::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,419::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,422::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:13,480::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608676 s, 16.8 MB/s\n'; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,670::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,670::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,671::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,680::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=174418c8-73dd-4b93-9059-6ba35d2db54b sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,686::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,693::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,693::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' (0 active users) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,693::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' is free, finding out if anyone is waiting for it. >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,694::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f', Clearing records. >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,694::task::568::TaskManager.Task::(_updateState) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::moving from state running -> state finished >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,695::task::719::TaskManager.Task::(_save) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/b2ef1a7d-a7e7-414e-ad1d-2e2515597c32.temp >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,702::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,702::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,703::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,703::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,703::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,703::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,704::task::880::TaskManager.Task::(_runJobs) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::Task.run: exit - success: result {'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b'} >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,704::task::957::TaskManager.Task::(_decref) Task=`b2ef1a7d-a7e7-414e-ad1d-2e2515597c32`::ref 0 aborting False >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:02:13,704::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:02:15,493::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:15,577::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385459 s, 26.6 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:02:15,601::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:02:15,602::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:15,948::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:02:15,950::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:02:15,950::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:15,965::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00227598 s, 1.8 MB/s\n'; <rc> = 0 >Thread-654::DEBUG::2013-03-01 13:02:16,090::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-654::DEBUG::2013-03-01 13:02:16,090::task::568::TaskManager.Task::(_updateState) Task=`19a70b5f-fba8-4bb0-89fe-010294270946`::moving from state init -> state preparing >Thread-654::INFO::2013-03-01 13:02:16,091::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-654::DEBUG::2013-03-01 13:02:16,091::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-654::DEBUG::2013-03-01 13:02:16,091::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 >Thread-654::DEBUG::2013-03-01 13:02:16,092::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32'} >Thread-654::DEBUG::2013-03-01 13:02:16,092::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32'}} >Thread-654::INFO::2013-03-01 13:02:16,092::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32'}}} >Thread-654::DEBUG::2013-03-01 13:02:16,092::task::1151::TaskManager.Task::(prepare) Task=`19a70b5f-fba8-4bb0-89fe-010294270946`::finished: {'allTasksStatus': {'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b2ef1a7d-a7e7-414e-ad1d-2e2515597c32'}}} >Thread-654::DEBUG::2013-03-01 13:02:16,093::task::568::TaskManager.Task::(_updateState) Task=`19a70b5f-fba8-4bb0-89fe-010294270946`::moving from state preparing -> state finished >Thread-654::DEBUG::2013-03-01 13:02:16,093::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-654::DEBUG::2013-03-01 13:02:16,093::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-654::DEBUG::2013-03-01 13:02:16,094::task::957::TaskManager.Task::(_decref) Task=`19a70b5f-fba8-4bb0-89fe-010294270946`::ref 0 aborting False >Thread-655::DEBUG::2013-03-01 13:02:16,147::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-655::DEBUG::2013-03-01 13:02:16,148::task::568::TaskManager.Task::(_updateState) Task=`03937bff-3c26-4279-b9ac-39ae641c0cbe`::moving from state init -> state preparing >Thread-655::INFO::2013-03-01 13:02:16,148::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', volUUID='174418c8-73dd-4b93-9059-6ba35d2db54b', options=None) >Thread-655::DEBUG::2013-03-01 13:02:16,149::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5c73ce01-e2ba-457e-90a3-c47151fa8c3d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-655::DEBUG::2013-03-01 13:02:16,149::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-655::DEBUG::2013-03-01 13:02:16,150::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-655::DEBUG::2013-03-01 13:02:16,150::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5c73ce01-e2ba-457e-90a3-c47151fa8c3d`::Granted request >Thread-655::DEBUG::2013-03-01 13:02:16,150::task::794::TaskManager.Task::(resourceAcquired) Task=`03937bff-3c26-4279-b9ac-39ae641c0cbe`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-655::DEBUG::2013-03-01 13:02:16,151::task::957::TaskManager.Task::(_decref) Task=`03937bff-3c26-4279-b9ac-39ae641c0cbe`::ref 1 aborting False >Thread-655::DEBUG::2013-03-01 13:02:16,151::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-655::DEBUG::2013-03-01 13:02:16,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-655::DEBUG::2013-03-01 13:02:16,399::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-655::DEBUG::2013-03-01 13:02:16,410::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-655::INFO::2013-03-01 13:02:16,411::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f volUUID = 174418c8-73dd-4b93-9059-6ba35d2db54b >Thread-655::DEBUG::2013-03-01 13:02:16,411::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-655::DEBUG::2013-03-01 13:02:16,422::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000303088 s, 1.7 MB/s\n'; <rc> = 0 >Thread-655::DEBUG::2013-03-01 13:02:16,422::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000303088 s, 1.7 MB/s'], size: 512 >Thread-655::DEBUG::2013-03-01 13:02:16,423::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-655::DEBUG::2013-03-01 13:02:16,433::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319232 s, 1.6 MB/s\n'; <rc> = 0 >Thread-655::DEBUG::2013-03-01 13:02:16,434::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319232 s, 1.6 MB/s'], size: 512 >Thread-655::DEBUG::2013-03-01 13:02:16,434::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-655::DEBUG::2013-03-01 13:02:16,435::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:16,550::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:16,560::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000297488 s, 13.8 MB/s\n'; <rc> = 0 >Thread-655::DEBUG::2013-03-01 13:02:16,659::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-655::DEBUG::2013-03-01 13:02:16,669::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-655::INFO::2013-03-01 13:02:16,670::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-655::INFO::2013-03-01 13:02:16,670::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-655::DEBUG::2013-03-01 13:02:16,670::task::1151::TaskManager.Task::(prepare) Task=`03937bff-3c26-4279-b9ac-39ae641c0cbe`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-655::DEBUG::2013-03-01 13:02:16,671::task::568::TaskManager.Task::(_updateState) Task=`03937bff-3c26-4279-b9ac-39ae641c0cbe`::moving from state preparing -> state finished >Thread-655::DEBUG::2013-03-01 13:02:16,671::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-655::DEBUG::2013-03-01 13:02:16,671::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-655::DEBUG::2013-03-01 13:02:16,671::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-655::DEBUG::2013-03-01 13:02:16,672::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-655::DEBUG::2013-03-01 13:02:16,672::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-655::DEBUG::2013-03-01 13:02:16,672::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-655::DEBUG::2013-03-01 13:02:16,672::task::957::TaskManager.Task::(_decref) Task=`03937bff-3c26-4279-b9ac-39ae641c0cbe`::ref 0 aborting False >Thread-656::DEBUG::2013-03-01 13:02:16,709::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-656::DEBUG::2013-03-01 13:02:16,710::task::568::TaskManager.Task::(_updateState) Task=`db0d7901-766a-458f-9220-3841bb30e22e`::moving from state init -> state preparing >Thread-656::INFO::2013-03-01 13:02:16,711::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-656::INFO::2013-03-01 13:02:16,711::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-656::DEBUG::2013-03-01 13:02:16,711::task::1151::TaskManager.Task::(prepare) Task=`db0d7901-766a-458f-9220-3841bb30e22e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-656::DEBUG::2013-03-01 13:02:16,712::task::568::TaskManager.Task::(_updateState) Task=`db0d7901-766a-458f-9220-3841bb30e22e`::moving from state preparing -> state finished >Thread-656::DEBUG::2013-03-01 13:02:16,712::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-656::DEBUG::2013-03-01 13:02:16,712::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-656::DEBUG::2013-03-01 13:02:16,712::task::957::TaskManager.Task::(_decref) Task=`db0d7901-766a-458f-9220-3841bb30e22e`::ref 0 aborting False >Thread-657::DEBUG::2013-03-01 13:02:16,738::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-657::DEBUG::2013-03-01 13:02:16,739::task::568::TaskManager.Task::(_updateState) Task=`58d1c0e6-2857-425a-8b28-882c338f035e`::moving from state init -> state preparing >Thread-657::INFO::2013-03-01 13:02:16,739::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-657::DEBUG::2013-03-01 13:02:16,740::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`144073a6-5784-43e2-bb3e-1cf3ce57e5cb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-657::DEBUG::2013-03-01 13:02:16,740::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-657::DEBUG::2013-03-01 13:02:16,740::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-657::DEBUG::2013-03-01 13:02:16,741::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`144073a6-5784-43e2-bb3e-1cf3ce57e5cb`::Granted request >Thread-657::DEBUG::2013-03-01 13:02:16,741::task::794::TaskManager.Task::(resourceAcquired) Task=`58d1c0e6-2857-425a-8b28-882c338f035e`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-657::DEBUG::2013-03-01 13:02:16,742::task::957::TaskManager.Task::(_decref) Task=`58d1c0e6-2857-425a-8b28-882c338f035e`::ref 1 aborting False >Thread-657::INFO::2013-03-01 13:02:16,743::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-657::DEBUG::2013-03-01 13:02:16,743::task::1151::TaskManager.Task::(prepare) Task=`58d1c0e6-2857-425a-8b28-882c338f035e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-657::DEBUG::2013-03-01 13:02:16,744::task::568::TaskManager.Task::(_updateState) Task=`58d1c0e6-2857-425a-8b28-882c338f035e`::moving from state preparing -> state finished >Thread-657::DEBUG::2013-03-01 13:02:16,744::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-657::DEBUG::2013-03-01 13:02:16,744::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-657::DEBUG::2013-03-01 13:02:16,745::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-657::DEBUG::2013-03-01 13:02:16,745::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-657::DEBUG::2013-03-01 13:02:16,745::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-657::DEBUG::2013-03-01 13:02:16,745::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-657::DEBUG::2013-03-01 13:02:16,746::task::957::TaskManager.Task::(_decref) Task=`58d1c0e6-2857-425a-8b28-882c338f035e`::ref 0 aborting False >Thread-658::DEBUG::2013-03-01 13:02:16,789::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-658::DEBUG::2013-03-01 13:02:16,790::task::568::TaskManager.Task::(_updateState) Task=`e13d7fad-ea52-4aa9-b8dc-62900e910f5a`::moving from state init -> state preparing >Thread-658::INFO::2013-03-01 13:02:16,790::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='b2ef1a7d-a7e7-414e-ad1d-2e2515597c32', spUUID=None, options=None) >Thread-658::DEBUG::2013-03-01 13:02:16,790::taskManager::161::TaskManager::(clearTask) Entry. taskID: b2ef1a7d-a7e7-414e-ad1d-2e2515597c32 >Thread-658::DEBUG::2013-03-01 13:02:16,792::taskManager::166::TaskManager::(clearTask) Return. >Thread-658::INFO::2013-03-01 13:02:16,792::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-658::DEBUG::2013-03-01 13:02:16,792::task::1151::TaskManager.Task::(prepare) Task=`e13d7fad-ea52-4aa9-b8dc-62900e910f5a`::finished: None >Thread-658::DEBUG::2013-03-01 13:02:16,792::task::568::TaskManager.Task::(_updateState) Task=`e13d7fad-ea52-4aa9-b8dc-62900e910f5a`::moving from state preparing -> state finished >Thread-658::DEBUG::2013-03-01 13:02:16,793::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-658::DEBUG::2013-03-01 13:02:16,793::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-658::DEBUG::2013-03-01 13:02:16,793::task::957::TaskManager.Task::(_decref) Task=`e13d7fad-ea52-4aa9-b8dc-62900e910f5a`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:17,591::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-659::DEBUG::2013-03-01 13:02:17,689::task::568::TaskManager.Task::(_updateState) Task=`cfca2113-7f2d-43f5-ac19-2b840ea1d9ab`::moving from state init -> state preparing >Thread-659::INFO::2013-03-01 13:02:17,692::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-659::INFO::2013-03-01 13:02:17,694::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0105710029602', 'lastCheck': '1.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0149991512299', 'lastCheck': '1.7', 'code': 0, 'valid': True}} >Thread-659::DEBUG::2013-03-01 13:02:17,696::task::1151::TaskManager.Task::(prepare) Task=`cfca2113-7f2d-43f5-ac19-2b840ea1d9ab`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0105710029602', 'lastCheck': '1.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0149991512299', 'lastCheck': '1.7', 'code': 0, 'valid': True}} >Thread-659::DEBUG::2013-03-01 13:02:17,698::task::568::TaskManager.Task::(_updateState) Task=`cfca2113-7f2d-43f5-ac19-2b840ea1d9ab`::moving from state preparing -> state finished >Thread-659::DEBUG::2013-03-01 13:02:17,700::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-659::DEBUG::2013-03-01 13:02:17,702::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-659::DEBUG::2013-03-01 13:02:17,704::task::957::TaskManager.Task::(_decref) Task=`cfca2113-7f2d-43f5-ac19-2b840ea1d9ab`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:17,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494653 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:19,787::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:19,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413408 s, 24.8 MB/s\n'; <rc> = 0 >Thread-661::DEBUG::2013-03-01 13:02:20,231::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-661::DEBUG::2013-03-01 13:02:20,232::task::568::TaskManager.Task::(_updateState) Task=`fbf3b5a6-0c7c-4c2b-a3c5-d46f9263bca7`::moving from state init -> state preparing >Thread-661::INFO::2013-03-01 13:02:20,232::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', volUUID='174418c8-73dd-4b93-9059-6ba35d2db54b', options=None) >Thread-661::DEBUG::2013-03-01 13:02:20,233::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`6a90d89a-bc5f-4793-bb8c-f2d7061e7142`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-661::DEBUG::2013-03-01 13:02:20,233::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-661::DEBUG::2013-03-01 13:02:20,233::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-661::DEBUG::2013-03-01 13:02:20,234::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`6a90d89a-bc5f-4793-bb8c-f2d7061e7142`::Granted request >Thread-661::DEBUG::2013-03-01 13:02:20,234::task::794::TaskManager.Task::(resourceAcquired) Task=`fbf3b5a6-0c7c-4c2b-a3c5-d46f9263bca7`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-661::DEBUG::2013-03-01 13:02:20,235::task::957::TaskManager.Task::(_decref) Task=`fbf3b5a6-0c7c-4c2b-a3c5-d46f9263bca7`::ref 1 aborting False >Thread-661::INFO::2013-03-01 13:02:20,235::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f volUUID = 174418c8-73dd-4b93-9059-6ba35d2db54b >Thread-661::DEBUG::2013-03-01 13:02:20,236::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-661::DEBUG::2013-03-01 13:02:20,246::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000347243 s, 1.5 MB/s\n'; <rc> = 0 >Thread-661::DEBUG::2013-03-01 13:02:20,246::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000347243 s, 1.5 MB/s'], size: 512 >Thread-661::DEBUG::2013-03-01 13:02:20,247::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-661::DEBUG::2013-03-01 13:02:20,257::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000375061 s, 1.4 MB/s\n'; <rc> = 0 >Thread-661::DEBUG::2013-03-01 13:02:20,258::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000375061 s, 1.4 MB/s'], size: 512 >Thread-661::DEBUG::2013-03-01 13:02:20,258::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-661::DEBUG::2013-03-01 13:02:20,259::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-661::DEBUG::2013-03-01 13:02:20,504::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-661::DEBUG::2013-03-01 13:02:20,516::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-661::INFO::2013-03-01 13:02:20,517::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-661::INFO::2013-03-01 13:02:20,517::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-661::DEBUG::2013-03-01 13:02:20,517::task::1151::TaskManager.Task::(prepare) Task=`fbf3b5a6-0c7c-4c2b-a3c5-d46f9263bca7`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-661::DEBUG::2013-03-01 13:02:20,518::task::568::TaskManager.Task::(_updateState) Task=`fbf3b5a6-0c7c-4c2b-a3c5-d46f9263bca7`::moving from state preparing -> state finished >Thread-661::DEBUG::2013-03-01 13:02:20,518::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-661::DEBUG::2013-03-01 13:02:20,518::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-661::DEBUG::2013-03-01 13:02:20,518::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-661::DEBUG::2013-03-01 13:02:20,519::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-661::DEBUG::2013-03-01 13:02:20,519::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-661::DEBUG::2013-03-01 13:02:20,519::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-661::DEBUG::2013-03-01 13:02:20,519::task::957::TaskManager.Task::(_decref) Task=`fbf3b5a6-0c7c-4c2b-a3c5-d46f9263bca7`::ref 0 aborting False >Thread-662::DEBUG::2013-03-01 13:02:20,583::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-662::DEBUG::2013-03-01 13:02:20,583::task::568::TaskManager.Task::(_updateState) Task=`d94dd47b-3370-420b-8f4c-ff1c911de722`::moving from state init -> state preparing >Thread-662::INFO::2013-03-01 13:02:20,584::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', volUUID='174418c8-73dd-4b93-9059-6ba35d2db54b', options=None) >Thread-662::DEBUG::2013-03-01 13:02:20,584::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`95c89fde-2289-44e9-bb1c-a30181a93ef8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-662::DEBUG::2013-03-01 13:02:20,585::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-662::DEBUG::2013-03-01 13:02:20,585::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-662::DEBUG::2013-03-01 13:02:20,585::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`95c89fde-2289-44e9-bb1c-a30181a93ef8`::Granted request >Thread-662::DEBUG::2013-03-01 13:02:20,586::task::794::TaskManager.Task::(resourceAcquired) Task=`d94dd47b-3370-420b-8f4c-ff1c911de722`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-662::DEBUG::2013-03-01 13:02:20,586::task::957::TaskManager.Task::(_decref) Task=`d94dd47b-3370-420b-8f4c-ff1c911de722`::ref 1 aborting False >Thread-662::INFO::2013-03-01 13:02:20,587::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f volUUID = 174418c8-73dd-4b93-9059-6ba35d2db54b >Thread-662::DEBUG::2013-03-01 13:02:20,587::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-662::DEBUG::2013-03-01 13:02:20,597::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316435 s, 1.6 MB/s\n'; <rc> = 0 >Thread-662::DEBUG::2013-03-01 13:02:20,598::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316435 s, 1.6 MB/s'], size: 512 >Thread-662::DEBUG::2013-03-01 13:02:20,599::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-662::DEBUG::2013-03-01 13:02:20,609::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000312206 s, 1.6 MB/s\n'; <rc> = 0 >Thread-662::DEBUG::2013-03-01 13:02:20,609::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000312206 s, 1.6 MB/s'], size: 512 >Thread-662::DEBUG::2013-03-01 13:02:20,610::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-662::DEBUG::2013-03-01 13:02:20,611::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-662::DEBUG::2013-03-01 13:02:20,856::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-662::DEBUG::2013-03-01 13:02:20,869::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-662::INFO::2013-03-01 13:02:20,869::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-662::INFO::2013-03-01 13:02:20,870::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-662::DEBUG::2013-03-01 13:02:20,870::task::1151::TaskManager.Task::(prepare) Task=`d94dd47b-3370-420b-8f4c-ff1c911de722`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135733', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135733', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-662::DEBUG::2013-03-01 13:02:20,870::task::568::TaskManager.Task::(_updateState) Task=`d94dd47b-3370-420b-8f4c-ff1c911de722`::moving from state preparing -> state finished >Thread-662::DEBUG::2013-03-01 13:02:20,871::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-662::DEBUG::2013-03-01 13:02:20,871::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-662::DEBUG::2013-03-01 13:02:20,872::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-662::DEBUG::2013-03-01 13:02:20,872::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-662::DEBUG::2013-03-01 13:02:20,872::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-662::DEBUG::2013-03-01 13:02:20,872::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-662::DEBUG::2013-03-01 13:02:20,873::task::957::TaskManager.Task::(_decref) Task=`d94dd47b-3370-420b-8f4c-ff1c911de722`::ref 0 aborting False >Thread-664::DEBUG::2013-03-01 13:02:20,903::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-664::DEBUG::2013-03-01 13:02:20,903::task::568::TaskManager.Task::(_updateState) Task=`da528929-1528-4625-8e48-420fc39627a8`::moving from state init -> state preparing >Thread-664::INFO::2013-03-01 13:02:20,904::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='8936b001-cffa-4086-ad60-c1815334d95c', desc='', srcImgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', srcVolUUID='174418c8-73dd-4b93-9059-6ba35d2db54b') >Thread-664::INFO::2013-03-01 13:02:20,904::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-664::DEBUG::2013-03-01 13:02:20,905::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-664::DEBUG::2013-03-01 13:02:21,146::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-664::DEBUG::2013-03-01 13:02:21,151::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-664::DEBUG::2013-03-01 13:02:21,152::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-664::DEBUG::2013-03-01 13:02:21,152::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-664::DEBUG::2013-03-01 13:02:21,153::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-664::DEBUG::2013-03-01 13:02:21,153::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-664::DEBUG::2013-03-01 13:02:21,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-664::DEBUG::2013-03-01 13:02:21,358::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-664::DEBUG::2013-03-01 13:02:21,360::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-664::DEBUG::2013-03-01 13:02:21,360::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-664::DEBUG::2013-03-01 13:02:21,362::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a95fa70b-e532-461c-aa16-df96bba7f65e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-664::DEBUG::2013-03-01 13:02:21,362::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-664::DEBUG::2013-03-01 13:02:21,363::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-664::DEBUG::2013-03-01 13:02:21,363::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`a95fa70b-e532-461c-aa16-df96bba7f65e`::Granted request >Thread-664::DEBUG::2013-03-01 13:02:21,364::task::794::TaskManager.Task::(resourceAcquired) Task=`da528929-1528-4625-8e48-420fc39627a8`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-664::DEBUG::2013-03-01 13:02:21,364::task::957::TaskManager.Task::(_decref) Task=`da528929-1528-4625-8e48-420fc39627a8`::ref 1 aborting False >Thread-664::DEBUG::2013-03-01 13:02:21,366::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >Thread-664::DEBUG::2013-03-01 13:02:21,373::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task da528929-1528-4625-8e48-420fc39627a8 >Thread-664::INFO::2013-03-01 13:02:21,373::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-664::DEBUG::2013-03-01 13:02:21,373::task::1146::TaskManager.Task::(prepare) Task=`da528929-1528-4625-8e48-420fc39627a8`::Prepare: 1 jobs exist, move to acquiring >Thread-664::DEBUG::2013-03-01 13:02:21,374::task::568::TaskManager.Task::(_updateState) Task=`da528929-1528-4625-8e48-420fc39627a8`::moving from state preparing -> state acquiring >Thread-664::DEBUG::2013-03-01 13:02:21,375::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >Thread-664::DEBUG::2013-03-01 13:02:21,382::task::568::TaskManager.Task::(_updateState) Task=`da528929-1528-4625-8e48-420fc39627a8`::moving from state acquiring -> state queued >Thread-664::DEBUG::2013-03-01 13:02:21,383::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >Thread-664::DEBUG::2013-03-01 13:02:21,390::taskManager::50::TaskManager::(_queueTask) queuing task: da528929-1528-4625-8e48-420fc39627a8 >1cde5706-72b6-4774-bb7d-4d8aa7ff0634::DEBUG::2013-03-01 13:02:21,391::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-664::DEBUG::2013-03-01 13:02:21,391::taskManager::56::TaskManager::(_queueTask) task queued: da528929-1528-4625-8e48-420fc39627a8 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,392::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: da528929-1528-4625-8e48-420fc39627a8 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c014a098>> with: None >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,394::task::1159::TaskManager.Task::(commit) Task=`da528929-1528-4625-8e48-420fc39627a8`::committing task: da528929-1528-4625-8e48-420fc39627a8 >Thread-664::DEBUG::2013-03-01 13:02:21,394::task::1148::TaskManager.Task::(prepare) Task=`da528929-1528-4625-8e48-420fc39627a8`::returning >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,396::task::568::TaskManager.Task::(_updateState) Task=`da528929-1528-4625-8e48-420fc39627a8`::moving from state queued -> state running >Thread-664::DEBUG::2013-03-01 13:02:21,397::task::957::TaskManager.Task::(_decref) Task=`da528929-1528-4625-8e48-420fc39627a8`::ref 1 aborting False >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,401::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,410::task::872::TaskManager.Task::(_runJobs) Task=`da528929-1528-4625-8e48-420fc39627a8`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'bc7e8a03-5152-493a-a0b5-55c04543214f', 12582912, 4, 2, 2, '8936b001-cffa-4086-ad60-c1815334d95c', '', 'bc7e8a03-5152-493a-a0b5-55c04543214f', '174418c8-73dd-4b93-9059-6ba35d2db54b') kwargs: {}) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,411::task::304::TaskManager.Task::(run) Task=`da528929-1528-4625-8e48-420fc39627a8`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'bc7e8a03-5152-493a-a0b5-55c04543214f', 12582912, 4, 2, 2, '8936b001-cffa-4086-ad60-c1815334d95c', '', 'bc7e8a03-5152-493a-a0b5-55c04543214f', '174418c8-73dd-4b93-9059-6ba35d2db54b') kwargs: {}) callback None >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,411::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`084fadb1-a7e5-42c5-a747-72bd8be616c3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,411::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' for lock type 'exclusive' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,412::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,413::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,660::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,673::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,684::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308872 s, 1.7 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,685::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308872 s, 1.7 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,685::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,695::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000305928 s, 1.7 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,696::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000305928 s, 1.7 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::INFO::2013-03-01 13:02:21,696::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f chain=[<storage.blockVolume.BlockVolume object at 0x7f15ec19fb90>] >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,697::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`b0eea599-0f31-4788-8b7b-c76fb164f7d5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,697::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' for lock type 'exclusive' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,698::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free. Now locking as 'exclusive' (1 active user) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,699::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`b0eea599-0f31-4788-8b7b-c76fb164f7d5`::Granted request >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,700::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' is free. Now locking as 'exclusive' (1 active user) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,700::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`084fadb1-a7e5-42c5-a747-72bd8be616c3`::Granted request >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,701::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,702::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:21,911::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,960::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,990::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::WARNING::2013-03-01 13:02:21,991::lvm::593::Storage.LVM::(getLv) lv: 8936b001-cffa-4086-ad60-c1815334d95c not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:21,994::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00033049 s, 1.5 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,018::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00033049 s, 1.5 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,039::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000348986 s, 1.5 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,041::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000348986 s, 1.5 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::INFO::2013-03-01 13:02:22,042::volume::457::Storage.Volume::(create) Creating volume 8936b001-cffa-4086-ad60-c1815334d95c >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,046::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,076::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:22,110::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 8936b001-cffa-4086-ad60-c1815334d95c a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:22,150::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.155081 s, 6.6 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,759::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,759::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,760::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,760::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::INFO::2013-03-01 13:02:23,761::blockVolume::182::Storage.Volume::(_create) Request to create snapshot bc7e8a03-5152-493a-a0b5-55c04543214f/8936b001-cffa-4086-ad60-c1815334d95c of volume bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,762::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,772::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,783::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000350842 s, 1.5 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,783::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000350842 s, 1.5 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,784::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,794::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000369682 s, 1.4 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,794::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000369682 s, 1.4 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::INFO::2013-03-01 13:02:23,796::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,796::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,806::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000302292 s, 1.7 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,807::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000302292 s, 1.7 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,808::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`23bc4fb8-7aca-459e-b35b-cd216dfe40b7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,808::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' for lock type 'shared' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:23,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:24,163::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:24,264::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383808 s, 26.7 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,530::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,531::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,531::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,531::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free. Now locking as 'shared' (1 active user) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,532::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`23bc4fb8-7aca-459e-b35b-cd216dfe40b7`::Granted request >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,533::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,534::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,790::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,804::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,804::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/8936b001-cffa-4086-ad60-c1815334d95c >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,805::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,815::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000365011 s, 1.4 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,816::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000365011 s, 1.4 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,817::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,827::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000360413 s, 1.4 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,827::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000360413 s, 1.4 MB/s'], size: 512 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,828::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/8936b001-cffa-4086-ad60-c1815334d95c' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,843::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::INFO::2013-03-01 13:02:25,843::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b justme False >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,844::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,844::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' (0 active users) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,844::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free, finding out if anyone is waiting for it. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:25,845::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:25,972::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:02:25,973::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-666::DEBUG::2013-03-01 13:02:26,133::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-666::DEBUG::2013-03-01 13:02:26,133::task::568::TaskManager.Task::(_updateState) Task=`4fcbd055-f50f-4670-984f-6e8db2e9e172`::moving from state init -> state preparing >Thread-666::INFO::2013-03-01 13:02:26,134::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-666::DEBUG::2013-03-01 13:02:26,134::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-666::DEBUG::2013-03-01 13:02:26,134::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: da528929-1528-4625-8e48-420fc39627a8 >Thread-666::DEBUG::2013-03-01 13:02:26,134::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'} >Thread-666::DEBUG::2013-03-01 13:02:26,134::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'da528929-1528-4625-8e48-420fc39627a8': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'}} >Thread-666::INFO::2013-03-01 13:02:26,134::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'da528929-1528-4625-8e48-420fc39627a8': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'}}} >Thread-666::DEBUG::2013-03-01 13:02:26,135::task::1151::TaskManager.Task::(prepare) Task=`4fcbd055-f50f-4670-984f-6e8db2e9e172`::finished: {'allTasksStatus': {'da528929-1528-4625-8e48-420fc39627a8': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'}}} >Thread-666::DEBUG::2013-03-01 13:02:26,135::task::568::TaskManager.Task::(_updateState) Task=`4fcbd055-f50f-4670-984f-6e8db2e9e172`::moving from state preparing -> state finished >Thread-666::DEBUG::2013-03-01 13:02:26,135::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-666::DEBUG::2013-03-01 13:02:26,135::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-666::DEBUG::2013-03-01 13:02:26,135::task::957::TaskManager.Task::(_decref) Task=`4fcbd055-f50f-4670-984f-6e8db2e9e172`::ref 0 aborting False >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,163::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,209::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Dummy-173::DEBUG::2013-03-01 13:02:26,277::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:26,320::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:02:26,324::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,327::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:02:26,329::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,340::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,345::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b', Clearing records. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,352::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,367::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:26,397::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000357683 s, 11.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:26,452::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0947698 s, 10.8 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:02:26,562::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:26,570::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00037383 s, 11.0 MB/s\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,593::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,594::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,595::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-667::DEBUG::2013-03-01 13:02:26,785::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-667::DEBUG::2013-03-01 13:02:26,786::task::568::TaskManager.Task::(_updateState) Task=`d8378330-ca30-4ae6-ba05-1f52e36b3baa`::moving from state init -> state preparing >Thread-667::INFO::2013-03-01 13:02:26,787::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-667::INFO::2013-03-01 13:02:26,787::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-667::DEBUG::2013-03-01 13:02:26,788::task::1151::TaskManager.Task::(prepare) Task=`d8378330-ca30-4ae6-ba05-1f52e36b3baa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-667::DEBUG::2013-03-01 13:02:26,788::task::568::TaskManager.Task::(_updateState) Task=`d8378330-ca30-4ae6-ba05-1f52e36b3baa`::moving from state preparing -> state finished >Thread-667::DEBUG::2013-03-01 13:02:26,788::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-667::DEBUG::2013-03-01 13:02:26,788::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-667::DEBUG::2013-03-01 13:02:26,789::task::957::TaskManager.Task::(_decref) Task=`d8378330-ca30-4ae6-ba05-1f52e36b3baa`::ref 0 aborting False >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,795::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,806::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::WARNING::2013-03-01 13:02:26,807::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/8936b001-cffa-4086-ad60-c1815334d95c >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,808::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 8 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:26,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_bc7e8a03-5152-493a-a0b5-55c04543214f --addtag PU_174418c8-73dd-4b93-9059-6ba35d2db54b --addtag MD_8 a558fc2a-a4a3-4118-9b81-d1d601eaa295/8936b001-cffa-4086-ad60-c1815334d95c' (cwd None) >Thread-668::DEBUG::2013-03-01 13:02:26,819::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-668::DEBUG::2013-03-01 13:02:26,820::task::568::TaskManager.Task::(_updateState) Task=`939b5609-d106-4d88-9f9e-a5a53a8dfa85`::moving from state init -> state preparing >Thread-668::INFO::2013-03-01 13:02:26,821::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-668::DEBUG::2013-03-01 13:02:26,821::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`13569975-584a-4c14-aaf6-3ce3e67e5c5a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-668::DEBUG::2013-03-01 13:02:26,822::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-668::DEBUG::2013-03-01 13:02:26,822::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-668::DEBUG::2013-03-01 13:02:26,822::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`13569975-584a-4c14-aaf6-3ce3e67e5c5a`::Granted request >Thread-668::DEBUG::2013-03-01 13:02:26,824::task::794::TaskManager.Task::(resourceAcquired) Task=`939b5609-d106-4d88-9f9e-a5a53a8dfa85`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-668::DEBUG::2013-03-01 13:02:26,824::task::957::TaskManager.Task::(_decref) Task=`939b5609-d106-4d88-9f9e-a5a53a8dfa85`::ref 1 aborting False >Thread-668::INFO::2013-03-01 13:02:26,826::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-668::DEBUG::2013-03-01 13:02:26,826::task::1151::TaskManager.Task::(prepare) Task=`939b5609-d106-4d88-9f9e-a5a53a8dfa85`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-668::DEBUG::2013-03-01 13:02:26,827::task::568::TaskManager.Task::(_updateState) Task=`939b5609-d106-4d88-9f9e-a5a53a8dfa85`::moving from state preparing -> state finished >Thread-668::DEBUG::2013-03-01 13:02:26,827::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-668::DEBUG::2013-03-01 13:02:26,827::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-668::DEBUG::2013-03-01 13:02:26,828::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-668::DEBUG::2013-03-01 13:02:26,828::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-668::DEBUG::2013-03-01 13:02:26,828::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-668::DEBUG::2013-03-01 13:02:26,828::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-668::DEBUG::2013-03-01 13:02:26,829::task::957::TaskManager.Task::(_decref) Task=`939b5609-d106-4d88-9f9e-a5a53a8dfa85`::ref 0 aborting False >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,013::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,013::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,014::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,015::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/8936b001-cffa-4086-ad60-c1815334d95c' (cwd None) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,222::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,223::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,224::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,225::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,237::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=8936b001-cffa-4086-ad60-c1815334d95c sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,247::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,253::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,253::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' (0 active users) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,254::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' is free, finding out if anyone is waiting for it. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,254::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,254::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' (0 active users) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,254::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free, finding out if anyone is waiting for it. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,254::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b', Clearing records. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,255::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f', Clearing records. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,255::task::568::TaskManager.Task::(_updateState) Task=`da528929-1528-4625-8e48-420fc39627a8`::moving from state running -> state finished >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,256::task::719::TaskManager.Task::(_save) Task=`da528929-1528-4625-8e48-420fc39627a8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/da528929-1528-4625-8e48-420fc39627a8.temp >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,263::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,263::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,263::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,264::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,264::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,264::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,264::task::880::TaskManager.Task::(_runJobs) Task=`da528929-1528-4625-8e48-420fc39627a8`::Task.run: exit - success: result {'uuid': '8936b001-cffa-4086-ad60-c1815334d95c'} >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,264::task::957::TaskManager.Task::(_decref) Task=`da528929-1528-4625-8e48-420fc39627a8`::ref 0 aborting False >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:02:27,265::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:02:28,466::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:28,555::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429494 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:30,569::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:30,673::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384227 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:32,692::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:32,803::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465124 s, 22.0 MB/s\n'; <rc> = 0 >Thread-671::DEBUG::2013-03-01 13:02:32,944::task::568::TaskManager.Task::(_updateState) Task=`db22d96d-0203-4ac5-9d3e-eeb8ab3b871d`::moving from state init -> state preparing >Thread-671::INFO::2013-03-01 13:02:32,945::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-671::INFO::2013-03-01 13:02:32,945::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00902605056763', 'lastCheck': '6.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0728838443756', 'lastCheck': '6.5', 'code': 0, 'valid': True}} >Thread-671::DEBUG::2013-03-01 13:02:32,945::task::1151::TaskManager.Task::(prepare) Task=`db22d96d-0203-4ac5-9d3e-eeb8ab3b871d`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00902605056763', 'lastCheck': '6.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0728838443756', 'lastCheck': '6.5', 'code': 0, 'valid': True}} >Thread-671::DEBUG::2013-03-01 13:02:32,945::task::568::TaskManager.Task::(_updateState) Task=`db22d96d-0203-4ac5-9d3e-eeb8ab3b871d`::moving from state preparing -> state finished >Thread-671::DEBUG::2013-03-01 13:02:32,946::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-671::DEBUG::2013-03-01 13:02:32,946::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-671::DEBUG::2013-03-01 13:02:32,946::task::957::TaskManager.Task::(_decref) Task=`db22d96d-0203-4ac5-9d3e-eeb8ab3b871d`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:34,822::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:34,926::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038009 s, 26.9 MB/s\n'; <rc> = 0 >Thread-674::DEBUG::2013-03-01 13:02:36,165::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-674::DEBUG::2013-03-01 13:02:36,165::task::568::TaskManager.Task::(_updateState) Task=`bedca823-4100-4399-8725-0af41f9cd51b`::moving from state init -> state preparing >Thread-674::INFO::2013-03-01 13:02:36,165::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-674::DEBUG::2013-03-01 13:02:36,166::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-674::DEBUG::2013-03-01 13:02:36,166::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: da528929-1528-4625-8e48-420fc39627a8 >Thread-674::DEBUG::2013-03-01 13:02:36,166::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'} >Thread-674::DEBUG::2013-03-01 13:02:36,166::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'da528929-1528-4625-8e48-420fc39627a8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'}} >Thread-674::INFO::2013-03-01 13:02:36,167::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'da528929-1528-4625-8e48-420fc39627a8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'}}} >Thread-674::DEBUG::2013-03-01 13:02:36,167::task::1151::TaskManager.Task::(prepare) Task=`bedca823-4100-4399-8725-0af41f9cd51b`::finished: {'allTasksStatus': {'da528929-1528-4625-8e48-420fc39627a8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'da528929-1528-4625-8e48-420fc39627a8'}}} >Thread-674::DEBUG::2013-03-01 13:02:36,167::task::568::TaskManager.Task::(_updateState) Task=`bedca823-4100-4399-8725-0af41f9cd51b`::moving from state preparing -> state finished >Thread-674::DEBUG::2013-03-01 13:02:36,167::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-674::DEBUG::2013-03-01 13:02:36,168::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-674::DEBUG::2013-03-01 13:02:36,168::task::957::TaskManager.Task::(_decref) Task=`bedca823-4100-4399-8725-0af41f9cd51b`::ref 0 aborting False >Thread-675::DEBUG::2013-03-01 13:02:36,240::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-675::DEBUG::2013-03-01 13:02:36,240::task::568::TaskManager.Task::(_updateState) Task=`4fd341d4-9688-417a-bcce-19713e95cdc6`::moving from state init -> state preparing >Thread-675::INFO::2013-03-01 13:02:36,241::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', volUUID='8936b001-cffa-4086-ad60-c1815334d95c', options=None) >Thread-675::DEBUG::2013-03-01 13:02:36,241::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`cc9d5a2d-b165-4779-a187-14fef2d4be2d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-675::DEBUG::2013-03-01 13:02:36,241::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-675::DEBUG::2013-03-01 13:02:36,242::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-675::DEBUG::2013-03-01 13:02:36,242::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`cc9d5a2d-b165-4779-a187-14fef2d4be2d`::Granted request >Thread-675::DEBUG::2013-03-01 13:02:36,242::task::794::TaskManager.Task::(resourceAcquired) Task=`4fd341d4-9688-417a-bcce-19713e95cdc6`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-675::DEBUG::2013-03-01 13:02:36,243::task::957::TaskManager.Task::(_decref) Task=`4fd341d4-9688-417a-bcce-19713e95cdc6`::ref 1 aborting False >Thread-675::DEBUG::2013-03-01 13:02:36,243::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-675::DEBUG::2013-03-01 13:02:36,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:36,419::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:36,431::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000369953 s, 11.1 MB/s\n'; <rc> = 0 >Thread-675::DEBUG::2013-03-01 13:02:36,491::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-675::DEBUG::2013-03-01 13:02:36,505::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-675::INFO::2013-03-01 13:02:36,506::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f volUUID = 8936b001-cffa-4086-ad60-c1815334d95c >Thread-675::DEBUG::2013-03-01 13:02:36,506::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-675::DEBUG::2013-03-01 13:02:36,516::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000336451 s, 1.5 MB/s\n'; <rc> = 0 >Thread-675::DEBUG::2013-03-01 13:02:36,517::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000336451 s, 1.5 MB/s'], size: 512 >Thread-675::DEBUG::2013-03-01 13:02:36,518::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-675::DEBUG::2013-03-01 13:02:36,528::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000317155 s, 1.6 MB/s\n'; <rc> = 0 >Thread-675::DEBUG::2013-03-01 13:02:36,529::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000317155 s, 1.6 MB/s'], size: 512 >Thread-675::DEBUG::2013-03-01 13:02:36,530::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-675::DEBUG::2013-03-01 13:02:36,531::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:36,572::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:36,581::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000368593 s, 11.1 MB/s\n'; <rc> = 0 >Thread-675::DEBUG::2013-03-01 13:02:36,776::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-675::DEBUG::2013-03-01 13:02:36,787::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-675::INFO::2013-03-01 13:02:36,788::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/bc7e8a03-5152-493a-a0b5-55c04543214f/8936b001-cffa-4086-ad60-c1815334d95c info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135747', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135747', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8936b001-cffa-4086-ad60-c1815334d95c', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-675::INFO::2013-03-01 13:02:36,788::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135747', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135747', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8936b001-cffa-4086-ad60-c1815334d95c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-675::DEBUG::2013-03-01 13:02:36,789::task::1151::TaskManager.Task::(prepare) Task=`4fd341d4-9688-417a-bcce-19713e95cdc6`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '174418c8-73dd-4b93-9059-6ba35d2db54b', 'format': 'COW', 'image': 'bc7e8a03-5152-493a-a0b5-55c04543214f', 'ctime': '1362135747', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135747', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '8936b001-cffa-4086-ad60-c1815334d95c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-675::DEBUG::2013-03-01 13:02:36,789::task::568::TaskManager.Task::(_updateState) Task=`4fd341d4-9688-417a-bcce-19713e95cdc6`::moving from state preparing -> state finished >Thread-675::DEBUG::2013-03-01 13:02:36,789::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-675::DEBUG::2013-03-01 13:02:36,790::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-675::DEBUG::2013-03-01 13:02:36,790::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-675::DEBUG::2013-03-01 13:02:36,790::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-675::DEBUG::2013-03-01 13:02:36,791::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-675::DEBUG::2013-03-01 13:02:36,791::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-675::DEBUG::2013-03-01 13:02:36,791::task::957::TaskManager.Task::(_decref) Task=`4fd341d4-9688-417a-bcce-19713e95cdc6`::ref 0 aborting False >Thread-676::DEBUG::2013-03-01 13:02:36,841::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-676::DEBUG::2013-03-01 13:02:36,842::task::568::TaskManager.Task::(_updateState) Task=`d7ac3ff7-c8c7-4ebb-8c58-9ffdc75d6ee1`::moving from state init -> state preparing >Thread-676::INFO::2013-03-01 13:02:36,842::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='da528929-1528-4625-8e48-420fc39627a8', spUUID=None, options=None) >Thread-676::DEBUG::2013-03-01 13:02:36,842::taskManager::161::TaskManager::(clearTask) Entry. taskID: da528929-1528-4625-8e48-420fc39627a8 >Thread-676::DEBUG::2013-03-01 13:02:36,844::taskManager::166::TaskManager::(clearTask) Return. >Thread-676::INFO::2013-03-01 13:02:36,844::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-676::DEBUG::2013-03-01 13:02:36,844::task::1151::TaskManager.Task::(prepare) Task=`d7ac3ff7-c8c7-4ebb-8c58-9ffdc75d6ee1`::finished: None >Thread-676::DEBUG::2013-03-01 13:02:36,845::task::568::TaskManager.Task::(_updateState) Task=`d7ac3ff7-c8c7-4ebb-8c58-9ffdc75d6ee1`::moving from state preparing -> state finished >Thread-676::DEBUG::2013-03-01 13:02:36,845::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-676::DEBUG::2013-03-01 13:02:36,845::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-676::DEBUG::2013-03-01 13:02:36,845::task::957::TaskManager.Task::(_decref) Task=`d7ac3ff7-c8c7-4ebb-8c58-9ffdc75d6ee1`::ref 0 aborting False >Thread-677::DEBUG::2013-03-01 13:02:36,872::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-677::DEBUG::2013-03-01 13:02:36,872::task::568::TaskManager.Task::(_updateState) Task=`f50817a4-60b8-43ed-9dbe-18e540256aa5`::moving from state init -> state preparing >Thread-677::INFO::2013-03-01 13:02:36,873::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-677::INFO::2013-03-01 13:02:36,873::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-677::DEBUG::2013-03-01 13:02:36,873::task::1151::TaskManager.Task::(prepare) Task=`f50817a4-60b8-43ed-9dbe-18e540256aa5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-677::DEBUG::2013-03-01 13:02:36,874::task::568::TaskManager.Task::(_updateState) Task=`f50817a4-60b8-43ed-9dbe-18e540256aa5`::moving from state preparing -> state finished >Thread-677::DEBUG::2013-03-01 13:02:36,874::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-677::DEBUG::2013-03-01 13:02:36,874::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-677::DEBUG::2013-03-01 13:02:36,874::task::957::TaskManager.Task::(_decref) Task=`f50817a4-60b8-43ed-9dbe-18e540256aa5`::ref 0 aborting False >Thread-678::DEBUG::2013-03-01 13:02:36,899::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-678::DEBUG::2013-03-01 13:02:36,899::task::568::TaskManager.Task::(_updateState) Task=`22d222bb-c737-42a7-8d2f-1e353a4df2a1`::moving from state init -> state preparing >Thread-678::INFO::2013-03-01 13:02:36,900::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-678::DEBUG::2013-03-01 13:02:36,900::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2219884e-ba85-4c24-850f-246e0f60d57b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-678::DEBUG::2013-03-01 13:02:36,901::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-678::DEBUG::2013-03-01 13:02:36,901::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-678::DEBUG::2013-03-01 13:02:36,901::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2219884e-ba85-4c24-850f-246e0f60d57b`::Granted request >Thread-678::DEBUG::2013-03-01 13:02:36,902::task::794::TaskManager.Task::(resourceAcquired) Task=`22d222bb-c737-42a7-8d2f-1e353a4df2a1`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-678::DEBUG::2013-03-01 13:02:36,902::task::957::TaskManager.Task::(_decref) Task=`22d222bb-c737-42a7-8d2f-1e353a4df2a1`::ref 1 aborting False >Thread-678::INFO::2013-03-01 13:02:36,904::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-678::DEBUG::2013-03-01 13:02:36,904::task::1151::TaskManager.Task::(prepare) Task=`22d222bb-c737-42a7-8d2f-1e353a4df2a1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-678::DEBUG::2013-03-01 13:02:36,904::task::568::TaskManager.Task::(_updateState) Task=`22d222bb-c737-42a7-8d2f-1e353a4df2a1`::moving from state preparing -> state finished >Thread-678::DEBUG::2013-03-01 13:02:36,905::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-678::DEBUG::2013-03-01 13:02:36,905::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-678::DEBUG::2013-03-01 13:02:36,905::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-678::DEBUG::2013-03-01 13:02:36,906::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-678::DEBUG::2013-03-01 13:02:36,906::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-678::DEBUG::2013-03-01 13:02:36,906::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-678::DEBUG::2013-03-01 13:02:36,907::task::957::TaskManager.Task::(_decref) Task=`22d222bb-c737-42a7-8d2f-1e353a4df2a1`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:36,945::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:37,065::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464268 s, 22.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:39,084::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:39,187::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409242 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:41,201::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:41,315::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494457 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:43,334::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:43,427::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403666 s, 25.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:45,447::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:45,553::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408635 s, 25.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:02:46,438::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:46,449::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000349066 s, 11.7 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:02:46,583::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:46,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000400818 s, 10.2 MB/s\n'; <rc> = 0 >Thread-682::DEBUG::2013-03-01 13:02:46,946::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-682::DEBUG::2013-03-01 13:02:46,947::task::568::TaskManager.Task::(_updateState) Task=`fe2456c5-08d1-403f-91f3-52b6a6960a05`::moving from state init -> state preparing >Thread-682::INFO::2013-03-01 13:02:46,947::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-682::INFO::2013-03-01 13:02:46,948::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-682::DEBUG::2013-03-01 13:02:46,948::task::1151::TaskManager.Task::(prepare) Task=`fe2456c5-08d1-403f-91f3-52b6a6960a05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-682::DEBUG::2013-03-01 13:02:46,948::task::568::TaskManager.Task::(_updateState) Task=`fe2456c5-08d1-403f-91f3-52b6a6960a05`::moving from state preparing -> state finished >Thread-682::DEBUG::2013-03-01 13:02:46,949::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-682::DEBUG::2013-03-01 13:02:46,949::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-682::DEBUG::2013-03-01 13:02:46,949::task::957::TaskManager.Task::(_decref) Task=`fe2456c5-08d1-403f-91f3-52b6a6960a05`::ref 0 aborting False >Thread-683::DEBUG::2013-03-01 13:02:46,975::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-683::DEBUG::2013-03-01 13:02:46,975::task::568::TaskManager.Task::(_updateState) Task=`0bd3f302-bd08-4c2d-a58a-935eb8b0d8fc`::moving from state init -> state preparing >Thread-683::INFO::2013-03-01 13:02:46,975::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-683::DEBUG::2013-03-01 13:02:46,976::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9983d07b-09f9-4af1-986a-4ba786c2e688`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-683::DEBUG::2013-03-01 13:02:46,976::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-683::DEBUG::2013-03-01 13:02:46,977::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-683::DEBUG::2013-03-01 13:02:46,977::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9983d07b-09f9-4af1-986a-4ba786c2e688`::Granted request >Thread-683::DEBUG::2013-03-01 13:02:46,978::task::794::TaskManager.Task::(resourceAcquired) Task=`0bd3f302-bd08-4c2d-a58a-935eb8b0d8fc`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-683::DEBUG::2013-03-01 13:02:46,978::task::957::TaskManager.Task::(_decref) Task=`0bd3f302-bd08-4c2d-a58a-935eb8b0d8fc`::ref 1 aborting False >Thread-683::INFO::2013-03-01 13:02:46,979::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-683::DEBUG::2013-03-01 13:02:46,980::task::1151::TaskManager.Task::(prepare) Task=`0bd3f302-bd08-4c2d-a58a-935eb8b0d8fc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-683::DEBUG::2013-03-01 13:02:46,980::task::568::TaskManager.Task::(_updateState) Task=`0bd3f302-bd08-4c2d-a58a-935eb8b0d8fc`::moving from state preparing -> state finished >Thread-683::DEBUG::2013-03-01 13:02:46,980::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-683::DEBUG::2013-03-01 13:02:46,981::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-683::DEBUG::2013-03-01 13:02:46,981::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-683::DEBUG::2013-03-01 13:02:46,981::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-683::DEBUG::2013-03-01 13:02:46,982::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-683::DEBUG::2013-03-01 13:02:46,982::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-683::DEBUG::2013-03-01 13:02:46,982::task::957::TaskManager.Task::(_decref) Task=`0bd3f302-bd08-4c2d-a58a-935eb8b0d8fc`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:47,572::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:47,670::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358915 s, 28.5 MB/s\n'; <rc> = 0 >Thread-684::DEBUG::2013-03-01 13:02:48,464::task::568::TaskManager.Task::(_updateState) Task=`35574f87-1358-4060-afe8-28d5f3371ce0`::moving from state init -> state preparing >Thread-684::INFO::2013-03-01 13:02:48,464::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-684::INFO::2013-03-01 13:02:48,464::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0099937915802', 'lastCheck': '1.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0126101970673', 'lastCheck': '2.0', 'code': 0, 'valid': True}} >Thread-684::DEBUG::2013-03-01 13:02:48,465::task::1151::TaskManager.Task::(prepare) Task=`35574f87-1358-4060-afe8-28d5f3371ce0`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0099937915802', 'lastCheck': '1.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0126101970673', 'lastCheck': '2.0', 'code': 0, 'valid': True}} >Thread-684::DEBUG::2013-03-01 13:02:48,465::task::568::TaskManager.Task::(_updateState) Task=`35574f87-1358-4060-afe8-28d5f3371ce0`::moving from state preparing -> state finished >Thread-684::DEBUG::2013-03-01 13:02:48,465::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-684::DEBUG::2013-03-01 13:02:48,465::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-684::DEBUG::2013-03-01 13:02:48,466::task::957::TaskManager.Task::(_decref) Task=`35574f87-1358-4060-afe8-28d5f3371ce0`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:02:49,689::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:49,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360357 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:02:51,809::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:51,915::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414271 s, 24.7 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:53,918::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-687::DEBUG::2013-03-01 13:02:53,919::task::568::TaskManager.Task::(_updateState) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::moving from state init -> state preparing >Thread-687::INFO::2013-03-01 13:02:53,919::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', srcVolUUID='174418c8-73dd-4b93-9059-6ba35d2db54b', dstImgUUID='72cd2840-a18b-4e77-98ec-487a6d283cf3', dstVolUUID='202d8c60-c94a-4a5e-9c54-b496489f6911', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-687::INFO::2013-03-01 13:02:53,920::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-687::DEBUG::2013-03-01 13:02:53,920::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:53,934::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:54,040::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413766 s, 24.7 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,168::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,168::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,169::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,169::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,169::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,170::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,170::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:54,527::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,530::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,531::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-687::DEBUG::2013-03-01 13:02:54,532::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:54,752::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,764::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-687::INFO::2013-03-01 13:02:54,765::image::458::Storage.Image::(isLegal) image bc7e8a03-5152-493a-a0b5-55c04543214f in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['8936b001-cffa-4086-ad60-c1815334d95c', '174418c8-73dd-4b93-9059-6ba35d2db54b'] >Thread-687::DEBUG::2013-03-01 13:02:54,765::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:54,775::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000331087 s, 1.5 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,776::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000331087 s, 1.5 MB/s'], size: 512 >Thread-687::DEBUG::2013-03-01 13:02:54,776::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:54,786::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000334055 s, 1.5 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,787::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000334055 s, 1.5 MB/s'], size: 512 >Thread-687::DEBUG::2013-03-01 13:02:54,788::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:54,797::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316492 s, 1.6 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,798::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316492 s, 1.6 MB/s'], size: 512 >Thread-687::DEBUG::2013-03-01 13:02:54,798::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:54,808::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000301876 s, 1.7 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:54,809::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000301876 s, 1.7 MB/s'], size: 512 >Thread-687::DEBUG::2013-03-01 13:02:54,809::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:54,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:55,001::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:55,014::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:02:55,015::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:55,025::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000298281 s, 1.7 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:55,026::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000298281 s, 1.7 MB/s'], size: 512 >Thread-687::DEBUG::2013-03-01 13:02:55,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-687::DEBUG::2013-03-01 13:02:55,037::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308037 s, 1.7 MB/s\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:02:55,037::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308037 s, 1.7 MB/s'], size: 512 >Thread-687::INFO::2013-03-01 13:02:55,038::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f chain=[<storage.blockVolume.BlockVolume object at 0x7f15f80b0c90>, <storage.blockVolume.BlockVolume object at 0x7f15e00cc450>] >Thread-687::DEBUG::2013-03-01 13:02:55,039::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`aad99723-0601-4060-9dff-852353ff59a4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-687::DEBUG::2013-03-01 13:02:55,039::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-687::DEBUG::2013-03-01 13:02:55,039::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-687::DEBUG::2013-03-01 13:02:55,040::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`aad99723-0601-4060-9dff-852353ff59a4`::Granted request >Thread-687::DEBUG::2013-03-01 13:02:55,040::task::794::TaskManager.Task::(resourceAcquired) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-687::DEBUG::2013-03-01 13:02:55,041::task::957::TaskManager.Task::(_decref) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::ref 1 aborting False >Thread-687::DEBUG::2013-03-01 13:02:55,042::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >Thread-687::DEBUG::2013-03-01 13:02:55,049::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_72cd2840-a18b-4e77-98ec-487a6d283cf3 for task e00f98e4-3ebe-48fa-97df-9d139da1f18a >Thread-687::INFO::2013-03-01 13:02:55,050::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-687::DEBUG::2013-03-01 13:02:55,050::task::1146::TaskManager.Task::(prepare) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::Prepare: 1 jobs exist, move to acquiring >Thread-687::DEBUG::2013-03-01 13:02:55,050::task::568::TaskManager.Task::(_updateState) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::moving from state preparing -> state acquiring >Thread-687::DEBUG::2013-03-01 13:02:55,051::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >Thread-687::DEBUG::2013-03-01 13:02:55,058::task::568::TaskManager.Task::(_updateState) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::moving from state acquiring -> state queued >Thread-687::DEBUG::2013-03-01 13:02:55,059::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >Thread-687::DEBUG::2013-03-01 13:02:55,065::taskManager::50::TaskManager::(_queueTask) queuing task: e00f98e4-3ebe-48fa-97df-9d139da1f18a >bc2c49f8-2929-4ea7-8d09-4420d7b21985::DEBUG::2013-03-01 13:02:55,066::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-687::DEBUG::2013-03-01 13:02:55,066::taskManager::56::TaskManager::(_queueTask) task queued: e00f98e4-3ebe-48fa-97df-9d139da1f18a >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,067::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: e00f98e4-3ebe-48fa-97df-9d139da1f18a running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c0277ab8>> with: None >Thread-687::DEBUG::2013-03-01 13:02:55,068::task::1148::TaskManager.Task::(prepare) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::returning >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,069::task::1159::TaskManager.Task::(commit) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::committing task: e00f98e4-3ebe-48fa-97df-9d139da1f18a >Thread-687::DEBUG::2013-03-01 13:02:55,071::task::957::TaskManager.Task::(_decref) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::ref 0 aborting False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,071::task::568::TaskManager.Task::(_updateState) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::moving from state queued -> state running >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,077::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,085::task::872::TaskManager.Task::(_runJobs) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::Task.run: running job 0: copyImage_72cd2840-a18b-4e77-98ec-487a6d283cf3: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'bc7e8a03-5152-493a-a0b5-55c04543214f', '174418c8-73dd-4b93-9059-6ba35d2db54b', '72cd2840-a18b-4e77-98ec-487a6d283cf3', '202d8c60-c94a-4a5e-9c54-b496489f6911', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,085::task::304::TaskManager.Task::(run) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::Job.run: running copyImage_72cd2840-a18b-4e77-98ec-487a6d283cf3: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'bc7e8a03-5152-493a-a0b5-55c04543214f', '174418c8-73dd-4b93-9059-6ba35d2db54b', '72cd2840-a18b-4e77-98ec-487a6d283cf3', '202d8c60-c94a-4a5e-9c54-b496489f6911', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,085::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`8bd0eb77-d9f5-4e5c-b56f-01dd80763313`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,086::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' for lock type 'shared' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,086::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,279::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,291::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,292::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,302::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299578 s, 1.7 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,303::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299578 s, 1.7 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,304::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,314::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000333417 s, 1.5 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,314::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000333417 s, 1.5 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:55,315::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f chain=[<storage.blockVolume.BlockVolume object at 0x7f15f80ab510>, <storage.blockVolume.BlockVolume object at 0x7f15f802c490>] >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,315::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`0008e240-96c1-40b0-8a99-2d681f371234`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,316::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' for lock type 'shared' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,316::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free. Now locking as 'shared' (1 active user) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,316::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`0008e240-96c1-40b0-8a99-2d681f371234`::Granted request >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,317::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c`ReqID=`cb6842bd-0a62-4f99-bcd6-d2c11ad60207`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,317::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c' for lock type 'shared' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,318::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c' is free. Now locking as 'shared' (1 active user) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,318::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c`ReqID=`cb6842bd-0a62-4f99-bcd6-d2c11ad60207`::Granted request >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,319::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' is free. Now locking as 'shared' (1 active user) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,319::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`8bd0eb77-d9f5-4e5c-b56f-01dd80763313`::Granted request >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,320::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3`ReqID=`3f83c674-f679-4234-bd30-35592a713da0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,320::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3' for lock type 'exclusive' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,321::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,568::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,580::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,581::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 72cd2840-a18b-4e77-98ec-487a6d283cf3 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,581::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3' is free. Now locking as 'exclusive' (1 active user) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,581::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3`ReqID=`3f83c674-f679-4234-bd30-35592a713da0`::Granted request >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:55,582::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=bc7e8a03-5152-493a-a0b5-55c04543214f srcVolUUID=174418c8-73dd-4b93-9059-6ba35d2db54b dstImgUUID=72cd2840-a18b-4e77-98ec-487a6d283cf3 dstVolUUID=202d8c60-c94a-4a5e-9c54-b496489f6911 dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,583::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308508 s, 1.7 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,593::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308508 s, 1.7 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,594::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,603::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311372 s, 1.6 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,604::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311372 s, 1.6 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,604::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,614::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000312928 s, 1.6 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,615::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000312928 s, 1.6 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,615::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,625::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327407 s, 1.6 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,625::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327407 s, 1.6 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,636::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000306152 s, 1.7 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,637::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000306152 s, 1.7 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,638::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,647::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000304752 s, 1.7 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,648::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000304752 s, 1.7 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:55,648::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:bc7e8a03-5152-493a-a0b5-55c04543214f:174418c8-73dd-4b93-9059-6ba35d2db54b vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:72cd2840-a18b-4e77-98ec-487a6d283cf3:202d8c60-c94a-4a5e-9c54-b496489f6911 apparentsize 2097152 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,649::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,650::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,874::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,884::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:55,885::image::458::Storage.Image::(isLegal) image 72cd2840-a18b-4e77-98ec-487a6d283cf3 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:55,885::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3 for image's volumes >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,886::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,894::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:55,895::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:56,059::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:56,147::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:56,171::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::WARNING::2013-03-01 13:02:56,172::lvm::593::Storage.LVM::(getLv) lv: 202d8c60-c94a-4a5e-9c54-b496489f6911 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:56,174::volume::457::Storage.Volume::(create) Creating volume 202d8c60-c94a-4a5e-9c54-b496489f6911 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:56,176::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:56,202::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >Thread-689::DEBUG::2013-03-01 13:02:56,207::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-689::DEBUG::2013-03-01 13:02:56,210::task::568::TaskManager.Task::(_updateState) Task=`a406f704-028e-4da5-8276-3a973dca8d5e`::moving from state init -> state preparing >Thread-689::INFO::2013-03-01 13:02:56,212::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-689::DEBUG::2013-03-01 13:02:56,213::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-689::DEBUG::2013-03-01 13:02:56,215::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e00f98e4-3ebe-48fa-97df-9d139da1f18a >Thread-689::DEBUG::2013-03-01 13:02:56,217::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'} >Thread-689::DEBUG::2013-03-01 13:02:56,218::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}} >Thread-689::INFO::2013-03-01 13:02:56,220::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}}} >Thread-689::DEBUG::2013-03-01 13:02:56,221::task::1151::TaskManager.Task::(prepare) Task=`a406f704-028e-4da5-8276-3a973dca8d5e`::finished: {'allTasksStatus': {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}}} >Thread-689::DEBUG::2013-03-01 13:02:56,223::task::568::TaskManager.Task::(_updateState) Task=`a406f704-028e-4da5-8276-3a973dca8d5e`::moving from state preparing -> state finished >Thread-689::DEBUG::2013-03-01 13:02:56,224::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-689::DEBUG::2013-03-01 13:02:56,226::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-689::DEBUG::2013-03-01 13:02:56,227::task::957::TaskManager.Task::(_decref) Task=`a406f704-028e-4da5-8276-3a973dca8d5e`::ref 0 aborting False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:56,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 202d8c60-c94a-4a5e-9c54-b496489f6911 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:56,260::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447926 s, 22.9 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:02:56,456::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:02:56,468::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000332417 s, 12.3 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:02:56,594::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:02:56,604::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000354631 s, 11.6 MB/s\n'; <rc> = 0 >Thread-690::DEBUG::2013-03-01 13:02:57,021::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-690::DEBUG::2013-03-01 13:02:57,022::task::568::TaskManager.Task::(_updateState) Task=`c2dead40-db16-433d-97a0-55aa860614c8`::moving from state init -> state preparing >Thread-690::INFO::2013-03-01 13:02:57,022::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-690::INFO::2013-03-01 13:02:57,023::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-690::DEBUG::2013-03-01 13:02:57,023::task::1151::TaskManager.Task::(prepare) Task=`c2dead40-db16-433d-97a0-55aa860614c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-690::DEBUG::2013-03-01 13:02:57,023::task::568::TaskManager.Task::(_updateState) Task=`c2dead40-db16-433d-97a0-55aa860614c8`::moving from state preparing -> state finished >Thread-690::DEBUG::2013-03-01 13:02:57,023::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-690::DEBUG::2013-03-01 13:02:57,023::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-690::DEBUG::2013-03-01 13:02:57,023::task::957::TaskManager.Task::(_decref) Task=`c2dead40-db16-433d-97a0-55aa860614c8`::ref 0 aborting False >Thread-691::DEBUG::2013-03-01 13:02:57,048::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-691::DEBUG::2013-03-01 13:02:57,048::task::568::TaskManager.Task::(_updateState) Task=`7fbe1dff-829d-4d86-a497-c2726aedf78b`::moving from state init -> state preparing >Thread-691::INFO::2013-03-01 13:02:57,048::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-691::DEBUG::2013-03-01 13:02:57,049::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`031dd71a-85e0-468f-91d1-e36949f76c4e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-691::DEBUG::2013-03-01 13:02:57,049::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-691::DEBUG::2013-03-01 13:02:57,050::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-691::DEBUG::2013-03-01 13:02:57,050::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`031dd71a-85e0-468f-91d1-e36949f76c4e`::Granted request >Thread-691::DEBUG::2013-03-01 13:02:57,050::task::794::TaskManager.Task::(resourceAcquired) Task=`7fbe1dff-829d-4d86-a497-c2726aedf78b`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-691::DEBUG::2013-03-01 13:02:57,051::task::957::TaskManager.Task::(_decref) Task=`7fbe1dff-829d-4d86-a497-c2726aedf78b`::ref 1 aborting False >Thread-691::INFO::2013-03-01 13:02:57,052::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-691::DEBUG::2013-03-01 13:02:57,052::task::1151::TaskManager.Task::(prepare) Task=`7fbe1dff-829d-4d86-a497-c2726aedf78b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-691::DEBUG::2013-03-01 13:02:57,052::task::568::TaskManager.Task::(_updateState) Task=`7fbe1dff-829d-4d86-a497-c2726aedf78b`::moving from state preparing -> state finished >Thread-691::DEBUG::2013-03-01 13:02:57,052::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-691::DEBUG::2013-03-01 13:02:57,052::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-691::DEBUG::2013-03-01 13:02:57,053::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-691::DEBUG::2013-03-01 13:02:57,053::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-691::DEBUG::2013-03-01 13:02:57,053::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-691::DEBUG::2013-03-01 13:02:57,053::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-691::DEBUG::2013-03-01 13:02:57,053::task::957::TaskManager.Task::(_decref) Task=`7fbe1dff-829d-4d86-a497-c2726aedf78b`::ref 0 aborting False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,870::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,870::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,871::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,871::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,871::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:57,872::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911 with size = 20480 sectors >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,873::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911 10240K' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,884::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,885::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:57,886::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,133::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,145::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::WARNING::2013-03-01 13:02:58,145::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,146::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 9 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,147::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_72cd2840-a18b-4e77-98ec-487a6d283cf3 --addtag MD_9 a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:58,274::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:02:58,382::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457118 s, 22.4 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,405::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,405::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,406::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,407::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,670::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,670::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,670::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,672::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,684::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=202d8c60-c94a-4a5e-9c54-b496489f6911 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 9) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,689::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,698::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,699::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,955::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:58,956::blockVolume::280::Storage.Volume::(extend) Request to extend LV 202d8c60-c94a-4a5e-9c54-b496489f6911 of image 72cd2840-a18b-4e77-98ec-487a6d283cf3 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:58,957::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,161::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,164::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,175::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00033107 s, 1.5 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,175::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00033107 s, 1.5 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:02:59,176::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,177::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,187::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031045 s, 1.6 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,187::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031045 s, 1.6 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,188::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`3efd9646-59a6-42fd-8b12-ed4e8b5a63cc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,188::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' for lock type 'shared' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:02:59,189::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:00,403::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:01,791::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.479313 s, 2.1 MB/s\n'; <rc> = 0 >Thread-694::DEBUG::2013-03-01 13:03:03,888::task::568::TaskManager.Task::(_updateState) Task=`f924bc11-4020-418b-9812-52e2120218e0`::moving from state init -> state preparing >Thread-694::INFO::2013-03-01 13:03:03,894::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-694::INFO::2013-03-01 13:03:03,899::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106031894684', 'lastCheck': '7.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0134541988373', 'lastCheck': '7.4', 'code': 0, 'valid': True}} >Thread-694::DEBUG::2013-03-01 13:03:03,902::task::1151::TaskManager.Task::(prepare) Task=`f924bc11-4020-418b-9812-52e2120218e0`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106031894684', 'lastCheck': '7.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0134541988373', 'lastCheck': '7.4', 'code': 0, 'valid': True}} >Thread-694::DEBUG::2013-03-01 13:03:03,905::task::568::TaskManager.Task::(_updateState) Task=`f924bc11-4020-418b-9812-52e2120218e0`::moving from state preparing -> state finished >Thread-694::DEBUG::2013-03-01 13:03:03,908::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-694::DEBUG::2013-03-01 13:03:03,910::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-694::DEBUG::2013-03-01 13:03:03,913::task::957::TaskManager.Task::(_decref) Task=`f924bc11-4020-418b-9812-52e2120218e0`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:03,964::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:05,351::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.462683 s, 2.2 MB/s\n'; <rc> = 0 >Thread-696::DEBUG::2013-03-01 13:03:06,263::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-696::DEBUG::2013-03-01 13:03:06,264::task::568::TaskManager.Task::(_updateState) Task=`c673e8ce-0e45-4780-8b0c-3fa4442b6a5b`::moving from state init -> state preparing >Thread-696::INFO::2013-03-01 13:03:06,264::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-696::DEBUG::2013-03-01 13:03:06,265::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-696::DEBUG::2013-03-01 13:03:06,265::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e00f98e4-3ebe-48fa-97df-9d139da1f18a >Thread-696::DEBUG::2013-03-01 13:03:06,265::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'} >Thread-696::DEBUG::2013-03-01 13:03:06,265::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}} >Thread-696::INFO::2013-03-01 13:03:06,266::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}}} >Thread-696::DEBUG::2013-03-01 13:03:06,266::task::1151::TaskManager.Task::(prepare) Task=`c673e8ce-0e45-4780-8b0c-3fa4442b6a5b`::finished: {'allTasksStatus': {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}}} >Thread-696::DEBUG::2013-03-01 13:03:06,266::task::568::TaskManager.Task::(_updateState) Task=`c673e8ce-0e45-4780-8b0c-3fa4442b6a5b`::moving from state preparing -> state finished >Thread-696::DEBUG::2013-03-01 13:03:06,266::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-696::DEBUG::2013-03-01 13:03:06,267::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-696::DEBUG::2013-03-01 13:03:06,267::task::957::TaskManager.Task::(_decref) Task=`c673e8ce-0e45-4780-8b0c-3fa4442b6a5b`::ref 0 aborting False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,374::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,375::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,375::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,376::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free. Now locking as 'shared' (1 active user) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,376::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b`ReqID=`3efd9646-59a6-42fd-8b12-ed4e8b5a63cc`::Granted request >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,377::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,378::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:06,475::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:03:06,476::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:03:06,606::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:03:06,617::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026762 s, 15.3 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,635::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:03:06,646::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,646::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,656::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000333635 s, 1.5 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,657::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000333635 s, 1.5 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,657::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000356538 s, 1.4 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,668::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000356538 s, 1.4 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,668::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911`ReqID=`b51f1003-57ee-411b-ac94-fb0936b0f292`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,669::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911' for lock type 'exclusive' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:06,670::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:06,835::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:03:06,838::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:03:06,838::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:06,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000341161 s, 12.0 MB/s\n'; <rc> = 0 >Thread-697::DEBUG::2013-03-01 13:03:07,093::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-697::DEBUG::2013-03-01 13:03:07,094::task::568::TaskManager.Task::(_updateState) Task=`99d97279-516a-4f78-b0e0-92721e95e16d`::moving from state init -> state preparing >Thread-697::INFO::2013-03-01 13:03:07,095::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-697::INFO::2013-03-01 13:03:07,095::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-697::DEBUG::2013-03-01 13:03:07,096::task::1151::TaskManager.Task::(prepare) Task=`99d97279-516a-4f78-b0e0-92721e95e16d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-697::DEBUG::2013-03-01 13:03:07,096::task::568::TaskManager.Task::(_updateState) Task=`99d97279-516a-4f78-b0e0-92721e95e16d`::moving from state preparing -> state finished >Thread-697::DEBUG::2013-03-01 13:03:07,096::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-697::DEBUG::2013-03-01 13:03:07,096::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-697::DEBUG::2013-03-01 13:03:07,097::task::957::TaskManager.Task::(_decref) Task=`99d97279-516a-4f78-b0e0-92721e95e16d`::ref 0 aborting False >Thread-698::DEBUG::2013-03-01 13:03:07,121::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-698::DEBUG::2013-03-01 13:03:07,122::task::568::TaskManager.Task::(_updateState) Task=`96a4120f-4914-4c73-bf9e-f1b78879c23c`::moving from state init -> state preparing >Thread-698::INFO::2013-03-01 13:03:07,122::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-698::DEBUG::2013-03-01 13:03:07,122::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`abc331e0-c81e-4a2c-bc4d-039e1bbc4a51`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-698::DEBUG::2013-03-01 13:03:07,123::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-698::DEBUG::2013-03-01 13:03:07,123::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-698::DEBUG::2013-03-01 13:03:07,123::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`abc331e0-c81e-4a2c-bc4d-039e1bbc4a51`::Granted request >Thread-698::DEBUG::2013-03-01 13:03:07,124::task::794::TaskManager.Task::(resourceAcquired) Task=`96a4120f-4914-4c73-bf9e-f1b78879c23c`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-698::DEBUG::2013-03-01 13:03:07,124::task::957::TaskManager.Task::(_decref) Task=`96a4120f-4914-4c73-bf9e-f1b78879c23c`::ref 1 aborting False >Thread-698::INFO::2013-03-01 13:03:07,125::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-698::DEBUG::2013-03-01 13:03:07,125::task::1151::TaskManager.Task::(prepare) Task=`96a4120f-4914-4c73-bf9e-f1b78879c23c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-698::DEBUG::2013-03-01 13:03:07,125::task::568::TaskManager.Task::(_updateState) Task=`96a4120f-4914-4c73-bf9e-f1b78879c23c`::moving from state preparing -> state finished >Thread-698::DEBUG::2013-03-01 13:03:07,125::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-698::DEBUG::2013-03-01 13:03:07,126::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-698::DEBUG::2013-03-01 13:03:07,126::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-698::DEBUG::2013-03-01 13:03:07,126::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-698::DEBUG::2013-03-01 13:03:07,126::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-698::DEBUG::2013-03-01 13:03:07,127::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-698::DEBUG::2013-03-01 13:03:07,127::task::957::TaskManager.Task::(_decref) Task=`96a4120f-4914-4c73-bf9e-f1b78879c23c`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:07,416::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:07,502::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417384 s, 24.5 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,288::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,289::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,289::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,289::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911' is free. Now locking as 'exclusive' (1 active user) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,289::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911`ReqID=`b51f1003-57ee-411b-ac94-fb0936b0f292`::Granted request >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,290::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,291::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,484::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,497::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,498::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,509::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000296585 s, 1.7 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,510::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000296585 s, 1.7 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,512::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000317402 s, 1.6 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,523::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000317402 s, 1.6 MB/s'], size: 512 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,523::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911 (qcow2) START >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,524::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:08,534::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >Dummy-173::DEBUG::2013-03-01 13:03:09,515::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:09,590::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279646 s, 36.6 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,140::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,140::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911 DONE >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:03:10,141::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:174418c8-73dd-4b93-9059-6ba35d2db54b -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:202d8c60-c94a-4a5e-9c54-b496489f6911 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:03:10,141::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b justme False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,141::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,141::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,142::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,142::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,402::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,403::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,403::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,404::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.174418c8-73dd-4b93-9059-6ba35d2db54b', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,404::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,405::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,644::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,656::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::INFO::2013-03-01 13:03:10,656::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911 justme False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,656::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,657::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,657::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,658::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,861::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,862::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,862::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,862::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.202d8c60-c94a-4a5e-9c54-b496489f6911', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,863::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:10,864::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:11,608::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:12,867::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,236::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,273::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,304::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,321::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,341::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.72cd2840-a18b-4e77-98ec-487a6d283cf3', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,402::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,409::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,411::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,415::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,418::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,419::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,421::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.174418c8-73dd-4b93-9059-6ba35d2db54b', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,424::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,425::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,426::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,427::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.8936b001-cffa-4086-ad60-c1815334d95c', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,428::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.bc7e8a03-5152-493a-a0b5-55c04543214f', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,429::task::568::TaskManager.Task::(_updateState) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::moving from state running -> state finished >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,432::task::719::TaskManager.Task::(_save) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/e00f98e4-3ebe-48fa-97df-9d139da1f18a.temp >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,453::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Dummy-173::DEBUG::2013-03-01 13:03:13,454::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.443062 s, 2.3 MB/s\n'; <rc> = 0 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,454::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,455::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,456::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,457::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,457::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,458::task::880::TaskManager.Task::(_runJobs) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::Task.run: exit - success: result {'uuid': '202d8c60-c94a-4a5e-9c54-b496489f6911'} >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,459::task::957::TaskManager.Task::(_decref) Task=`e00f98e4-3ebe-48fa-97df-9d139da1f18a`::ref 0 aborting False >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:13,460::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:03:15,473::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:15,556::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381204 s, 26.9 MB/s\n'; <rc> = 0 >Thread-702::DEBUG::2013-03-01 13:03:16,296::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-702::DEBUG::2013-03-01 13:03:16,297::task::568::TaskManager.Task::(_updateState) Task=`1447050c-acec-4e55-a969-56be574e9ca0`::moving from state init -> state preparing >Thread-702::INFO::2013-03-01 13:03:16,297::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-702::DEBUG::2013-03-01 13:03:16,298::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-702::DEBUG::2013-03-01 13:03:16,298::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e00f98e4-3ebe-48fa-97df-9d139da1f18a >Thread-702::DEBUG::2013-03-01 13:03:16,298::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'} >Thread-702::DEBUG::2013-03-01 13:03:16,299::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}} >Thread-702::INFO::2013-03-01 13:03:16,299::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}}} >Thread-702::DEBUG::2013-03-01 13:03:16,299::task::1151::TaskManager.Task::(prepare) Task=`1447050c-acec-4e55-a969-56be574e9ca0`::finished: {'allTasksStatus': {'e00f98e4-3ebe-48fa-97df-9d139da1f18a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e00f98e4-3ebe-48fa-97df-9d139da1f18a'}}} >Thread-702::DEBUG::2013-03-01 13:03:16,299::task::568::TaskManager.Task::(_updateState) Task=`1447050c-acec-4e55-a969-56be574e9ca0`::moving from state preparing -> state finished >Thread-702::DEBUG::2013-03-01 13:03:16,300::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-702::DEBUG::2013-03-01 13:03:16,300::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-702::DEBUG::2013-03-01 13:03:16,300::task::957::TaskManager.Task::(_decref) Task=`1447050c-acec-4e55-a969-56be574e9ca0`::ref 0 aborting False >Thread-703::DEBUG::2013-03-01 13:03:16,386::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-703::DEBUG::2013-03-01 13:03:16,387::task::568::TaskManager.Task::(_updateState) Task=`0a6fd340-9f0a-44fe-b88e-4ce406b1f35a`::moving from state init -> state preparing >Thread-703::INFO::2013-03-01 13:03:16,387::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='72cd2840-a18b-4e77-98ec-487a6d283cf3', volUUID='202d8c60-c94a-4a5e-9c54-b496489f6911', options=None) >Thread-703::DEBUG::2013-03-01 13:03:16,388::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`82e70b8a-d036-4ad0-a400-fc72551f7e5c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-703::DEBUG::2013-03-01 13:03:16,388::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-703::DEBUG::2013-03-01 13:03:16,389::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-703::DEBUG::2013-03-01 13:03:16,389::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`82e70b8a-d036-4ad0-a400-fc72551f7e5c`::Granted request >Thread-703::DEBUG::2013-03-01 13:03:16,389::task::794::TaskManager.Task::(resourceAcquired) Task=`0a6fd340-9f0a-44fe-b88e-4ce406b1f35a`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-703::DEBUG::2013-03-01 13:03:16,390::task::957::TaskManager.Task::(_decref) Task=`0a6fd340-9f0a-44fe-b88e-4ce406b1f35a`::ref 1 aborting False >Thread-703::INFO::2013-03-01 13:03:16,390::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=72cd2840-a18b-4e77-98ec-487a6d283cf3 volUUID = 202d8c60-c94a-4a5e-9c54-b496489f6911 >Thread-703::DEBUG::2013-03-01 13:03:16,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-703::DEBUG::2013-03-01 13:03:16,401::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000362791 s, 1.4 MB/s\n'; <rc> = 0 >Thread-703::DEBUG::2013-03-01 13:03:16,402::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000362791 s, 1.4 MB/s'], size: 512 >Thread-703::DEBUG::2013-03-01 13:03:16,403::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-703::DEBUG::2013-03-01 13:03:16,413::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000322288 s, 1.6 MB/s\n'; <rc> = 0 >Thread-703::DEBUG::2013-03-01 13:03:16,413::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000322288 s, 1.6 MB/s'], size: 512 >Thread-703::DEBUG::2013-03-01 13:03:16,414::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-703::DEBUG::2013-03-01 13:03:16,415::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-703::DEBUG::2013-03-01 13:03:16,609::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:03:16,622::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-703::DEBUG::2013-03-01 13:03:16,638::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:03:16,642::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000293275 s, 14.0 MB/s\n'; <rc> = 0 >Thread-703::INFO::2013-03-01 13:03:16,643::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '72cd2840-a18b-4e77-98ec-487a6d283cf3', 'ctime': '1362135778', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135788', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '202d8c60-c94a-4a5e-9c54-b496489f6911', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-703::INFO::2013-03-01 13:03:16,644::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '72cd2840-a18b-4e77-98ec-487a6d283cf3', 'ctime': '1362135778', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135788', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '202d8c60-c94a-4a5e-9c54-b496489f6911', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-703::DEBUG::2013-03-01 13:03:16,645::task::1151::TaskManager.Task::(prepare) Task=`0a6fd340-9f0a-44fe-b88e-4ce406b1f35a`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '72cd2840-a18b-4e77-98ec-487a6d283cf3', 'ctime': '1362135778', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135788', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '202d8c60-c94a-4a5e-9c54-b496489f6911', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-703::DEBUG::2013-03-01 13:03:16,646::task::568::TaskManager.Task::(_updateState) Task=`0a6fd340-9f0a-44fe-b88e-4ce406b1f35a`::moving from state preparing -> state finished >Thread-703::DEBUG::2013-03-01 13:03:16,646::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-703::DEBUG::2013-03-01 13:03:16,646::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-703::DEBUG::2013-03-01 13:03:16,647::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-703::DEBUG::2013-03-01 13:03:16,647::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-703::DEBUG::2013-03-01 13:03:16,648::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-703::DEBUG::2013-03-01 13:03:16,648::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-703::DEBUG::2013-03-01 13:03:16,648::task::957::TaskManager.Task::(_decref) Task=`0a6fd340-9f0a-44fe-b88e-4ce406b1f35a`::ref 0 aborting False >Thread-705::DEBUG::2013-03-01 13:03:16,709::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-705::DEBUG::2013-03-01 13:03:16,710::task::568::TaskManager.Task::(_updateState) Task=`5d943fd2-bfe8-4c7f-8c23-080fec59aef6`::moving from state init -> state preparing >Thread-705::INFO::2013-03-01 13:03:16,710::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='e00f98e4-3ebe-48fa-97df-9d139da1f18a', spUUID=None, options=None) >Thread-705::DEBUG::2013-03-01 13:03:16,711::taskManager::161::TaskManager::(clearTask) Entry. taskID: e00f98e4-3ebe-48fa-97df-9d139da1f18a >Thread-705::DEBUG::2013-03-01 13:03:16,712::taskManager::166::TaskManager::(clearTask) Return. >Thread-705::INFO::2013-03-01 13:03:16,712::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-705::DEBUG::2013-03-01 13:03:16,713::task::1151::TaskManager.Task::(prepare) Task=`5d943fd2-bfe8-4c7f-8c23-080fec59aef6`::finished: None >Thread-705::DEBUG::2013-03-01 13:03:16,713::task::568::TaskManager.Task::(_updateState) Task=`5d943fd2-bfe8-4c7f-8c23-080fec59aef6`::moving from state preparing -> state finished >Thread-705::DEBUG::2013-03-01 13:03:16,713::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-705::DEBUG::2013-03-01 13:03:16,713::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-705::DEBUG::2013-03-01 13:03:16,714::task::957::TaskManager.Task::(_decref) Task=`5d943fd2-bfe8-4c7f-8c23-080fec59aef6`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:03:16,857::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:16,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000363166 s, 11.3 MB/s\n'; <rc> = 0 >Thread-706::DEBUG::2013-03-01 13:03:17,167::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-706::DEBUG::2013-03-01 13:03:17,168::task::568::TaskManager.Task::(_updateState) Task=`675096f9-fa09-4dc7-bafe-24d6fa0ccba3`::moving from state init -> state preparing >Thread-706::INFO::2013-03-01 13:03:17,168::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-706::INFO::2013-03-01 13:03:17,169::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-706::DEBUG::2013-03-01 13:03:17,169::task::1151::TaskManager.Task::(prepare) Task=`675096f9-fa09-4dc7-bafe-24d6fa0ccba3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-706::DEBUG::2013-03-01 13:03:17,169::task::568::TaskManager.Task::(_updateState) Task=`675096f9-fa09-4dc7-bafe-24d6fa0ccba3`::moving from state preparing -> state finished >Thread-706::DEBUG::2013-03-01 13:03:17,170::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-706::DEBUG::2013-03-01 13:03:17,170::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-706::DEBUG::2013-03-01 13:03:17,170::task::957::TaskManager.Task::(_decref) Task=`675096f9-fa09-4dc7-bafe-24d6fa0ccba3`::ref 0 aborting False >Thread-707::DEBUG::2013-03-01 13:03:17,195::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-707::DEBUG::2013-03-01 13:03:17,196::task::568::TaskManager.Task::(_updateState) Task=`fa6c551d-34f6-4f9e-b677-e74346f2bfdf`::moving from state init -> state preparing >Thread-707::INFO::2013-03-01 13:03:17,196::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-707::DEBUG::2013-03-01 13:03:17,197::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b5887f2a-5331-4ac0-9853-833c9f372154`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-707::DEBUG::2013-03-01 13:03:17,197::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-707::DEBUG::2013-03-01 13:03:17,197::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-707::DEBUG::2013-03-01 13:03:17,198::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b5887f2a-5331-4ac0-9853-833c9f372154`::Granted request >Thread-707::DEBUG::2013-03-01 13:03:17,198::task::794::TaskManager.Task::(resourceAcquired) Task=`fa6c551d-34f6-4f9e-b677-e74346f2bfdf`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-707::DEBUG::2013-03-01 13:03:17,198::task::957::TaskManager.Task::(_decref) Task=`fa6c551d-34f6-4f9e-b677-e74346f2bfdf`::ref 1 aborting False >Thread-707::INFO::2013-03-01 13:03:17,200::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-707::DEBUG::2013-03-01 13:03:17,200::task::1151::TaskManager.Task::(prepare) Task=`fa6c551d-34f6-4f9e-b677-e74346f2bfdf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-707::DEBUG::2013-03-01 13:03:17,201::task::568::TaskManager.Task::(_updateState) Task=`fa6c551d-34f6-4f9e-b677-e74346f2bfdf`::moving from state preparing -> state finished >Thread-707::DEBUG::2013-03-01 13:03:17,201::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-707::DEBUG::2013-03-01 13:03:17,201::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-707::DEBUG::2013-03-01 13:03:17,202::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-707::DEBUG::2013-03-01 13:03:17,202::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-707::DEBUG::2013-03-01 13:03:17,202::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-707::DEBUG::2013-03-01 13:03:17,202::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-707::DEBUG::2013-03-01 13:03:17,203::task::957::TaskManager.Task::(_decref) Task=`fa6c551d-34f6-4f9e-b677-e74346f2bfdf`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:17,570::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:17,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450862 s, 22.7 MB/s\n'; <rc> = 0 >Thread-708::DEBUG::2013-03-01 13:03:19,484::task::568::TaskManager.Task::(_updateState) Task=`08bc3681-93dd-45f2-9295-a48cc5ef6a53`::moving from state init -> state preparing >Thread-708::INFO::2013-03-01 13:03:19,485::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-708::INFO::2013-03-01 13:03:19,485::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0241708755493', 'lastCheck': '2.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0132570266724', 'lastCheck': '2.6', 'code': 0, 'valid': True}} >Thread-708::DEBUG::2013-03-01 13:03:19,485::task::1151::TaskManager.Task::(prepare) Task=`08bc3681-93dd-45f2-9295-a48cc5ef6a53`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0241708755493', 'lastCheck': '2.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0132570266724', 'lastCheck': '2.6', 'code': 0, 'valid': True}} >Thread-708::DEBUG::2013-03-01 13:03:19,486::task::568::TaskManager.Task::(_updateState) Task=`08bc3681-93dd-45f2-9295-a48cc5ef6a53`::moving from state preparing -> state finished >Thread-708::DEBUG::2013-03-01 13:03:19,486::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-708::DEBUG::2013-03-01 13:03:19,486::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-708::DEBUG::2013-03-01 13:03:19,487::task::957::TaskManager.Task::(_decref) Task=`08bc3681-93dd-45f2-9295-a48cc5ef6a53`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:19,685::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:19,781::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375878 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:21,801::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:21,905::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384306 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:23,925::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:24,023::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466364 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:26,034::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:26,137::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376777 s, 27.2 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:03:26,646::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:03:26,656::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000339679 s, 12.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:03:26,875::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:26,888::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000360928 s, 11.3 MB/s\n'; <rc> = 0 >Thread-712::DEBUG::2013-03-01 13:03:27,285::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-712::DEBUG::2013-03-01 13:03:27,286::task::568::TaskManager.Task::(_updateState) Task=`a719f168-2d20-41c2-82e3-58338de84afd`::moving from state init -> state preparing >Thread-712::INFO::2013-03-01 13:03:27,286::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-712::INFO::2013-03-01 13:03:27,286::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-712::DEBUG::2013-03-01 13:03:27,287::task::1151::TaskManager.Task::(prepare) Task=`a719f168-2d20-41c2-82e3-58338de84afd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-712::DEBUG::2013-03-01 13:03:27,287::task::568::TaskManager.Task::(_updateState) Task=`a719f168-2d20-41c2-82e3-58338de84afd`::moving from state preparing -> state finished >Thread-712::DEBUG::2013-03-01 13:03:27,287::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-712::DEBUG::2013-03-01 13:03:27,287::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-712::DEBUG::2013-03-01 13:03:27,288::task::957::TaskManager.Task::(_decref) Task=`a719f168-2d20-41c2-82e3-58338de84afd`::ref 0 aborting False >Thread-713::DEBUG::2013-03-01 13:03:27,312::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-713::DEBUG::2013-03-01 13:03:27,313::task::568::TaskManager.Task::(_updateState) Task=`b1191a0d-b1d5-476a-9c23-59627e3b936f`::moving from state init -> state preparing >Thread-713::INFO::2013-03-01 13:03:27,313::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-713::DEBUG::2013-03-01 13:03:27,314::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3d8eb648-e578-4cdc-b7bb-74c968385b2b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-713::DEBUG::2013-03-01 13:03:27,314::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-713::DEBUG::2013-03-01 13:03:27,314::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-713::DEBUG::2013-03-01 13:03:27,314::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`3d8eb648-e578-4cdc-b7bb-74c968385b2b`::Granted request >Thread-713::DEBUG::2013-03-01 13:03:27,315::task::794::TaskManager.Task::(resourceAcquired) Task=`b1191a0d-b1d5-476a-9c23-59627e3b936f`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-713::DEBUG::2013-03-01 13:03:27,315::task::957::TaskManager.Task::(_decref) Task=`b1191a0d-b1d5-476a-9c23-59627e3b936f`::ref 1 aborting False >Thread-713::INFO::2013-03-01 13:03:27,317::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-713::DEBUG::2013-03-01 13:03:27,317::task::1151::TaskManager.Task::(prepare) Task=`b1191a0d-b1d5-476a-9c23-59627e3b936f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-713::DEBUG::2013-03-01 13:03:27,317::task::568::TaskManager.Task::(_updateState) Task=`b1191a0d-b1d5-476a-9c23-59627e3b936f`::moving from state preparing -> state finished >Thread-713::DEBUG::2013-03-01 13:03:27,317::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-713::DEBUG::2013-03-01 13:03:27,318::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-713::DEBUG::2013-03-01 13:03:27,318::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-713::DEBUG::2013-03-01 13:03:27,318::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-713::DEBUG::2013-03-01 13:03:27,319::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-713::DEBUG::2013-03-01 13:03:27,319::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-713::DEBUG::2013-03-01 13:03:27,319::task::957::TaskManager.Task::(_decref) Task=`b1191a0d-b1d5-476a-9c23-59627e3b936f`::ref 0 aborting False >Thread-714::DEBUG::2013-03-01 13:03:27,959::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-714::DEBUG::2013-03-01 13:03:27,960::task::568::TaskManager.Task::(_updateState) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::moving from state init -> state preparing >Thread-714::INFO::2013-03-01 13:03:27,960::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='bc7e8a03-5152-493a-a0b5-55c04543214f', postZero='false', force='false') >Thread-714::INFO::2013-03-01 13:03:27,960::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-714::DEBUG::2013-03-01 13:03:27,961::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:28,157::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:28,262::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385657 s, 26.6 MB/s\n'; <rc> = 0 >Thread-714::DEBUG::2013-03-01 13:03:28,296::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-714::DEBUG::2013-03-01 13:03:28,297::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,297::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,297::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,298::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,298::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,299::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-714::DEBUG::2013-03-01 13:03:28,538::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-714::DEBUG::2013-03-01 13:03:28,540::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,540::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-714::DEBUG::2013-03-01 13:03:28,541::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`1cd0cc8c-138a-4114-890f-0961b06ff0df`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-714::DEBUG::2013-03-01 13:03:28,542::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f' for lock type 'exclusive' >Thread-714::DEBUG::2013-03-01 13:03:28,542::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f' is free. Now locking as 'exclusive' (1 active user) >Thread-714::DEBUG::2013-03-01 13:03:28,542::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.bc7e8a03-5152-493a-a0b5-55c04543214f`ReqID=`1cd0cc8c-138a-4114-890f-0961b06ff0df`::Granted request >Thread-714::DEBUG::2013-03-01 13:03:28,543::task::794::TaskManager.Task::(resourceAcquired) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_resourcesAcquired: Storage.bc7e8a03-5152-493a-a0b5-55c04543214f (exclusive) >Thread-714::DEBUG::2013-03-01 13:03:28,543::task::957::TaskManager.Task::(_decref) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::ref 1 aborting False >Thread-714::DEBUG::2013-03-01 13:03:28,543::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`0c5f80c1-3ba1-46cb-9e65-aff53bf4ae6f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-714::DEBUG::2013-03-01 13:03:28,543::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-714::DEBUG::2013-03-01 13:03:28,544::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-714::DEBUG::2013-03-01 13:03:28,544::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`0c5f80c1-3ba1-46cb-9e65-aff53bf4ae6f`::Granted request >Thread-714::DEBUG::2013-03-01 13:03:28,545::task::794::TaskManager.Task::(resourceAcquired) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-714::DEBUG::2013-03-01 13:03:28,545::task::957::TaskManager.Task::(_decref) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::ref 1 aborting False >Thread-714::DEBUG::2013-03-01 13:03:28,545::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,546::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-714::DEBUG::2013-03-01 13:03:28,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-714::DEBUG::2013-03-01 13:03:28,759::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/8936b001-cffa-4086-ad60-c1815334d95c a558fc2a-a4a3-4118-9b81-d1d601eaa295/174418c8-73dd-4b93-9059-6ba35d2db54b' (cwd None) >Thread-714::DEBUG::2013-03-01 13:03:28,973::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-714::DEBUG::2013-03-01 13:03:28,974::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,974::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,974::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,975::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-714::DEBUG::2013-03-01 13:03:28,975::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f/174418c8-73dd-4b93-9059-6ba35d2db54b'] >Thread-714::DEBUG::2013-03-01 13:03:28,975::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/bc7e8a03-5152-493a-a0b5-55c04543214f >Thread-714::DEBUG::2013-03-01 13:03:28,977::task::719::TaskManager.Task::(_save) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade.temp >Thread-714::DEBUG::2013-03-01 13:03:28,984::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_bc7e8a03-5152-493a-a0b5-55c04543214f for task cd1e07ab-eb31-4958-8748-09d42d1daade >Thread-714::INFO::2013-03-01 13:03:28,984::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-714::DEBUG::2013-03-01 13:03:28,985::task::1146::TaskManager.Task::(prepare) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::Prepare: 1 jobs exist, move to acquiring >Thread-714::DEBUG::2013-03-01 13:03:28,985::task::568::TaskManager.Task::(_updateState) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::moving from state preparing -> state acquiring >Thread-714::DEBUG::2013-03-01 13:03:28,986::task::719::TaskManager.Task::(_save) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade.temp >Thread-714::DEBUG::2013-03-01 13:03:28,993::task::568::TaskManager.Task::(_updateState) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::moving from state acquiring -> state queued >Thread-714::DEBUG::2013-03-01 13:03:28,994::task::719::TaskManager.Task::(_save) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade.temp >Thread-714::DEBUG::2013-03-01 13:03:29,001::taskManager::50::TaskManager::(_queueTask) queuing task: cd1e07ab-eb31-4958-8748-09d42d1daade >1622fdc2-35e4-4dd5-bb80-9fb5b1d3e937::DEBUG::2013-03-01 13:03:29,002::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-714::DEBUG::2013-03-01 13:03:29,001::taskManager::56::TaskManager::(_queueTask) task queued: cd1e07ab-eb31-4958-8748-09d42d1daade >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,003::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: cd1e07ab-eb31-4958-8748-09d42d1daade running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c012f518>> with: None >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,005::task::1159::TaskManager.Task::(commit) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::committing task: cd1e07ab-eb31-4958-8748-09d42d1daade >Thread-714::DEBUG::2013-03-01 13:03:29,004::task::1148::TaskManager.Task::(prepare) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::returning >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,007::task::568::TaskManager.Task::(_updateState) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::moving from state queued -> state running >Thread-714::DEBUG::2013-03-01 13:03:29,008::task::957::TaskManager.Task::(_decref) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::ref 1 aborting False >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,012::task::719::TaskManager.Task::(_save) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade.temp >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,026::task::872::TaskManager.Task::(_runJobs) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::Task.run: running job 0: deleteImage_bc7e8a03-5152-493a-a0b5-55c04543214f: <function <lambda> at 0x7f1588319de8> (args: () kwargs: {}) >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,026::task::304::TaskManager.Task::(run) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::Job.run: running deleteImage_bc7e8a03-5152-493a-a0b5-55c04543214f: <function <lambda> at 0x7f1588319de8> (args: () kwargs: {}) callback None >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,026::task::568::TaskManager.Task::(_updateState) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::moving from state running -> state finished >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,027::task::719::TaskManager.Task::(_save) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cd1e07ab-eb31-4958-8748-09d42d1daade.temp >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,037::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f': < ResourceRef 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f', isValid: 'True' obj: 'None'>, 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,038::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,038::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f' >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,038::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f' (0 active users) >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,039::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f' is free, finding out if anyone is waiting for it. >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,039::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.bc7e8a03-5152-493a-a0b5-55c04543214f', Clearing records. >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,039::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,040::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,042::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-716::DEBUG::2013-03-01 13:03:29,044::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,044::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-716::DEBUG::2013-03-01 13:03:29,046::task::568::TaskManager.Task::(_updateState) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::moving from state init -> state preparing >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,046::task::880::TaskManager.Task::(_runJobs) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::Task.run: exit - success: result True >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,048::task::957::TaskManager.Task::(_decref) Task=`cd1e07ab-eb31-4958-8748-09d42d1daade`::ref 0 aborting False >Thread-716::INFO::2013-03-01 13:03:29,048::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='72cd2840-a18b-4e77-98ec-487a6d283cf3', postZero='false', force='false') >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:03:29,049::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-716::INFO::2013-03-01 13:03:29,049::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-716::DEBUG::2013-03-01 13:03:29,051::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-716::DEBUG::2013-03-01 13:03:29,291::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-716::DEBUG::2013-03-01 13:03:29,292::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,292::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,293::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,293::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,293::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,294::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-716::DEBUG::2013-03-01 13:03:29,644::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-716::DEBUG::2013-03-01 13:03:29,645::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,646::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-716::DEBUG::2013-03-01 13:03:29,647::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3`ReqID=`e44becf7-9a09-41db-8d6f-87997f604f45`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-716::DEBUG::2013-03-01 13:03:29,648::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3' for lock type 'exclusive' >Thread-716::DEBUG::2013-03-01 13:03:29,648::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3' is free. Now locking as 'exclusive' (1 active user) >Thread-716::DEBUG::2013-03-01 13:03:29,648::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3`ReqID=`e44becf7-9a09-41db-8d6f-87997f604f45`::Granted request >Thread-716::DEBUG::2013-03-01 13:03:29,649::task::794::TaskManager.Task::(resourceAcquired) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_resourcesAcquired: Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3 (exclusive) >Thread-716::DEBUG::2013-03-01 13:03:29,649::task::957::TaskManager.Task::(_decref) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::ref 1 aborting False >Thread-716::DEBUG::2013-03-01 13:03:29,650::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`2b020fb5-1969-4d59-bb75-f9c4137b2ddc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-716::DEBUG::2013-03-01 13:03:29,650::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-716::DEBUG::2013-03-01 13:03:29,651::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-716::DEBUG::2013-03-01 13:03:29,651::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`2b020fb5-1969-4d59-bb75-f9c4137b2ddc`::Granted request >Thread-716::DEBUG::2013-03-01 13:03:29,651::task::794::TaskManager.Task::(resourceAcquired) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-716::DEBUG::2013-03-01 13:03:29,652::task::957::TaskManager.Task::(_decref) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::ref 1 aborting False >Thread-716::DEBUG::2013-03-01 13:03:29,652::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,653::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-716::DEBUG::2013-03-01 13:03:29,841::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-716::DEBUG::2013-03-01 13:03:29,852::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:29,854::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/202d8c60-c94a-4a5e-9c54-b496489f6911' (cwd None) >Thread-716::DEBUG::2013-03-01 13:03:30,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-716::DEBUG::2013-03-01 13:03:30,052::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:30,053::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-716::DEBUG::2013-03-01 13:03:30,053::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3/202d8c60-c94a-4a5e-9c54-b496489f6911'] >Thread-716::DEBUG::2013-03-01 13:03:30,053::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/72cd2840-a18b-4e77-98ec-487a6d283cf3 >Thread-716::DEBUG::2013-03-01 13:03:30,054::task::719::TaskManager.Task::(_save) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86.temp >Thread-716::DEBUG::2013-03-01 13:03:30,059::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_72cd2840-a18b-4e77-98ec-487a6d283cf3 for task cf2b464d-085d-49bc-a9f5-533578a13e86 >Thread-716::INFO::2013-03-01 13:03:30,060::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-716::DEBUG::2013-03-01 13:03:30,060::task::1146::TaskManager.Task::(prepare) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::Prepare: 1 jobs exist, move to acquiring >Thread-716::DEBUG::2013-03-01 13:03:30,060::task::568::TaskManager.Task::(_updateState) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::moving from state preparing -> state acquiring >Thread-716::DEBUG::2013-03-01 13:03:30,061::task::719::TaskManager.Task::(_save) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86.temp >Thread-716::DEBUG::2013-03-01 13:03:30,066::task::568::TaskManager.Task::(_updateState) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::moving from state acquiring -> state queued >Thread-716::DEBUG::2013-03-01 13:03:30,067::task::719::TaskManager.Task::(_save) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86.temp >Thread-716::DEBUG::2013-03-01 13:03:30,074::taskManager::50::TaskManager::(_queueTask) queuing task: cf2b464d-085d-49bc-a9f5-533578a13e86 >da528929-1528-4625-8e48-420fc39627a8::DEBUG::2013-03-01 13:03:30,075::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-716::DEBUG::2013-03-01 13:03:30,075::taskManager::56::TaskManager::(_queueTask) task queued: cf2b464d-085d-49bc-a9f5-533578a13e86 >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,077::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: cf2b464d-085d-49bc-a9f5-533578a13e86 running: <bound method Task.commit of <storage.task.Task instance at 0x178f0e0>> with: None >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,078::task::1159::TaskManager.Task::(commit) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::committing task: cf2b464d-085d-49bc-a9f5-533578a13e86 >Thread-716::DEBUG::2013-03-01 13:03:30,078::task::1148::TaskManager.Task::(prepare) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::returning >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,080::task::568::TaskManager.Task::(_updateState) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::moving from state queued -> state running >Thread-716::DEBUG::2013-03-01 13:03:30,082::task::957::TaskManager.Task::(_decref) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::ref 1 aborting False >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,084::task::719::TaskManager.Task::(_save) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86.temp >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,095::task::872::TaskManager.Task::(_runJobs) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::Task.run: running job 0: deleteImage_72cd2840-a18b-4e77-98ec-487a6d283cf3: <function <lambda> at 0x7f15c02715f0> (args: () kwargs: {}) >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,096::task::304::TaskManager.Task::(run) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::Job.run: running deleteImage_72cd2840-a18b-4e77-98ec-487a6d283cf3: <function <lambda> at 0x7f15c02715f0> (args: () kwargs: {}) callback None >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,096::task::568::TaskManager.Task::(_updateState) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::moving from state running -> state finished >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,097::task::719::TaskManager.Task::(_save) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/cf2b464d-085d-49bc-a9f5-533578a13e86.temp >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,104::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3': < ResourceRef 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3', isValid: 'True' obj: 'None'>} >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,105::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,105::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,106::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,106::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,106::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,107::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3' >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,107::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3' (0 active users) >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,107::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3' is free, finding out if anyone is waiting for it. >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,107::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.72cd2840-a18b-4e77-98ec-487a6d283cf3', Clearing records. >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,108::task::880::TaskManager.Task::(_runJobs) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::Task.run: exit - success: result True >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,108::task::957::TaskManager.Task::(_decref) Task=`cf2b464d-085d-49bc-a9f5-533578a13e86`::ref 0 aborting False >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:03:30,108::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:03:30,280::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:30,367::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422776 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:32,381::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:32,489::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447678 s, 22.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:34,509::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:34,611::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398817 s, 25.7 MB/s\n'; <rc> = 0 >Thread-718::DEBUG::2013-03-01 13:03:34,703::task::568::TaskManager.Task::(_updateState) Task=`15341f36-c65a-4c16-a438-ef23c7c40f2c`::moving from state init -> state preparing >Thread-718::INFO::2013-03-01 13:03:34,703::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-718::INFO::2013-03-01 13:03:34,749::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104479789734', 'lastCheck': '8.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0128679275513', 'lastCheck': '7.9', 'code': 0, 'valid': True}} >Thread-718::DEBUG::2013-03-01 13:03:34,749::task::1151::TaskManager.Task::(prepare) Task=`15341f36-c65a-4c16-a438-ef23c7c40f2c`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0104479789734', 'lastCheck': '8.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0128679275513', 'lastCheck': '7.9', 'code': 0, 'valid': True}} >Thread-718::DEBUG::2013-03-01 13:03:34,750::task::568::TaskManager.Task::(_updateState) Task=`15341f36-c65a-4c16-a438-ef23c7c40f2c`::moving from state preparing -> state finished >Thread-718::DEBUG::2013-03-01 13:03:34,750::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-718::DEBUG::2013-03-01 13:03:34,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-718::DEBUG::2013-03-01 13:03:34,751::task::957::TaskManager.Task::(_decref) Task=`15341f36-c65a-4c16-a438-ef23c7c40f2c`::ref 0 aborting False >Thread-720::DEBUG::2013-03-01 13:03:36,402::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-720::DEBUG::2013-03-01 13:03:36,408::task::568::TaskManager.Task::(_updateState) Task=`8c2c40a5-5e7a-4d11-80a5-9a137cd6189d`::moving from state init -> state preparing >Thread-720::INFO::2013-03-01 13:03:36,411::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-720::DEBUG::2013-03-01 13:03:36,414::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-720::DEBUG::2013-03-01 13:03:36,417::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: cf2b464d-085d-49bc-a9f5-533578a13e86 >Thread-720::DEBUG::2013-03-01 13:03:36,420::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cf2b464d-085d-49bc-a9f5-533578a13e86'} >Thread-720::DEBUG::2013-03-01 13:03:36,423::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: cd1e07ab-eb31-4958-8748-09d42d1daade >Thread-720::DEBUG::2013-03-01 13:03:36,425::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cd1e07ab-eb31-4958-8748-09d42d1daade'} >Thread-720::DEBUG::2013-03-01 13:03:36,428::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'cf2b464d-085d-49bc-a9f5-533578a13e86': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cf2b464d-085d-49bc-a9f5-533578a13e86'}, 'cd1e07ab-eb31-4958-8748-09d42d1daade': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cd1e07ab-eb31-4958-8748-09d42d1daade'}} >Thread-720::INFO::2013-03-01 13:03:36,431::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'cf2b464d-085d-49bc-a9f5-533578a13e86': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cf2b464d-085d-49bc-a9f5-533578a13e86'}, 'cd1e07ab-eb31-4958-8748-09d42d1daade': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cd1e07ab-eb31-4958-8748-09d42d1daade'}}} >Thread-720::DEBUG::2013-03-01 13:03:36,434::task::1151::TaskManager.Task::(prepare) Task=`8c2c40a5-5e7a-4d11-80a5-9a137cd6189d`::finished: {'allTasksStatus': {'cf2b464d-085d-49bc-a9f5-533578a13e86': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cf2b464d-085d-49bc-a9f5-533578a13e86'}, 'cd1e07ab-eb31-4958-8748-09d42d1daade': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'cd1e07ab-eb31-4958-8748-09d42d1daade'}}} >Thread-720::DEBUG::2013-03-01 13:03:36,437::task::568::TaskManager.Task::(_updateState) Task=`8c2c40a5-5e7a-4d11-80a5-9a137cd6189d`::moving from state preparing -> state finished >Thread-720::DEBUG::2013-03-01 13:03:36,440::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720::DEBUG::2013-03-01 13:03:36,442::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720::DEBUG::2013-03-01 13:03:36,445::task::957::TaskManager.Task::(_decref) Task=`8c2c40a5-5e7a-4d11-80a5-9a137cd6189d`::ref 0 aborting False >Thread-721::DEBUG::2013-03-01 13:03:36,603::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-721::DEBUG::2013-03-01 13:03:36,608::task::568::TaskManager.Task::(_updateState) Task=`79245cfc-289f-4d8b-a65a-fd2af3fdc927`::moving from state init -> state preparing >Thread-721::INFO::2013-03-01 13:03:36,612::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='cd1e07ab-eb31-4958-8748-09d42d1daade', spUUID=None, options=None) >Thread-721::DEBUG::2013-03-01 13:03:36,614::taskManager::161::TaskManager::(clearTask) Entry. taskID: cd1e07ab-eb31-4958-8748-09d42d1daade >Thread-721::DEBUG::2013-03-01 13:03:36,631::taskManager::166::TaskManager::(clearTask) Return. >Dummy-173::DEBUG::2013-03-01 13:03:36,636::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-721::INFO::2013-03-01 13:03:36,638::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-255::DEBUG::2013-03-01 13:03:36,839::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-721::DEBUG::2013-03-01 13:03:36,850::task::1151::TaskManager.Task::(prepare) Task=`79245cfc-289f-4d8b-a65a-fd2af3fdc927`::finished: None >Thread-721::DEBUG::2013-03-01 13:03:37,061::task::568::TaskManager.Task::(_updateState) Task=`79245cfc-289f-4d8b-a65a-fd2af3fdc927`::moving from state preparing -> state finished >Thread-105::DEBUG::2013-03-01 13:03:37,079::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-721::DEBUG::2013-03-01 13:03:37,102::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721::DEBUG::2013-03-01 13:03:37,139::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721::DEBUG::2013-03-01 13:03:37,173::task::957::TaskManager.Task::(_decref) Task=`79245cfc-289f-4d8b-a65a-fd2af3fdc927`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:03:37,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:03:37,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00478322 s, 856 kB/s\n'; <rc> = 0 >Thread-722::DEBUG::2013-03-01 13:03:37,634::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-722::DEBUG::2013-03-01 13:03:37,678::task::568::TaskManager.Task::(_updateState) Task=`be968b4b-c5d6-408f-bfaf-01580136ec1a`::moving from state init -> state preparing >Thread-722::INFO::2013-03-01 13:03:37,710::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='cf2b464d-085d-49bc-a9f5-533578a13e86', spUUID=None, options=None) >Thread-722::DEBUG::2013-03-01 13:03:37,726::taskManager::161::TaskManager::(clearTask) Entry. taskID: cf2b464d-085d-49bc-a9f5-533578a13e86 >Thread-722::DEBUG::2013-03-01 13:03:37,782::taskManager::166::TaskManager::(clearTask) Return. >Thread-722::INFO::2013-03-01 13:03:37,794::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-722::DEBUG::2013-03-01 13:03:37,821::task::1151::TaskManager.Task::(prepare) Task=`be968b4b-c5d6-408f-bfaf-01580136ec1a`::finished: None >Thread-722::DEBUG::2013-03-01 13:03:37,846::task::568::TaskManager.Task::(_updateState) Task=`be968b4b-c5d6-408f-bfaf-01580136ec1a`::moving from state preparing -> state finished >Thread-722::DEBUG::2013-03-01 13:03:37,870::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-722::DEBUG::2013-03-01 13:03:37,891::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-722::DEBUG::2013-03-01 13:03:37,912::task::957::TaskManager.Task::(_decref) Task=`be968b4b-c5d6-408f-bfaf-01580136ec1a`::ref 0 aborting False >Thread-724::DEBUG::2013-03-01 13:03:38,047::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-724::DEBUG::2013-03-01 13:03:38,048::task::568::TaskManager.Task::(_updateState) Task=`43210b31-7acf-4e88-b4e6-a89541076344`::moving from state init -> state preparing >Thread-724::INFO::2013-03-01 13:03:38,049::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-724::INFO::2013-03-01 13:03:38,050::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-724::DEBUG::2013-03-01 13:03:38,051::task::1151::TaskManager.Task::(prepare) Task=`43210b31-7acf-4e88-b4e6-a89541076344`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-724::DEBUG::2013-03-01 13:03:38,052::task::568::TaskManager.Task::(_updateState) Task=`43210b31-7acf-4e88-b4e6-a89541076344`::moving from state preparing -> state finished >Thread-724::DEBUG::2013-03-01 13:03:38,053::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-724::DEBUG::2013-03-01 13:03:38,054::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-724::DEBUG::2013-03-01 13:03:38,056::task::957::TaskManager.Task::(_decref) Task=`43210b31-7acf-4e88-b4e6-a89541076344`::ref 0 aborting False >Thread-725::DEBUG::2013-03-01 13:03:38,084::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-725::DEBUG::2013-03-01 13:03:38,087::task::568::TaskManager.Task::(_updateState) Task=`fad60fbd-eb9a-465e-b1d4-fadbfe1c6f0f`::moving from state init -> state preparing >Thread-725::INFO::2013-03-01 13:03:38,090::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-725::DEBUG::2013-03-01 13:03:38,093::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`584f68e4-9224-4002-8918-54426580a4ed`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-725::DEBUG::2013-03-01 13:03:38,094::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-725::DEBUG::2013-03-01 13:03:38,095::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-725::DEBUG::2013-03-01 13:03:38,096::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`584f68e4-9224-4002-8918-54426580a4ed`::Granted request >Thread-725::DEBUG::2013-03-01 13:03:38,098::task::794::TaskManager.Task::(resourceAcquired) Task=`fad60fbd-eb9a-465e-b1d4-fadbfe1c6f0f`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-725::DEBUG::2013-03-01 13:03:38,099::task::957::TaskManager.Task::(_decref) Task=`fad60fbd-eb9a-465e-b1d4-fadbfe1c6f0f`::ref 1 aborting False >Thread-725::DEBUG::2013-03-01 13:03:38,101::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-725::DEBUG::2013-03-01 13:03:38,105::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:38,131::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.25991 s, 813 kB/s\n'; <rc> = 0 >Thread-725::DEBUG::2013-03-01 13:03:38,295::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-725::INFO::2013-03-01 13:03:38,297::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-725::DEBUG::2013-03-01 13:03:38,307::task::1151::TaskManager.Task::(prepare) Task=`fad60fbd-eb9a-465e-b1d4-fadbfe1c6f0f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-725::DEBUG::2013-03-01 13:03:38,307::task::568::TaskManager.Task::(_updateState) Task=`fad60fbd-eb9a-465e-b1d4-fadbfe1c6f0f`::moving from state preparing -> state finished >Thread-725::DEBUG::2013-03-01 13:03:38,308::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-725::DEBUG::2013-03-01 13:03:38,308::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-725::DEBUG::2013-03-01 13:03:38,308::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-725::DEBUG::2013-03-01 13:03:38,309::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-725::DEBUG::2013-03-01 13:03:38,309::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-725::DEBUG::2013-03-01 13:03:38,309::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-725::DEBUG::2013-03-01 13:03:38,310::task::957::TaskManager.Task::(_decref) Task=`fad60fbd-eb9a-465e-b1d4-fadbfe1c6f0f`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:03:38,327::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:03:38,328::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:03:38,329::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:38,341::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000367027 s, 11.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:40,147::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:41,530::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.483687 s, 2.1 MB/s\n'; <rc> = 0 >Thread-727::DEBUG::2013-03-01 13:03:42,121::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-727::DEBUG::2013-03-01 13:03:42,121::task::568::TaskManager.Task::(_updateState) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::moving from state init -> state preparing >Thread-727::INFO::2013-03-01 13:03:42,122::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='46e8b230-ef40-4738-aed4-250016777727', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-727::INFO::2013-03-01 13:03:42,122::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-727::DEBUG::2013-03-01 13:03:42,123::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-727::DEBUG::2013-03-01 13:03:42,371::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-727::DEBUG::2013-03-01 13:03:42,372::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-727::DEBUG::2013-03-01 13:03:42,372::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-727::DEBUG::2013-03-01 13:03:42,373::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-727::DEBUG::2013-03-01 13:03:42,373::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-727::DEBUG::2013-03-01 13:03:42,373::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-727::DEBUG::2013-03-01 13:03:42,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-727::DEBUG::2013-03-01 13:03:42,619::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-727::DEBUG::2013-03-01 13:03:42,621::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-727::DEBUG::2013-03-01 13:03:42,621::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-727::DEBUG::2013-03-01 13:03:42,623::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`4aa2b7a1-ab9e-4eb4-953f-8d27c5b632de`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-727::DEBUG::2013-03-01 13:03:42,623::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-727::DEBUG::2013-03-01 13:03:42,623::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-727::DEBUG::2013-03-01 13:03:42,623::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`4aa2b7a1-ab9e-4eb4-953f-8d27c5b632de`::Granted request >Thread-727::DEBUG::2013-03-01 13:03:42,624::task::794::TaskManager.Task::(resourceAcquired) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-727::DEBUG::2013-03-01 13:03:42,624::task::957::TaskManager.Task::(_decref) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::ref 1 aborting False >Thread-727::DEBUG::2013-03-01 13:03:42,626::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >Thread-727::DEBUG::2013-03-01 13:03:42,632::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task d309adb4-fd76-4b1a-a905-11a97ff643d8 >Thread-727::INFO::2013-03-01 13:03:42,632::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-727::DEBUG::2013-03-01 13:03:42,633::task::1146::TaskManager.Task::(prepare) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::Prepare: 1 jobs exist, move to acquiring >Thread-727::DEBUG::2013-03-01 13:03:42,633::task::568::TaskManager.Task::(_updateState) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::moving from state preparing -> state acquiring >Thread-727::DEBUG::2013-03-01 13:03:42,634::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >Thread-727::DEBUG::2013-03-01 13:03:42,641::task::568::TaskManager.Task::(_updateState) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::moving from state acquiring -> state queued >Thread-727::DEBUG::2013-03-01 13:03:42,641::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >Thread-727::DEBUG::2013-03-01 13:03:42,648::taskManager::50::TaskManager::(_queueTask) queuing task: d309adb4-fd76-4b1a-a905-11a97ff643d8 >Thread-727::DEBUG::2013-03-01 13:03:42,649::taskManager::56::TaskManager::(_queueTask) task queued: d309adb4-fd76-4b1a-a905-11a97ff643d8 >e00f98e4-3ebe-48fa-97df-9d139da1f18a::DEBUG::2013-03-01 13:03:42,649::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,650::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: d309adb4-fd76-4b1a-a905-11a97ff643d8 running: <bound method Task.commit of <storage.task.Task instance at 0x17b7ea8>> with: None >Thread-727::DEBUG::2013-03-01 13:03:42,650::task::1148::TaskManager.Task::(prepare) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::returning >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,652::task::1159::TaskManager.Task::(commit) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::committing task: d309adb4-fd76-4b1a-a905-11a97ff643d8 >Thread-727::DEBUG::2013-03-01 13:03:42,652::task::957::TaskManager.Task::(_decref) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::ref 0 aborting False >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,653::task::568::TaskManager.Task::(_updateState) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::moving from state queued -> state running >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,657::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,665::task::872::TaskManager.Task::(_runJobs) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a178bac1-309b-4737-846b-0b43463f11b7', 12582912, 4, 2, 2, '46e8b230-ef40-4738-aed4-250016777727', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,665::task::304::TaskManager.Task::(run) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a178bac1-309b-4737-846b-0b43463f11b7', 12582912, 4, 2, 2, '46e8b230-ef40-4738-aed4-250016777727', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,666::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`f2fe8cdf-8e6c-452e-9d98-c560e65db528`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,666::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' for lock type 'exclusive' >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,667::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,668::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,910::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,922::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,922::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image a178bac1-309b-4737-846b-0b43463f11b7 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,923::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' is free. Now locking as 'exclusive' (1 active user) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,923::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`f2fe8cdf-8e6c-452e-9d98-c560e65db528`::Granted request >d309adb4-fd76-4b1a-a905-11a97ff643d8::INFO::2013-03-01 13:03:42,924::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7 for image's volumes >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,925::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,934::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:42,935::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:43,181::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:43,192::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::WARNING::2013-03-01 13:03:43,193::lvm::593::Storage.LVM::(getLv) lv: 46e8b230-ef40-4738-aed4-250016777727 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >d309adb4-fd76-4b1a-a905-11a97ff643d8::INFO::2013-03-01 13:03:43,193::volume::457::Storage.Volume::(create) Creating volume 46e8b230-ef40-4738-aed4-250016777727 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:43,194::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:43,204::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:43,214::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 46e8b230-ef40-4738-aed4-250016777727 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:43,549::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:43,664::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483801 s, 21.2 MB/s\n'; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,915::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,916::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,916::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,916::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,917::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::INFO::2013-03-01 13:03:44,917::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 with size = 12582912 sectors >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,918::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 6291456K' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,930::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,931::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:44,932::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,176::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,185::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::WARNING::2013-03-01 13:03:45,186::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,186::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,187::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_7 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_a178bac1-309b-4737-846b-0b43463f11b7 a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,391::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,391::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,392::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,392::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,643::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,643::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,644::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,645::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,657::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=46e8b230-ef40-4738-aed4-250016777727 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,663::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,676::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,676::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' (0 active users) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,677::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' is free, finding out if anyone is waiting for it. >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,677::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7', Clearing records. >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,677::task::568::TaskManager.Task::(_updateState) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::moving from state running -> state finished >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,678::task::719::TaskManager.Task::(_save) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d309adb4-fd76-4b1a-a905-11a97ff643d8.temp >Dummy-173::DEBUG::2013-03-01 13:03:45,683::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,707::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,708::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,711::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,712::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,713::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,714::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,716::task::880::TaskManager.Task::(_runJobs) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::Task.run: exit - success: result {'uuid': '46e8b230-ef40-4738-aed4-250016777727'} >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,717::task::957::TaskManager.Task::(_decref) Task=`d309adb4-fd76-4b1a-a905-11a97ff643d8`::ref 0 aborting False >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:03:45,719::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:03:45,792::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0628245 s, 16.3 MB/s\n'; <rc> = 0 >Thread-729::DEBUG::2013-03-01 13:03:46,495::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-729::DEBUG::2013-03-01 13:03:46,496::task::568::TaskManager.Task::(_updateState) Task=`5e91da27-e53b-4a4f-a97c-247266a2f370`::moving from state init -> state preparing >Thread-729::INFO::2013-03-01 13:03:46,496::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-729::DEBUG::2013-03-01 13:03:46,496::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-729::DEBUG::2013-03-01 13:03:46,496::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d309adb4-fd76-4b1a-a905-11a97ff643d8 >Thread-729::DEBUG::2013-03-01 13:03:46,496::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd309adb4-fd76-4b1a-a905-11a97ff643d8'} >Thread-729::DEBUG::2013-03-01 13:03:46,497::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'d309adb4-fd76-4b1a-a905-11a97ff643d8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd309adb4-fd76-4b1a-a905-11a97ff643d8'}} >Thread-729::INFO::2013-03-01 13:03:46,497::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d309adb4-fd76-4b1a-a905-11a97ff643d8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd309adb4-fd76-4b1a-a905-11a97ff643d8'}}} >Thread-729::DEBUG::2013-03-01 13:03:46,497::task::1151::TaskManager.Task::(prepare) Task=`5e91da27-e53b-4a4f-a97c-247266a2f370`::finished: {'allTasksStatus': {'d309adb4-fd76-4b1a-a905-11a97ff643d8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd309adb4-fd76-4b1a-a905-11a97ff643d8'}}} >Thread-729::DEBUG::2013-03-01 13:03:46,497::task::568::TaskManager.Task::(_updateState) Task=`5e91da27-e53b-4a4f-a97c-247266a2f370`::moving from state preparing -> state finished >Thread-729::DEBUG::2013-03-01 13:03:46,497::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-729::DEBUG::2013-03-01 13:03:46,498::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-729::DEBUG::2013-03-01 13:03:46,498::task::957::TaskManager.Task::(_decref) Task=`5e91da27-e53b-4a4f-a97c-247266a2f370`::ref 0 aborting False >Thread-730::DEBUG::2013-03-01 13:03:46,547::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-730::DEBUG::2013-03-01 13:03:46,547::task::568::TaskManager.Task::(_updateState) Task=`2d3b161b-2d83-49e8-8182-6c359e9d468e`::moving from state init -> state preparing >Thread-730::INFO::2013-03-01 13:03:46,547::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', volUUID='46e8b230-ef40-4738-aed4-250016777727', options=None) >Thread-730::DEBUG::2013-03-01 13:03:46,548::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`da937e7f-4caf-4272-99b0-dc39fe9e16b2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-730::DEBUG::2013-03-01 13:03:46,548::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-730::DEBUG::2013-03-01 13:03:46,549::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-730::DEBUG::2013-03-01 13:03:46,549::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`da937e7f-4caf-4272-99b0-dc39fe9e16b2`::Granted request >Thread-730::DEBUG::2013-03-01 13:03:46,550::task::794::TaskManager.Task::(resourceAcquired) Task=`2d3b161b-2d83-49e8-8182-6c359e9d468e`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-730::DEBUG::2013-03-01 13:03:46,550::task::957::TaskManager.Task::(_decref) Task=`2d3b161b-2d83-49e8-8182-6c359e9d468e`::ref 1 aborting False >Thread-730::DEBUG::2013-03-01 13:03:46,550::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-730::DEBUG::2013-03-01 13:03:46,551::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-730::DEBUG::2013-03-01 13:03:46,727::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-730::DEBUG::2013-03-01 13:03:46,737::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-730::INFO::2013-03-01 13:03:46,738::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 volUUID = 46e8b230-ef40-4738-aed4-250016777727 >Thread-730::DEBUG::2013-03-01 13:03:46,738::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-730::DEBUG::2013-03-01 13:03:46,747::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316965 s, 1.6 MB/s\n'; <rc> = 0 >Thread-730::DEBUG::2013-03-01 13:03:46,748::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316965 s, 1.6 MB/s'], size: 512 >Thread-730::DEBUG::2013-03-01 13:03:46,749::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-730::DEBUG::2013-03-01 13:03:46,759::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000350167 s, 1.5 MB/s\n'; <rc> = 0 >Thread-730::DEBUG::2013-03-01 13:03:46,759::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000350167 s, 1.5 MB/s'], size: 512 >Thread-730::DEBUG::2013-03-01 13:03:46,760::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-730::DEBUG::2013-03-01 13:03:46,761::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-730::DEBUG::2013-03-01 13:03:46,951::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-730::DEBUG::2013-03-01 13:03:46,964::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-730::INFO::2013-03-01 13:03:46,965::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-730::INFO::2013-03-01 13:03:46,965::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-730::DEBUG::2013-03-01 13:03:46,965::task::1151::TaskManager.Task::(prepare) Task=`2d3b161b-2d83-49e8-8182-6c359e9d468e`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-730::DEBUG::2013-03-01 13:03:46,966::task::568::TaskManager.Task::(_updateState) Task=`2d3b161b-2d83-49e8-8182-6c359e9d468e`::moving from state preparing -> state finished >Thread-730::DEBUG::2013-03-01 13:03:46,966::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-730::DEBUG::2013-03-01 13:03:46,966::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-730::DEBUG::2013-03-01 13:03:46,967::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-730::DEBUG::2013-03-01 13:03:46,967::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-730::DEBUG::2013-03-01 13:03:46,967::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-730::DEBUG::2013-03-01 13:03:46,968::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-730::DEBUG::2013-03-01 13:03:46,968::task::957::TaskManager.Task::(_decref) Task=`2d3b161b-2d83-49e8-8182-6c359e9d468e`::ref 0 aborting False >Thread-731::DEBUG::2013-03-01 13:03:47,016::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-731::DEBUG::2013-03-01 13:03:47,017::task::568::TaskManager.Task::(_updateState) Task=`3661fa93-8b4d-4315-8113-4ae5509b708c`::moving from state init -> state preparing >Thread-731::INFO::2013-03-01 13:03:47,017::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='d309adb4-fd76-4b1a-a905-11a97ff643d8', spUUID=None, options=None) >Thread-731::DEBUG::2013-03-01 13:03:47,017::taskManager::161::TaskManager::(clearTask) Entry. taskID: d309adb4-fd76-4b1a-a905-11a97ff643d8 >Thread-731::DEBUG::2013-03-01 13:03:47,018::taskManager::166::TaskManager::(clearTask) Return. >Thread-731::INFO::2013-03-01 13:03:47,019::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-731::DEBUG::2013-03-01 13:03:47,019::task::1151::TaskManager.Task::(prepare) Task=`3661fa93-8b4d-4315-8113-4ae5509b708c`::finished: None >Thread-731::DEBUG::2013-03-01 13:03:47,019::task::568::TaskManager.Task::(_updateState) Task=`3661fa93-8b4d-4315-8113-4ae5509b708c`::moving from state preparing -> state finished >Thread-731::DEBUG::2013-03-01 13:03:47,019::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-731::DEBUG::2013-03-01 13:03:47,019::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-731::DEBUG::2013-03-01 13:03:47,019::task::957::TaskManager.Task::(_decref) Task=`3661fa93-8b4d-4315-8113-4ae5509b708c`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:03:47,535::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:03:47,545::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000465534 s, 8.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:47,805::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:47,918::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466245 s, 22.0 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:03:48,347::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:03:48,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-733::DEBUG::2013-03-01 13:03:48,382::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-733::DEBUG::2013-03-01 13:03:48,382::task::568::TaskManager.Task::(_updateState) Task=`6d6c19fa-501b-4f52-81ce-0af82039b545`::moving from state init -> state preparing >Thread-733::INFO::2013-03-01 13:03:48,383::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-733::INFO::2013-03-01 13:03:48,383::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-733::DEBUG::2013-03-01 13:03:48,383::task::1151::TaskManager.Task::(prepare) Task=`6d6c19fa-501b-4f52-81ce-0af82039b545`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-733::DEBUG::2013-03-01 13:03:48,384::task::568::TaskManager.Task::(_updateState) Task=`6d6c19fa-501b-4f52-81ce-0af82039b545`::moving from state preparing -> state finished >Thread-733::DEBUG::2013-03-01 13:03:48,384::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-733::DEBUG::2013-03-01 13:03:48,384::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-733::DEBUG::2013-03-01 13:03:48,385::task::957::TaskManager.Task::(_decref) Task=`6d6c19fa-501b-4f52-81ce-0af82039b545`::ref 0 aborting False >Thread-734::DEBUG::2013-03-01 13:03:48,409::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-734::DEBUG::2013-03-01 13:03:48,409::task::568::TaskManager.Task::(_updateState) Task=`9bb98440-3e7a-4eaf-9e87-1a540b8abd45`::moving from state init -> state preparing >Thread-734::INFO::2013-03-01 13:03:48,455::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-734::DEBUG::2013-03-01 13:03:48,455::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b64e89a8-bd6a-4493-82b7-46daeea7ccba`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-734::DEBUG::2013-03-01 13:03:48,455::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-734::DEBUG::2013-03-01 13:03:48,456::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-734::DEBUG::2013-03-01 13:03:48,456::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b64e89a8-bd6a-4493-82b7-46daeea7ccba`::Granted request >Thread-734::DEBUG::2013-03-01 13:03:48,457::task::794::TaskManager.Task::(resourceAcquired) Task=`9bb98440-3e7a-4eaf-9e87-1a540b8abd45`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-734::DEBUG::2013-03-01 13:03:48,457::task::957::TaskManager.Task::(_decref) Task=`9bb98440-3e7a-4eaf-9e87-1a540b8abd45`::ref 1 aborting False >Thread-734::DEBUG::2013-03-01 13:03:48,458::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-734::DEBUG::2013-03-01 13:03:48,458::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:48,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:03:48,677::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:48,689::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000315087 s, 13.0 MB/s\n'; <rc> = 0 >Thread-734::DEBUG::2013-03-01 13:03:48,701::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-734::DEBUG::2013-03-01 13:03:48,703::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-734::INFO::2013-03-01 13:03:48,705::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-734::DEBUG::2013-03-01 13:03:48,705::task::1151::TaskManager.Task::(prepare) Task=`9bb98440-3e7a-4eaf-9e87-1a540b8abd45`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-734::DEBUG::2013-03-01 13:03:48,706::task::568::TaskManager.Task::(_updateState) Task=`9bb98440-3e7a-4eaf-9e87-1a540b8abd45`::moving from state preparing -> state finished >Thread-734::DEBUG::2013-03-01 13:03:48,706::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-734::DEBUG::2013-03-01 13:03:48,706::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-734::DEBUG::2013-03-01 13:03:48,707::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-734::DEBUG::2013-03-01 13:03:48,707::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-734::DEBUG::2013-03-01 13:03:48,707::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-734::DEBUG::2013-03-01 13:03:48,708::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-734::DEBUG::2013-03-01 13:03:48,708::task::957::TaskManager.Task::(_decref) Task=`9bb98440-3e7a-4eaf-9e87-1a540b8abd45`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:49,938::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:50,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456329 s, 22.4 MB/s\n'; <rc> = 0 >Thread-735::DEBUG::2013-03-01 13:03:50,322::task::568::TaskManager.Task::(_updateState) Task=`b2504478-80e2-4d7d-8774-16031bf75398`::moving from state init -> state preparing >Thread-735::INFO::2013-03-01 13:03:50,322::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-735::INFO::2013-03-01 13:03:50,322::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0108280181885', 'lastCheck': '2.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0123569965363', 'lastCheck': '1.6', 'code': 0, 'valid': True}} >Thread-735::DEBUG::2013-03-01 13:03:50,323::task::1151::TaskManager.Task::(prepare) Task=`b2504478-80e2-4d7d-8774-16031bf75398`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0108280181885', 'lastCheck': '2.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0123569965363', 'lastCheck': '1.6', 'code': 0, 'valid': True}} >Thread-735::DEBUG::2013-03-01 13:03:50,323::task::568::TaskManager.Task::(_updateState) Task=`b2504478-80e2-4d7d-8774-16031bf75398`::moving from state preparing -> state finished >Thread-735::DEBUG::2013-03-01 13:03:50,323::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-735::DEBUG::2013-03-01 13:03:50,323::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-735::DEBUG::2013-03-01 13:03:50,324::task::957::TaskManager.Task::(_decref) Task=`b2504478-80e2-4d7d-8774-16031bf75398`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:52,065::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:52,168::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376603 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:54,188::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:54,275::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289421 s, 35.4 MB/s\n'; <rc> = 0 >Thread-738::DEBUG::2013-03-01 13:03:54,604::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-738::DEBUG::2013-03-01 13:03:54,605::task::568::TaskManager.Task::(_updateState) Task=`c6c52d6f-9602-47cb-9c71-5191ed56f5bd`::moving from state init -> state preparing >Thread-738::INFO::2013-03-01 13:03:54,605::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', volUUID='46e8b230-ef40-4738-aed4-250016777727', options=None) >Thread-738::DEBUG::2013-03-01 13:03:54,606::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`54f09be0-0e2e-4c04-b2a7-fa10639bb5c0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-738::DEBUG::2013-03-01 13:03:54,606::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-738::DEBUG::2013-03-01 13:03:54,607::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-738::DEBUG::2013-03-01 13:03:54,607::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`54f09be0-0e2e-4c04-b2a7-fa10639bb5c0`::Granted request >Thread-738::DEBUG::2013-03-01 13:03:54,609::task::794::TaskManager.Task::(resourceAcquired) Task=`c6c52d6f-9602-47cb-9c71-5191ed56f5bd`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-738::DEBUG::2013-03-01 13:03:54,609::task::957::TaskManager.Task::(_decref) Task=`c6c52d6f-9602-47cb-9c71-5191ed56f5bd`::ref 1 aborting False >Thread-738::INFO::2013-03-01 13:03:54,610::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 volUUID = 46e8b230-ef40-4738-aed4-250016777727 >Thread-738::DEBUG::2013-03-01 13:03:54,611::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-738::DEBUG::2013-03-01 13:03:54,621::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000386137 s, 1.3 MB/s\n'; <rc> = 0 >Thread-738::DEBUG::2013-03-01 13:03:54,621::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000386137 s, 1.3 MB/s'], size: 512 >Thread-738::DEBUG::2013-03-01 13:03:54,622::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-738::DEBUG::2013-03-01 13:03:54,632::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000372176 s, 1.4 MB/s\n'; <rc> = 0 >Thread-738::DEBUG::2013-03-01 13:03:54,633::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000372176 s, 1.4 MB/s'], size: 512 >Thread-738::DEBUG::2013-03-01 13:03:54,633::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-738::DEBUG::2013-03-01 13:03:54,634::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-738::DEBUG::2013-03-01 13:03:54,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-738::DEBUG::2013-03-01 13:03:54,889::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-738::INFO::2013-03-01 13:03:54,889::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-738::INFO::2013-03-01 13:03:54,890::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-738::DEBUG::2013-03-01 13:03:54,890::task::1151::TaskManager.Task::(prepare) Task=`c6c52d6f-9602-47cb-9c71-5191ed56f5bd`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-738::DEBUG::2013-03-01 13:03:54,890::task::568::TaskManager.Task::(_updateState) Task=`c6c52d6f-9602-47cb-9c71-5191ed56f5bd`::moving from state preparing -> state finished >Thread-738::DEBUG::2013-03-01 13:03:54,890::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-738::DEBUG::2013-03-01 13:03:54,891::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-738::DEBUG::2013-03-01 13:03:54,891::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-738::DEBUG::2013-03-01 13:03:54,891::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-738::DEBUG::2013-03-01 13:03:54,891::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-738::DEBUG::2013-03-01 13:03:54,892::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-738::DEBUG::2013-03-01 13:03:54,892::task::957::TaskManager.Task::(_decref) Task=`c6c52d6f-9602-47cb-9c71-5191ed56f5bd`::ref 0 aborting False >Thread-739::DEBUG::2013-03-01 13:03:54,975::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-739::DEBUG::2013-03-01 13:03:54,975::task::568::TaskManager.Task::(_updateState) Task=`733881cc-9dba-4605-b01c-d5e41ada784d`::moving from state init -> state preparing >Thread-739::INFO::2013-03-01 13:03:54,976::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', volUUID='46e8b230-ef40-4738-aed4-250016777727', options=None) >Thread-739::DEBUG::2013-03-01 13:03:54,976::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`146b3945-e479-4ab7-8536-78ec5434fcc8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-739::DEBUG::2013-03-01 13:03:54,976::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-739::DEBUG::2013-03-01 13:03:54,977::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-739::DEBUG::2013-03-01 13:03:54,977::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`146b3945-e479-4ab7-8536-78ec5434fcc8`::Granted request >Thread-739::DEBUG::2013-03-01 13:03:54,978::task::794::TaskManager.Task::(resourceAcquired) Task=`733881cc-9dba-4605-b01c-d5e41ada784d`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-739::DEBUG::2013-03-01 13:03:54,978::task::957::TaskManager.Task::(_decref) Task=`733881cc-9dba-4605-b01c-d5e41ada784d`::ref 1 aborting False >Thread-739::INFO::2013-03-01 13:03:54,979::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 volUUID = 46e8b230-ef40-4738-aed4-250016777727 >Thread-739::DEBUG::2013-03-01 13:03:54,979::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-739::DEBUG::2013-03-01 13:03:54,989::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000300395 s, 1.7 MB/s\n'; <rc> = 0 >Thread-739::DEBUG::2013-03-01 13:03:54,990::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000300395 s, 1.7 MB/s'], size: 512 >Thread-739::DEBUG::2013-03-01 13:03:54,991::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-739::DEBUG::2013-03-01 13:03:55,000::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000329902 s, 1.6 MB/s\n'; <rc> = 0 >Thread-739::DEBUG::2013-03-01 13:03:55,001::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000329902 s, 1.6 MB/s'], size: 512 >Thread-739::DEBUG::2013-03-01 13:03:55,001::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-739::DEBUG::2013-03-01 13:03:55,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-739::DEBUG::2013-03-01 13:03:55,246::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-739::DEBUG::2013-03-01 13:03:55,256::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-739::INFO::2013-03-01 13:03:55,257::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-739::INFO::2013-03-01 13:03:55,257::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-739::DEBUG::2013-03-01 13:03:55,257::task::1151::TaskManager.Task::(prepare) Task=`733881cc-9dba-4605-b01c-d5e41ada784d`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135825', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135825', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '46e8b230-ef40-4738-aed4-250016777727', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-739::DEBUG::2013-03-01 13:03:55,258::task::568::TaskManager.Task::(_updateState) Task=`733881cc-9dba-4605-b01c-d5e41ada784d`::moving from state preparing -> state finished >Thread-739::DEBUG::2013-03-01 13:03:55,258::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-739::DEBUG::2013-03-01 13:03:55,258::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-739::DEBUG::2013-03-01 13:03:55,259::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-739::DEBUG::2013-03-01 13:03:55,259::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-739::DEBUG::2013-03-01 13:03:55,259::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-739::DEBUG::2013-03-01 13:03:55,260::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-739::DEBUG::2013-03-01 13:03:55,260::task::957::TaskManager.Task::(_decref) Task=`733881cc-9dba-4605-b01c-d5e41ada784d`::ref 0 aborting False >Thread-740::DEBUG::2013-03-01 13:03:55,290::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-740::DEBUG::2013-03-01 13:03:55,290::task::568::TaskManager.Task::(_updateState) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::moving from state init -> state preparing >Thread-740::INFO::2013-03-01 13:03:55,291::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='c517d142-d8c1-4f81-927b-d95764a45afa', desc='', srcImgUUID='a178bac1-309b-4737-846b-0b43463f11b7', srcVolUUID='46e8b230-ef40-4738-aed4-250016777727') >Thread-740::INFO::2013-03-01 13:03:55,291::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-740::DEBUG::2013-03-01 13:03:55,292::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-740::DEBUG::2013-03-01 13:03:55,534::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-740::DEBUG::2013-03-01 13:03:55,535::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-740::DEBUG::2013-03-01 13:03:55,535::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-740::DEBUG::2013-03-01 13:03:55,535::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-740::DEBUG::2013-03-01 13:03:55,536::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-740::DEBUG::2013-03-01 13:03:55,536::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-740::DEBUG::2013-03-01 13:03:55,537::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-740::DEBUG::2013-03-01 13:03:55,782::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-740::DEBUG::2013-03-01 13:03:55,784::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-740::DEBUG::2013-03-01 13:03:55,785::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-740::DEBUG::2013-03-01 13:03:55,786::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5dd7ee1c-366c-41b9-8f8a-f8947637b447`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-740::DEBUG::2013-03-01 13:03:55,786::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-740::DEBUG::2013-03-01 13:03:55,787::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-740::DEBUG::2013-03-01 13:03:55,787::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5dd7ee1c-366c-41b9-8f8a-f8947637b447`::Granted request >Thread-740::DEBUG::2013-03-01 13:03:55,788::task::794::TaskManager.Task::(resourceAcquired) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-740::DEBUG::2013-03-01 13:03:55,788::task::957::TaskManager.Task::(_decref) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::ref 1 aborting False >Thread-740::DEBUG::2013-03-01 13:03:55,789::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >Thread-740::DEBUG::2013-03-01 13:03:55,794::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >Thread-740::INFO::2013-03-01 13:03:55,795::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-740::DEBUG::2013-03-01 13:03:55,795::task::1146::TaskManager.Task::(prepare) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::Prepare: 1 jobs exist, move to acquiring >Thread-740::DEBUG::2013-03-01 13:03:55,795::task::568::TaskManager.Task::(_updateState) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::moving from state preparing -> state acquiring >Thread-740::DEBUG::2013-03-01 13:03:55,796::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >Thread-740::DEBUG::2013-03-01 13:03:55,803::task::568::TaskManager.Task::(_updateState) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::moving from state acquiring -> state queued >Thread-740::DEBUG::2013-03-01 13:03:55,804::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >Thread-740::DEBUG::2013-03-01 13:03:55,811::taskManager::50::TaskManager::(_queueTask) queuing task: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >Thread-740::DEBUG::2013-03-01 13:03:55,812::taskManager::56::TaskManager::(_queueTask) task queued: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >Thread-6::DEBUG::2013-03-01 13:03:55,812::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-740::DEBUG::2013-03-01 13:03:55,813::task::1148::TaskManager.Task::(prepare) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::returning >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,813::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c0129170>> with: None >Thread-740::DEBUG::2013-03-01 13:03:55,814::task::957::TaskManager.Task::(_decref) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::ref 0 aborting False >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,815::task::1159::TaskManager.Task::(commit) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::committing task: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,817::task::568::TaskManager.Task::(_updateState) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::moving from state queued -> state running >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,820::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,826::task::872::TaskManager.Task::(_runJobs) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a178bac1-309b-4737-846b-0b43463f11b7', 12582912, 4, 2, 2, 'c517d142-d8c1-4f81-927b-d95764a45afa', '', 'a178bac1-309b-4737-846b-0b43463f11b7', '46e8b230-ef40-4738-aed4-250016777727') kwargs: {}) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,827::task::304::TaskManager.Task::(run) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'a178bac1-309b-4737-846b-0b43463f11b7', 12582912, 4, 2, 2, 'c517d142-d8c1-4f81-927b-d95764a45afa', '', 'a178bac1-309b-4737-846b-0b43463f11b7', '46e8b230-ef40-4738-aed4-250016777727') kwargs: {}) callback None >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,827::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`b3f69dc5-1d5f-40ce-aa80-5f6689d42b6e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,827::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' for lock type 'exclusive' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,828::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:55,829::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,072::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,082::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,083::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000310932 s, 1.6 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,093::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000310932 s, 1.6 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,094::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,104::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000336775 s, 1.5 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,104::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000336775 s, 1.5 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::INFO::2013-03-01 13:03:56,105::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f8099a90>] >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,106::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`c4e42315-fb7e-41f6-b10b-757c61b8a8eb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,106::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' for lock type 'exclusive' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,106::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' is free. Now locking as 'exclusive' (1 active user) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,107::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`c4e42315-fb7e-41f6-b10b-757c61b8a8eb`::Granted request >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,107::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' is free. Now locking as 'exclusive' (1 active user) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,107::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`b3f69dc5-1d5f-40ce-aa80-5f6689d42b6e`::Granted request >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,109::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,110::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:03:56,294::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,305::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,341::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::WARNING::2013-03-01 13:03:56,344::lvm::593::Storage.LVM::(getLv) lv: c517d142-d8c1-4f81-927b-d95764a45afa not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,349::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,374::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00045261 s, 1.1 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,376::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00045261 s, 1.1 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,380::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,403::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000466634 s, 1.1 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,405::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000466634 s, 1.1 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::INFO::2013-03-01 13:03:56,407::volume::457::Storage.Volume::(create) Creating volume c517d142-d8c1-4f81-927b-d95764a45afa >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,411::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,448::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:03:56,487::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name c517d142-d8c1-4f81-927b-d95764a45afa a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-742::DEBUG::2013-03-01 13:03:56,543::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-742::DEBUG::2013-03-01 13:03:56,544::task::568::TaskManager.Task::(_updateState) Task=`ad528ad4-451d-4dc5-ac7f-304a0606fa98`::moving from state init -> state preparing >Thread-742::INFO::2013-03-01 13:03:56,545::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-742::DEBUG::2013-03-01 13:03:56,546::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-742::DEBUG::2013-03-01 13:03:56,547::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >Thread-742::DEBUG::2013-03-01 13:03:56,548::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'} >Thread-742::DEBUG::2013-03-01 13:03:56,548::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'20e4f56a-2b74-4cc9-bf1e-7f19f42835b9': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'}} >Thread-742::INFO::2013-03-01 13:03:56,549::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'20e4f56a-2b74-4cc9-bf1e-7f19f42835b9': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'}}} >Thread-742::DEBUG::2013-03-01 13:03:56,550::task::1151::TaskManager.Task::(prepare) Task=`ad528ad4-451d-4dc5-ac7f-304a0606fa98`::finished: {'allTasksStatus': {'20e4f56a-2b74-4cc9-bf1e-7f19f42835b9': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'}}} >Thread-742::DEBUG::2013-03-01 13:03:56,550::task::568::TaskManager.Task::(_updateState) Task=`ad528ad4-451d-4dc5-ac7f-304a0606fa98`::moving from state preparing -> state finished >Thread-742::DEBUG::2013-03-01 13:03:56,551::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-742::DEBUG::2013-03-01 13:03:56,552::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-742::DEBUG::2013-03-01 13:03:56,553::task::957::TaskManager.Task::(_decref) Task=`ad528ad4-451d-4dc5-ac7f-304a0606fa98`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:03:56,584::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.227752 s, 4.5 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:03:57,558::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:03:57,818::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00479966 s, 853 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:03:58,602::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:03:58,852::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-743::DEBUG::2013-03-01 13:03:59,122::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-743::DEBUG::2013-03-01 13:03:59,170::task::568::TaskManager.Task::(_updateState) Task=`473c0cb3-c843-4a6e-a53b-bbc685e8bf2d`::moving from state init -> state preparing >Thread-743::INFO::2013-03-01 13:03:59,194::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-743::INFO::2013-03-01 13:03:59,222::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-743::DEBUG::2013-03-01 13:03:59,238::task::1151::TaskManager.Task::(prepare) Task=`473c0cb3-c843-4a6e-a53b-bbc685e8bf2d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-743::DEBUG::2013-03-01 13:03:59,267::task::568::TaskManager.Task::(_updateState) Task=`473c0cb3-c843-4a6e-a53b-bbc685e8bf2d`::moving from state preparing -> state finished >Thread-743::DEBUG::2013-03-01 13:03:59,292::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-743::DEBUG::2013-03-01 13:03:59,327::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-743::DEBUG::2013-03-01 13:03:59,356::task::957::TaskManager.Task::(_decref) Task=`473c0cb3-c843-4a6e-a53b-bbc685e8bf2d`::ref 0 aborting False >Thread-744::DEBUG::2013-03-01 13:03:59,598::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-105::DEBUG::2013-03-01 13:03:59,607::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00487225 s, 841 kB/s\n'; <rc> = 0 >Thread-744::DEBUG::2013-03-01 13:03:59,661::task::568::TaskManager.Task::(_updateState) Task=`c8937021-966c-41af-ae3c-d3c3eaae3f32`::moving from state init -> state preparing >Thread-744::INFO::2013-03-01 13:03:59,710::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-744::DEBUG::2013-03-01 13:03:59,772::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`19a05c76-5f02-4c0d-bc0d-8f2afe2d270c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-744::DEBUG::2013-03-01 13:03:59,792::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-744::DEBUG::2013-03-01 13:03:59,831::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-744::DEBUG::2013-03-01 13:03:59,856::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`19a05c76-5f02-4c0d-bc0d-8f2afe2d270c`::Granted request >Thread-744::DEBUG::2013-03-01 13:03:59,938::task::794::TaskManager.Task::(resourceAcquired) Task=`c8937021-966c-41af-ae3c-d3c3eaae3f32`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-744::DEBUG::2013-03-01 13:03:59,943::task::957::TaskManager.Task::(_decref) Task=`c8937021-966c-41af-ae3c-d3c3eaae3f32`::ref 1 aborting False >Thread-744::INFO::2013-03-01 13:03:59,956::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-744::DEBUG::2013-03-01 13:03:59,958::task::1151::TaskManager.Task::(prepare) Task=`c8937021-966c-41af-ae3c-d3c3eaae3f32`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-744::DEBUG::2013-03-01 13:03:59,960::task::568::TaskManager.Task::(_updateState) Task=`c8937021-966c-41af-ae3c-d3c3eaae3f32`::moving from state preparing -> state finished >Thread-744::DEBUG::2013-03-01 13:03:59,961::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-744::DEBUG::2013-03-01 13:03:59,963::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-744::DEBUG::2013-03-01 13:03:59,965::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-744::DEBUG::2013-03-01 13:03:59,967::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-744::DEBUG::2013-03-01 13:03:59,969::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-744::DEBUG::2013-03-01 13:03:59,970::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-744::DEBUG::2013-03-01 13:03:59,973::task::957::TaskManager.Task::(_decref) Task=`c8937021-966c-41af-ae3c-d3c3eaae3f32`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:04:00,039::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.2307 s, 832 kB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,470::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,471::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,471::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,471::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,472::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::INFO::2013-03-01 13:04:00,472::blockVolume::182::Storage.Volume::(_create) Request to create snapshot a178bac1-309b-4737-846b-0b43463f11b7/c517d142-d8c1-4f81-927b-d95764a45afa of volume a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,473::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,484::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,495::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031685 s, 1.6 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,495::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031685 s, 1.6 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,496::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,506::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000317512 s, 1.6 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,506::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000317512 s, 1.6 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::INFO::2013-03-01 13:04:00,507::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,508::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,518::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000301891 s, 1.7 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,518::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000301891 s, 1.7 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,519::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`23f9b483-5f6e-4772-abbb-147eb66cc25c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,519::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' for lock type 'shared' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:00,521::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:02,047::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:02,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425016 s, 24.1 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,190::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,191::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,197::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,198::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' is free. Now locking as 'shared' (1 active user) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,198::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`23f9b483-5f6e-4772-abbb-147eb66cc25c`::Granted request >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,199::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,200::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,410::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,423::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,423::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/c517d142-d8c1-4f81-927b-d95764a45afa >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,424::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,433::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00028032 s, 1.8 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,434::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00028032 s, 1.8 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,434::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,444::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000312123 s, 1.6 MB/s\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,445::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000312123 s, 1.6 MB/s'], size: 512 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,445::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/c517d142-d8c1-4f81-927b-d95764a45afa' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::INFO::2013-03-01 13:04:02,460::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727 justme False >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,460::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,460::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' (0 active users) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,461::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' is free, finding out if anyone is waiting for it. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,663::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,664::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,664::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,664::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727', Clearing records. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,665::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,665::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,852::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,864::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,865::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:02,866::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,069::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::WARNING::2013-03-01 13:04:03,069::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/c517d142-d8c1-4f81-927b-d95764a45afa >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,070::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 8 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,071::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_46e8b230-ef40-4738-aed4-250016777727 --addtag IU_a178bac1-309b-4737-846b-0b43463f11b7 --addtag MD_8 a558fc2a-a4a3-4118-9b81-d1d601eaa295/c517d142-d8c1-4f81-927b-d95764a45afa' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,275::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,276::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,276::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,277::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/c517d142-d8c1-4f81-927b-d95764a45afa' (cwd None) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,483::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,483::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,483::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,484::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,496::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=c517d142-d8c1-4f81-927b-d95764a45afa sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,504::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,516::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,516::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' (0 active users) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,516::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' is free, finding out if anyone is waiting for it. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,517::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,517::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' (0 active users) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,517::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' is free, finding out if anyone is waiting for it. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,517::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727', Clearing records. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,517::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7', Clearing records. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,518::task::568::TaskManager.Task::(_updateState) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::moving from state running -> state finished >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,518::task::719::TaskManager.Task::(_save) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/20e4f56a-2b74-4cc9-bf1e-7f19f42835b9.temp >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,526::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,526::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,526::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,527::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,527::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,527::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,527::task::880::TaskManager.Task::(_runJobs) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::Task.run: exit - success: result {'uuid': 'c517d142-d8c1-4f81-927b-d95764a45afa'} >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,528::task::957::TaskManager.Task::(_decref) Task=`20e4f56a-2b74-4cc9-bf1e-7f19f42835b9`::ref 0 aborting False >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:03,528::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:04:04,148::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:04,247::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463965 s, 22.1 MB/s\n'; <rc> = 0 >Thread-747::DEBUG::2013-03-01 13:04:05,831::task::568::TaskManager.Task::(_updateState) Task=`aca7a49e-d530-4c92-9dff-73295eeb8ca1`::moving from state init -> state preparing >Thread-747::INFO::2013-03-01 13:04:05,831::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-747::INFO::2013-03-01 13:04:05,832::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.279886960983', 'lastCheck': '8.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.838965892792', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-747::DEBUG::2013-03-01 13:04:05,832::task::1151::TaskManager.Task::(prepare) Task=`aca7a49e-d530-4c92-9dff-73295eeb8ca1`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.279886960983', 'lastCheck': '8.0', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.838965892792', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-747::DEBUG::2013-03-01 13:04:05,832::task::568::TaskManager.Task::(_updateState) Task=`aca7a49e-d530-4c92-9dff-73295eeb8ca1`::moving from state preparing -> state finished >Thread-747::DEBUG::2013-03-01 13:04:05,832::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-747::DEBUG::2013-03-01 13:04:05,833::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-747::DEBUG::2013-03-01 13:04:05,833::task::957::TaskManager.Task::(_decref) Task=`aca7a49e-d530-4c92-9dff-73295eeb8ca1`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:04:06,260::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:06,365::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383774 s, 26.7 MB/s\n'; <rc> = 0 >Thread-749::DEBUG::2013-03-01 13:04:06,584::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-749::DEBUG::2013-03-01 13:04:06,585::task::568::TaskManager.Task::(_updateState) Task=`6e656d51-73f2-4138-b9e2-104a86fd6103`::moving from state init -> state preparing >Thread-749::INFO::2013-03-01 13:04:06,585::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-749::DEBUG::2013-03-01 13:04:06,586::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-749::DEBUG::2013-03-01 13:04:06,586::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >Thread-749::DEBUG::2013-03-01 13:04:06,586::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'} >Thread-749::DEBUG::2013-03-01 13:04:06,586::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'20e4f56a-2b74-4cc9-bf1e-7f19f42835b9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'}} >Thread-749::INFO::2013-03-01 13:04:06,587::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'20e4f56a-2b74-4cc9-bf1e-7f19f42835b9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'}}} >Thread-749::DEBUG::2013-03-01 13:04:06,587::task::1151::TaskManager.Task::(prepare) Task=`6e656d51-73f2-4138-b9e2-104a86fd6103`::finished: {'allTasksStatus': {'20e4f56a-2b74-4cc9-bf1e-7f19f42835b9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '20e4f56a-2b74-4cc9-bf1e-7f19f42835b9'}}} >Thread-749::DEBUG::2013-03-01 13:04:06,587::task::568::TaskManager.Task::(_updateState) Task=`6e656d51-73f2-4138-b9e2-104a86fd6103`::moving from state preparing -> state finished >Thread-749::DEBUG::2013-03-01 13:04:06,588::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-749::DEBUG::2013-03-01 13:04:06,588::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-749::DEBUG::2013-03-01 13:04:06,588::task::957::TaskManager.Task::(_decref) Task=`6e656d51-73f2-4138-b9e2-104a86fd6103`::ref 0 aborting False >Thread-750::DEBUG::2013-03-01 13:04:06,638::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-750::DEBUG::2013-03-01 13:04:06,639::task::568::TaskManager.Task::(_updateState) Task=`56ee1895-04aa-4eec-b56c-bbabb19d09d2`::moving from state init -> state preparing >Thread-750::INFO::2013-03-01 13:04:06,639::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', volUUID='c517d142-d8c1-4f81-927b-d95764a45afa', options=None) >Thread-750::DEBUG::2013-03-01 13:04:06,640::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ab381e5f-19fd-4b33-a164-b3973f6113c5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-750::DEBUG::2013-03-01 13:04:06,640::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-750::DEBUG::2013-03-01 13:04:06,641::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-750::DEBUG::2013-03-01 13:04:06,641::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ab381e5f-19fd-4b33-a164-b3973f6113c5`::Granted request >Thread-750::DEBUG::2013-03-01 13:04:06,642::task::794::TaskManager.Task::(resourceAcquired) Task=`56ee1895-04aa-4eec-b56c-bbabb19d09d2`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-750::DEBUG::2013-03-01 13:04:06,642::task::957::TaskManager.Task::(_decref) Task=`56ee1895-04aa-4eec-b56c-bbabb19d09d2`::ref 1 aborting False >Thread-750::DEBUG::2013-03-01 13:04:06,643::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-750::DEBUG::2013-03-01 13:04:06,644::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-750::DEBUG::2013-03-01 13:04:06,849::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-750::DEBUG::2013-03-01 13:04:06,861::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-750::INFO::2013-03-01 13:04:06,862::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 volUUID = c517d142-d8c1-4f81-927b-d95764a45afa >Thread-750::DEBUG::2013-03-01 13:04:06,862::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-750::DEBUG::2013-03-01 13:04:06,872::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000314037 s, 1.6 MB/s\n'; <rc> = 0 >Thread-750::DEBUG::2013-03-01 13:04:06,873::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000314037 s, 1.6 MB/s'], size: 512 >Thread-750::DEBUG::2013-03-01 13:04:06,874::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-750::DEBUG::2013-03-01 13:04:06,883::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308955 s, 1.7 MB/s\n'; <rc> = 0 >Thread-750::DEBUG::2013-03-01 13:04:06,884::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308955 s, 1.7 MB/s'], size: 512 >Thread-750::DEBUG::2013-03-01 13:04:06,884::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-750::DEBUG::2013-03-01 13:04:06,885::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-750::DEBUG::2013-03-01 13:04:07,129::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-750::DEBUG::2013-03-01 13:04:07,144::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-750::INFO::2013-03-01 13:04:07,145::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/a178bac1-309b-4737-846b-0b43463f11b7/c517d142-d8c1-4f81-927b-d95764a45afa info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '46e8b230-ef40-4738-aed4-250016777727', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135843', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135843', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'c517d142-d8c1-4f81-927b-d95764a45afa', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-750::INFO::2013-03-01 13:04:07,145::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '46e8b230-ef40-4738-aed4-250016777727', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135843', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135843', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'c517d142-d8c1-4f81-927b-d95764a45afa', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-750::DEBUG::2013-03-01 13:04:07,146::task::1151::TaskManager.Task::(prepare) Task=`56ee1895-04aa-4eec-b56c-bbabb19d09d2`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '46e8b230-ef40-4738-aed4-250016777727', 'format': 'COW', 'image': 'a178bac1-309b-4737-846b-0b43463f11b7', 'ctime': '1362135843', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135843', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'c517d142-d8c1-4f81-927b-d95764a45afa', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-750::DEBUG::2013-03-01 13:04:07,146::task::568::TaskManager.Task::(_updateState) Task=`56ee1895-04aa-4eec-b56c-bbabb19d09d2`::moving from state preparing -> state finished >Thread-750::DEBUG::2013-03-01 13:04:07,146::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-750::DEBUG::2013-03-01 13:04:07,147::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-750::DEBUG::2013-03-01 13:04:07,147::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-750::DEBUG::2013-03-01 13:04:07,147::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-750::DEBUG::2013-03-01 13:04:07,148::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-750::DEBUG::2013-03-01 13:04:07,148::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-750::DEBUG::2013-03-01 13:04:07,148::task::957::TaskManager.Task::(_decref) Task=`56ee1895-04aa-4eec-b56c-bbabb19d09d2`::ref 0 aborting False >Thread-751::DEBUG::2013-03-01 13:04:07,197::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-751::DEBUG::2013-03-01 13:04:07,198::task::568::TaskManager.Task::(_updateState) Task=`d800a32f-bcdf-4ca9-a87a-7cd7f71d07b9`::moving from state init -> state preparing >Thread-751::INFO::2013-03-01 13:04:07,198::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='20e4f56a-2b74-4cc9-bf1e-7f19f42835b9', spUUID=None, options=None) >Thread-751::DEBUG::2013-03-01 13:04:07,198::taskManager::161::TaskManager::(clearTask) Entry. taskID: 20e4f56a-2b74-4cc9-bf1e-7f19f42835b9 >Thread-751::DEBUG::2013-03-01 13:04:07,200::taskManager::166::TaskManager::(clearTask) Return. >Thread-751::INFO::2013-03-01 13:04:07,201::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-751::DEBUG::2013-03-01 13:04:07,201::task::1151::TaskManager.Task::(prepare) Task=`d800a32f-bcdf-4ca9-a87a-7cd7f71d07b9`::finished: None >Thread-751::DEBUG::2013-03-01 13:04:07,201::task::568::TaskManager.Task::(_updateState) Task=`d800a32f-bcdf-4ca9-a87a-7cd7f71d07b9`::moving from state preparing -> state finished >Thread-751::DEBUG::2013-03-01 13:04:07,201::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-751::DEBUG::2013-03-01 13:04:07,202::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-751::DEBUG::2013-03-01 13:04:07,202::task::957::TaskManager.Task::(_decref) Task=`d800a32f-bcdf-4ca9-a87a-7cd7f71d07b9`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:04:07,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:07,868::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000300408 s, 13.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:08,385::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:08,497::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468988 s, 21.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:09,953::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:09,954::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-753::DEBUG::2013-03-01 13:04:10,015::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-753::DEBUG::2013-03-01 13:04:10,016::task::568::TaskManager.Task::(_updateState) Task=`688182cb-0bcf-4a33-96f7-b92bbf3557a8`::moving from state init -> state preparing >Thread-753::INFO::2013-03-01 13:04:10,016::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-753::INFO::2013-03-01 13:04:10,017::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-753::DEBUG::2013-03-01 13:04:10,017::task::1151::TaskManager.Task::(prepare) Task=`688182cb-0bcf-4a33-96f7-b92bbf3557a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-753::DEBUG::2013-03-01 13:04:10,018::task::568::TaskManager.Task::(_updateState) Task=`688182cb-0bcf-4a33-96f7-b92bbf3557a8`::moving from state preparing -> state finished >Thread-753::DEBUG::2013-03-01 13:04:10,018::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-753::DEBUG::2013-03-01 13:04:10,018::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-753::DEBUG::2013-03-01 13:04:10,018::task::957::TaskManager.Task::(_decref) Task=`688182cb-0bcf-4a33-96f7-b92bbf3557a8`::ref 0 aborting False >Thread-754::DEBUG::2013-03-01 13:04:10,043::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-754::DEBUG::2013-03-01 13:04:10,043::task::568::TaskManager.Task::(_updateState) Task=`e14168ee-b9f2-4845-a2cc-e907a02974a9`::moving from state init -> state preparing >Thread-754::INFO::2013-03-01 13:04:10,043::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-754::DEBUG::2013-03-01 13:04:10,044::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`829bcd59-4dc9-4368-a137-9ed6d56182e4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-754::DEBUG::2013-03-01 13:04:10,044::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-754::DEBUG::2013-03-01 13:04:10,045::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-754::DEBUG::2013-03-01 13:04:10,045::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`829bcd59-4dc9-4368-a137-9ed6d56182e4`::Granted request >Thread-754::DEBUG::2013-03-01 13:04:10,045::task::794::TaskManager.Task::(resourceAcquired) Task=`e14168ee-b9f2-4845-a2cc-e907a02974a9`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-754::DEBUG::2013-03-01 13:04:10,046::task::957::TaskManager.Task::(_decref) Task=`e14168ee-b9f2-4845-a2cc-e907a02974a9`::ref 1 aborting False >Thread-754::DEBUG::2013-03-01 13:04:10,046::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-754::DEBUG::2013-03-01 13:04:10,047::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-754::DEBUG::2013-03-01 13:04:10,286::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-754::INFO::2013-03-01 13:04:10,289::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-754::DEBUG::2013-03-01 13:04:10,289::task::1151::TaskManager.Task::(prepare) Task=`e14168ee-b9f2-4845-a2cc-e907a02974a9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-754::DEBUG::2013-03-01 13:04:10,290::task::568::TaskManager.Task::(_updateState) Task=`e14168ee-b9f2-4845-a2cc-e907a02974a9`::moving from state preparing -> state finished >Thread-754::DEBUG::2013-03-01 13:04:10,290::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-754::DEBUG::2013-03-01 13:04:10,292::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2013-03-01 13:04:10,293::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-754::DEBUG::2013-03-01 13:04:10,294::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-754::DEBUG::2013-03-01 13:04:10,296::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-105::DEBUG::2013-03-01 13:04:10,297::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-754::DEBUG::2013-03-01 13:04:10,297::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-754::DEBUG::2013-03-01 13:04:10,299::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-105::DEBUG::2013-03-01 13:04:10,300::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-754::DEBUG::2013-03-01 13:04:10,310::task::957::TaskManager.Task::(_decref) Task=`e14168ee-b9f2-4845-a2cc-e907a02974a9`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:04:10,322::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000398698 s, 10.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:10,520::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:11,875::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.552237 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:14,124::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:14,217::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376212 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:16,231::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:16,333::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379077 s, 27.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:04:17,872::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:17,882::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000377261 s, 10.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:18,352::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:18,455::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382078 s, 26.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:20,329::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-105::DEBUG::2013-03-01 13:04:20,329::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-105::DEBUG::2013-03-01 13:04:20,330::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:04:20,343::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000341411 s, 6.0 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:20,344::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000341411 s, 6.0 MB/s'], size: 2048 >Thread-105::DEBUG::2013-03-01 13:04:20,344::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-105::WARNING::2013-03-01 13:04:20,344::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-105::DEBUG::2013-03-01 13:04:20,346::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-105::DEBUG::2013-03-01 13:04:20,347::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:20,347::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:20,348::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:20,349::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:20,349::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:20,351::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-758::DEBUG::2013-03-01 13:04:20,363::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-758::DEBUG::2013-03-01 13:04:20,364::task::568::TaskManager.Task::(_updateState) Task=`298c2988-a8ca-4b93-a573-bf4ac20ea4d4`::moving from state init -> state preparing >Thread-758::INFO::2013-03-01 13:04:20,364::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Dummy-173::DEBUG::2013-03-01 13:04:20,475::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:20,582::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461367 s, 22.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:20,595::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:20,598::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:04:20,599::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-105::WARNING::2013-03-01 13:04:20,602::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-105::WARNING::2013-03-01 13:04:20,603::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-105::WARNING::2013-03-01 13:04:20,604::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-758::INFO::2013-03-01 13:04:20,606::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-758::DEBUG::2013-03-01 13:04:20,608::task::1151::TaskManager.Task::(prepare) Task=`298c2988-a8ca-4b93-a573-bf4ac20ea4d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-758::DEBUG::2013-03-01 13:04:20,609::task::568::TaskManager.Task::(_updateState) Task=`298c2988-a8ca-4b93-a573-bf4ac20ea4d4`::moving from state preparing -> state finished >Thread-758::DEBUG::2013-03-01 13:04:20,610::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-758::DEBUG::2013-03-01 13:04:20,611::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-758::DEBUG::2013-03-01 13:04:20,613::task::957::TaskManager.Task::(_decref) Task=`298c2988-a8ca-4b93-a573-bf4ac20ea4d4`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:04:20,616::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-759::DEBUG::2013-03-01 13:04:20,648::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-759::DEBUG::2013-03-01 13:04:20,649::task::568::TaskManager.Task::(_updateState) Task=`0b7ac0e5-0508-42f7-97af-c4656b90fe38`::moving from state init -> state preparing >Thread-759::INFO::2013-03-01 13:04:20,650::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-759::DEBUG::2013-03-01 13:04:20,650::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`23e82bac-a44b-4fde-aa94-ebe7f87ca6b6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-759::DEBUG::2013-03-01 13:04:20,651::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-759::DEBUG::2013-03-01 13:04:20,651::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-759::DEBUG::2013-03-01 13:04:20,651::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`23e82bac-a44b-4fde-aa94-ebe7f87ca6b6`::Granted request >Thread-759::DEBUG::2013-03-01 13:04:20,652::task::794::TaskManager.Task::(resourceAcquired) Task=`0b7ac0e5-0508-42f7-97af-c4656b90fe38`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-759::DEBUG::2013-03-01 13:04:20,652::task::957::TaskManager.Task::(_decref) Task=`0b7ac0e5-0508-42f7-97af-c4656b90fe38`::ref 1 aborting False >Thread-759::INFO::2013-03-01 13:04:20,654::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-759::DEBUG::2013-03-01 13:04:20,654::task::1151::TaskManager.Task::(prepare) Task=`0b7ac0e5-0508-42f7-97af-c4656b90fe38`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-759::DEBUG::2013-03-01 13:04:20,655::task::568::TaskManager.Task::(_updateState) Task=`0b7ac0e5-0508-42f7-97af-c4656b90fe38`::moving from state preparing -> state finished >Thread-759::DEBUG::2013-03-01 13:04:20,655::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-759::DEBUG::2013-03-01 13:04:20,655::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-759::DEBUG::2013-03-01 13:04:20,656::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-759::DEBUG::2013-03-01 13:04:20,656::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-759::DEBUG::2013-03-01 13:04:20,656::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-759::DEBUG::2013-03-01 13:04:20,657::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-759::DEBUG::2013-03-01 13:04:20,657::task::957::TaskManager.Task::(_decref) Task=`0b7ac0e5-0508-42f7-97af-c4656b90fe38`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:04:20,860::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:20,860::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:04:20,873::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000370022 s, 11.1 MB/s\n'; <rc> = 0 >Thread-760::DEBUG::2013-03-01 13:04:21,178::task::568::TaskManager.Task::(_updateState) Task=`48f366fe-7d40-41dd-9376-e1155575267c`::moving from state init -> state preparing >Thread-760::INFO::2013-03-01 13:04:21,178::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-760::INFO::2013-03-01 13:04:21,178::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106990337372', 'lastCheck': '3.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131189823151', 'lastCheck': '0.3', 'code': 0, 'valid': True}} >Thread-760::DEBUG::2013-03-01 13:04:21,179::task::1151::TaskManager.Task::(prepare) Task=`48f366fe-7d40-41dd-9376-e1155575267c`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0106990337372', 'lastCheck': '3.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131189823151', 'lastCheck': '0.3', 'code': 0, 'valid': True}} >Thread-760::DEBUG::2013-03-01 13:04:21,179::task::568::TaskManager.Task::(_updateState) Task=`48f366fe-7d40-41dd-9376-e1155575267c`::moving from state preparing -> state finished >Thread-760::DEBUG::2013-03-01 13:04:21,179::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-760::DEBUG::2013-03-01 13:04:21,179::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-760::DEBUG::2013-03-01 13:04:21,180::task::957::TaskManager.Task::(_decref) Task=`48f366fe-7d40-41dd-9376-e1155575267c`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:04:22,629::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:22,729::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387569 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:24,748::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:24,851::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387748 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:26,871::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:26,985::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489662 s, 20.9 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:04:27,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:28,073::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00502558 s, 815 kB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:28,437::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-764::DEBUG::2013-03-01 13:04:28,447::task::568::TaskManager.Task::(_updateState) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::moving from state init -> state preparing >Thread-764::INFO::2013-03-01 13:04:28,453::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='a178bac1-309b-4737-846b-0b43463f11b7', srcVolUUID='46e8b230-ef40-4738-aed4-250016777727', dstImgUUID='9d2cd1d4-c395-4299-9840-65d1af86acc0', dstVolUUID='c1aea8aa-b030-4379-b2da-a4f4aee5a6be', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-764::INFO::2013-03-01 13:04:28,457::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-764::DEBUG::2013-03-01 13:04:28,465::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:29,011::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:29,612::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.397884 s, 2.6 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:29,662::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:29,663::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,663::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,663::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,664::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,664::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,665::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:29,872::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:29,875::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,875::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-764::DEBUG::2013-03-01 13:04:29,877::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:29,878::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,071::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,085::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-764::INFO::2013-03-01 13:04:30,085::image::458::Storage.Image::(isLegal) image a178bac1-309b-4737-846b-0b43463f11b7 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['c517d142-d8c1-4f81-927b-d95764a45afa', '46e8b230-ef40-4738-aed4-250016777727'] >Thread-764::DEBUG::2013-03-01 13:04:30,086::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,096::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000307022 s, 1.7 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,097::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000307022 s, 1.7 MB/s'], size: 512 >Thread-764::DEBUG::2013-03-01 13:04:30,097::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,107::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339774 s, 1.5 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,108::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339774 s, 1.5 MB/s'], size: 512 >Thread-764::DEBUG::2013-03-01 13:04:30,109::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,118::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000360674 s, 1.4 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,119::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000360674 s, 1.4 MB/s'], size: 512 >Thread-764::DEBUG::2013-03-01 13:04:30,120::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,130::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000352677 s, 1.5 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,130::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000352677 s, 1.5 MB/s'], size: 512 >Thread-764::DEBUG::2013-03-01 13:04:30,131::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:30,132::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,376::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,388::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-764::DEBUG::2013-03-01 13:04:30,388::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,398::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031042 s, 1.6 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,398::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031042 s, 1.6 MB/s'], size: 512 >Thread-764::DEBUG::2013-03-01 13:04:30,399::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-764::DEBUG::2013-03-01 13:04:30,409::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000331092 s, 1.5 MB/s\n'; <rc> = 0 >Thread-764::DEBUG::2013-03-01 13:04:30,410::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000331092 s, 1.5 MB/s'], size: 512 >Thread-764::INFO::2013-03-01 13:04:30,410::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 chain=[<storage.blockVolume.BlockVolume object at 0x7f15c0295990>, <storage.blockVolume.BlockVolume object at 0x7f15f0080610>] >Thread-764::DEBUG::2013-03-01 13:04:30,411::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`0ebf7970-cff3-4b53-a6c8-bba0e1b1da44`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-764::DEBUG::2013-03-01 13:04:30,411::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-764::DEBUG::2013-03-01 13:04:30,412::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-764::DEBUG::2013-03-01 13:04:30,412::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`0ebf7970-cff3-4b53-a6c8-bba0e1b1da44`::Granted request >Thread-764::DEBUG::2013-03-01 13:04:30,413::task::794::TaskManager.Task::(resourceAcquired) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-764::DEBUG::2013-03-01 13:04:30,413::task::957::TaskManager.Task::(_decref) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::ref 1 aborting False >Thread-764::DEBUG::2013-03-01 13:04:30,415::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >Thread-764::DEBUG::2013-03-01 13:04:30,423::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_9d2cd1d4-c395-4299-9840-65d1af86acc0 for task 960462ff-13ef-4792-9b10-fec2943aa7ab >Thread-764::INFO::2013-03-01 13:04:30,423::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-764::DEBUG::2013-03-01 13:04:30,423::task::1146::TaskManager.Task::(prepare) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::Prepare: 1 jobs exist, move to acquiring >Thread-764::DEBUG::2013-03-01 13:04:30,423::task::568::TaskManager.Task::(_updateState) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::moving from state preparing -> state acquiring >Thread-764::DEBUG::2013-03-01 13:04:30,424::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >Thread-764::DEBUG::2013-03-01 13:04:30,432::task::568::TaskManager.Task::(_updateState) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::moving from state acquiring -> state queued >Thread-764::DEBUG::2013-03-01 13:04:30,432::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >Thread-764::DEBUG::2013-03-01 13:04:30,440::taskManager::50::TaskManager::(_queueTask) queuing task: 960462ff-13ef-4792-9b10-fec2943aa7ab >Thread-764::DEBUG::2013-03-01 13:04:30,441::taskManager::56::TaskManager::(_queueTask) task queued: 960462ff-13ef-4792-9b10-fec2943aa7ab >20e4f56a-2b74-4cc9-bf1e-7f19f42835b9::DEBUG::2013-03-01 13:04:30,441::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-764::DEBUG::2013-03-01 13:04:30,443::task::1148::TaskManager.Task::(prepare) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::returning >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,443::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 960462ff-13ef-4792-9b10-fec2943aa7ab running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c012d098>> with: None >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,445::task::1159::TaskManager.Task::(commit) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::committing task: 960462ff-13ef-4792-9b10-fec2943aa7ab >Thread-764::DEBUG::2013-03-01 13:04:30,445::task::957::TaskManager.Task::(_decref) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::ref 0 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,449::task::568::TaskManager.Task::(_updateState) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::moving from state queued -> state running >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,457::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,468::task::872::TaskManager.Task::(_runJobs) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::Task.run: running job 0: copyImage_9d2cd1d4-c395-4299-9840-65d1af86acc0: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'a178bac1-309b-4737-846b-0b43463f11b7', '46e8b230-ef40-4738-aed4-250016777727', '9d2cd1d4-c395-4299-9840-65d1af86acc0', 'c1aea8aa-b030-4379-b2da-a4f4aee5a6be', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,468::task::304::TaskManager.Task::(run) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::Job.run: running copyImage_9d2cd1d4-c395-4299-9840-65d1af86acc0: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', 'a178bac1-309b-4737-846b-0b43463f11b7', '46e8b230-ef40-4738-aed4-250016777727', '9d2cd1d4-c395-4299-9840-65d1af86acc0', 'c1aea8aa-b030-4379-b2da-a4f4aee5a6be', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,469::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`b6721619-3072-4f7d-954f-b96af987c529`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,469::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' for lock type 'shared' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,470::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,471::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-766::DEBUG::2013-03-01 13:04:30,708::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-766::DEBUG::2013-03-01 13:04:30,709::task::568::TaskManager.Task::(_updateState) Task=`875b6b17-598d-475f-a8ab-f8fd5d9a29b8`::moving from state init -> state preparing >Thread-766::INFO::2013-03-01 13:04:30,709::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-766::INFO::2013-03-01 13:04:30,710::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-766::DEBUG::2013-03-01 13:04:30,710::task::1151::TaskManager.Task::(prepare) Task=`875b6b17-598d-475f-a8ab-f8fd5d9a29b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-766::DEBUG::2013-03-01 13:04:30,711::task::568::TaskManager.Task::(_updateState) Task=`875b6b17-598d-475f-a8ab-f8fd5d9a29b8`::moving from state preparing -> state finished >Thread-766::DEBUG::2013-03-01 13:04:30,711::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-766::DEBUG::2013-03-01 13:04:30,711::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-766::DEBUG::2013-03-01 13:04:30,712::task::957::TaskManager.Task::(_decref) Task=`875b6b17-598d-475f-a8ab-f8fd5d9a29b8`::ref 0 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,719::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,729::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,729::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,740::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000290806 s, 1.8 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,740::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000290806 s, 1.8 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,741::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-767::DEBUG::2013-03-01 13:04:30,755::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-767::DEBUG::2013-03-01 13:04:30,760::task::568::TaskManager.Task::(_updateState) Task=`9554a382-4abe-460a-8f2b-b4611360693a`::moving from state init -> state preparing >Thread-767::INFO::2013-03-01 13:04:30,764::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,767::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00030644 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,769::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00030644 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:30,771::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=a178bac1-309b-4737-846b-0b43463f11b7 chain=[<storage.blockVolume.BlockVolume object at 0x7f15e00be810>, <storage.blockVolume.BlockVolume object at 0x7f15ec132910>] >Thread-767::DEBUG::2013-03-01 13:04:30,771::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b80e2eee-d74e-40dd-9341-8bd76bb1585d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,774::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`2c417937-3948-4b21-b901-5ec8e3fb5abf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-767::DEBUG::2013-03-01 13:04:30,774::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,776::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' for lock type 'shared' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,778::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' is free. Now locking as 'shared' (1 active user) >Thread-767::DEBUG::2013-03-01 13:04:30,779::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,779::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`2c417937-3948-4b21-b901-5ec8e3fb5abf`::Granted request >Thread-767::DEBUG::2013-03-01 13:04:30,781::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b80e2eee-d74e-40dd-9341-8bd76bb1585d`::Granted request >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,785::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa`ReqID=`20cc3883-41db-4722-a6b9-becd2b50a862`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-767::DEBUG::2013-03-01 13:04:30,786::task::794::TaskManager.Task::(resourceAcquired) Task=`9554a382-4abe-460a-8f2b-b4611360693a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,787::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa' for lock type 'shared' >Thread-767::DEBUG::2013-03-01 13:04:30,788::task::957::TaskManager.Task::(_decref) Task=`9554a382-4abe-460a-8f2b-b4611360693a`::ref 1 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,790::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa' is free. Now locking as 'shared' (1 active user) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,793::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa`ReqID=`20cc3883-41db-4722-a6b9-becd2b50a862`::Granted request >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,798::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' is free. Now locking as 'shared' (1 active user) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,800::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`b6721619-3072-4f7d-954f-b96af987c529`::Granted request >Thread-767::INFO::2013-03-01 13:04:30,801::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-767::DEBUG::2013-03-01 13:04:30,803::task::1151::TaskManager.Task::(prepare) Task=`9554a382-4abe-460a-8f2b-b4611360693a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-767::DEBUG::2013-03-01 13:04:30,805::task::568::TaskManager.Task::(_updateState) Task=`9554a382-4abe-460a-8f2b-b4611360693a`::moving from state preparing -> state finished >Thread-767::DEBUG::2013-03-01 13:04:30,808::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,808::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0`ReqID=`1863a15e-44da-4015-acf3-c9d82624b5c1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-767::DEBUG::2013-03-01 13:04:30,809::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,810::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0' for lock type 'exclusive' >Thread-767::DEBUG::2013-03-01 13:04:30,813::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-767::DEBUG::2013-03-01 13:04:30,815::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,816::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-767::DEBUG::2013-03-01 13:04:30,817::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-767::DEBUG::2013-03-01 13:04:30,819::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-767::DEBUG::2013-03-01 13:04:30,822::task::957::TaskManager.Task::(_decref) Task=`9554a382-4abe-460a-8f2b-b4611360693a`::ref 0 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:30,826::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:04:30,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:04:30,892::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000368997 s, 11.1 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,071::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,084::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,085::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 9d2cd1d4-c395-4299-9840-65d1af86acc0 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,085::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0' is free. Now locking as 'exclusive' (1 active user) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,085::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0`ReqID=`1863a15e-44da-4015-acf3-c9d82624b5c1`::Granted request >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:31,086::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=a178bac1-309b-4737-846b-0b43463f11b7 srcVolUUID=46e8b230-ef40-4738-aed4-250016777727 dstImgUUID=9d2cd1d4-c395-4299-9840-65d1af86acc0 dstVolUUID=c1aea8aa-b030-4379-b2da-a4f4aee5a6be dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,096::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311368 s, 1.6 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,097::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311368 s, 1.6 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,097::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,107::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000319775 s, 1.6 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,108::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000319775 s, 1.6 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,108::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,118::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000376579 s, 1.4 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,119::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000376579 s, 1.4 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,119::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,129::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297172 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,130::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297172 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,131::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,140::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000297781 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,141::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000297781 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,141::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,151::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000296408 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,152::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000296408 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:31,152::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:a178bac1-309b-4737-846b-0b43463f11b7:46e8b230-ef40-4738-aed4-250016777727 vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:9d2cd1d4-c395-4299-9840-65d1af86acc0:c1aea8aa-b030-4379-b2da-a4f4aee5a6be apparentsize 2097152 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,153::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,400::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,411::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:31,411::image::458::Storage.Image::(isLegal) image 9d2cd1d4-c395-4299-9840-65d1af86acc0 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:31,411::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0 for image's volumes >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,412::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,420::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,421::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:31,626::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,675::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,708::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::WARNING::2013-03-01 13:04:31,710::lvm::593::Storage.LVM::(getLv) lv: c1aea8aa-b030-4379-b2da-a4f4aee5a6be not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:31,712::volume::457::Storage.Volume::(create) Creating volume c1aea8aa-b030-4379-b2da-a4f4aee5a6be >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,716::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,756::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:31,803::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name c1aea8aa-b030-4379-b2da-a4f4aee5a6be a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:31,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.086847 s, 11.8 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,522::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,523::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,523::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,524::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,524::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:33,525::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be with size = 20480 sectors >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,525::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be 10240K' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,537::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,538::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,539::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,793::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,805::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::WARNING::2013-03-01 13:04:33,806::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,806::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 9 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:33,807::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_9d2cd1d4-c395-4299-9840-65d1af86acc0 --addtag MD_9 a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:33,864::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:33,978::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493649 s, 20.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,066::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,067::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,067::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,068::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,328::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,329::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,329::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,330::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,343::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=c1aea8aa-b030-4379-b2da-a4f4aee5a6be sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 9) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,348::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,358::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,561::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,577::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:34,577::blockVolume::280::Storage.Volume::(extend) Request to extend LV c1aea8aa-b030-4379-b2da-a4f4aee5a6be of image 9d2cd1d4-c395-4299-9840-65d1af86acc0 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,578::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,769::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,773::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,783::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00032475 s, 1.6 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,784::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00032475 s, 1.6 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:34,785::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,785::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,796::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000304065 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,796::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000304065 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,797::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`f1e94171-90e5-4bf8-bdd2-50e98a66fc0e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,798::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' for lock type 'shared' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:34,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:35,998::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:36,098::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462119 s, 22.2 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,412::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,413::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,413::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,414::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' is free. Now locking as 'shared' (1 active user) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,414::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727`ReqID=`f1e94171-90e5-4bf8-bdd2-50e98a66fc0e`::Granted request >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,415::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,416::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-769::DEBUG::2013-03-01 13:04:36,523::task::568::TaskManager.Task::(_updateState) Task=`5830007d-2d0e-45d3-8bc0-b09e72cef5c6`::moving from state init -> state preparing >Thread-769::INFO::2013-03-01 13:04:36,523::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-769::INFO::2013-03-01 13:04:36,524::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.193519115448', 'lastCheck': '8.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0133328437805', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-769::DEBUG::2013-03-01 13:04:36,524::task::1151::TaskManager.Task::(prepare) Task=`5830007d-2d0e-45d3-8bc0-b09e72cef5c6`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.193519115448', 'lastCheck': '8.4', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0133328437805', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-769::DEBUG::2013-03-01 13:04:36,524::task::568::TaskManager.Task::(_updateState) Task=`5830007d-2d0e-45d3-8bc0-b09e72cef5c6`::moving from state preparing -> state finished >Thread-769::DEBUG::2013-03-01 13:04:36,524::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-769::DEBUG::2013-03-01 13:04:36,524::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-769::DEBUG::2013-03-01 13:04:36,525::task::957::TaskManager.Task::(_decref) Task=`5830007d-2d0e-45d3-8bc0-b09e72cef5c6`::ref 0 aborting False >Thread-771::DEBUG::2013-03-01 13:04:36,626::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-771::DEBUG::2013-03-01 13:04:36,626::task::568::TaskManager.Task::(_updateState) Task=`a8bf0b3a-3a11-4202-8339-78dbf43db673`::moving from state init -> state preparing >Thread-771::INFO::2013-03-01 13:04:36,627::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-771::DEBUG::2013-03-01 13:04:36,627::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-771::DEBUG::2013-03-01 13:04:36,627::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 960462ff-13ef-4792-9b10-fec2943aa7ab >Thread-771::DEBUG::2013-03-01 13:04:36,628::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'} >Thread-771::DEBUG::2013-03-01 13:04:36,628::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'960462ff-13ef-4792-9b10-fec2943aa7ab': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'}} >Thread-771::INFO::2013-03-01 13:04:36,629::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'960462ff-13ef-4792-9b10-fec2943aa7ab': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'}}} >Thread-771::DEBUG::2013-03-01 13:04:36,629::task::1151::TaskManager.Task::(prepare) Task=`a8bf0b3a-3a11-4202-8339-78dbf43db673`::finished: {'allTasksStatus': {'960462ff-13ef-4792-9b10-fec2943aa7ab': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'}}} >Thread-771::DEBUG::2013-03-01 13:04:36,629::task::568::TaskManager.Task::(_updateState) Task=`a8bf0b3a-3a11-4202-8339-78dbf43db673`::moving from state preparing -> state finished >Thread-771::DEBUG::2013-03-01 13:04:36,630::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-771::DEBUG::2013-03-01 13:04:36,630::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-771::DEBUG::2013-03-01 13:04:36,630::task::957::TaskManager.Task::(_decref) Task=`a8bf0b3a-3a11-4202-8339-78dbf43db673`::ref 0 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,658::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,673::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:36,673::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,684::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327179 s, 1.6 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,685::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327179 s, 1.6 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,685::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,695::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00029893 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,696::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00029893 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,697::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be`ReqID=`69e949e9-2850-4112-a9de-e9abaa889de5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,697::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be' for lock type 'exclusive' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:36,698::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:38,093::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:38,109::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:38,143::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000334697 s, 12.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:38,574::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469426 s, 21.8 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,712::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,722::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,728::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,732::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be' is free. Now locking as 'exclusive' (1 active user) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,736::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be`ReqID=`69e949e9-2850-4112-a9de-e9abaa889de5`::Granted request >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,748::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:40,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:40,780::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-773::DEBUG::2013-03-01 13:04:40,880::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-773::DEBUG::2013-03-01 13:04:40,884::task::568::TaskManager.Task::(_updateState) Task=`62a0c1a1-5d0b-47e0-b3c9-29395c7a7c02`::moving from state init -> state preparing >Thread-773::INFO::2013-03-01 13:04:40,886::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-773::INFO::2013-03-01 13:04:40,889::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-773::DEBUG::2013-03-01 13:04:40,890::task::1151::TaskManager.Task::(prepare) Task=`62a0c1a1-5d0b-47e0-b3c9-29395c7a7c02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-773::DEBUG::2013-03-01 13:04:40,891::task::568::TaskManager.Task::(_updateState) Task=`62a0c1a1-5d0b-47e0-b3c9-29395c7a7c02`::moving from state preparing -> state finished >Thread-773::DEBUG::2013-03-01 13:04:40,892::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-773::DEBUG::2013-03-01 13:04:40,894::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-773::DEBUG::2013-03-01 13:04:40,895::task::957::TaskManager.Task::(_decref) Task=`62a0c1a1-5d0b-47e0-b3c9-29395c7a7c02`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:04:40,900::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:04:40,909::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-774::DEBUG::2013-03-01 13:04:40,925::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-774::DEBUG::2013-03-01 13:04:40,927::task::568::TaskManager.Task::(_updateState) Task=`595edd88-c185-45f2-ab11-2e1302234ff5`::moving from state init -> state preparing >Thread-774::INFO::2013-03-01 13:04:40,929::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-774::DEBUG::2013-03-01 13:04:40,931::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`d4c2fee4-cea0-4c12-8ab5-6c4d76fae862`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-774::DEBUG::2013-03-01 13:04:40,932::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-774::DEBUG::2013-03-01 13:04:40,933::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-774::DEBUG::2013-03-01 13:04:40,935::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`d4c2fee4-cea0-4c12-8ab5-6c4d76fae862`::Granted request >Thread-774::DEBUG::2013-03-01 13:04:40,939::task::794::TaskManager.Task::(resourceAcquired) Task=`595edd88-c185-45f2-ab11-2e1302234ff5`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-774::DEBUG::2013-03-01 13:04:40,941::task::957::TaskManager.Task::(_decref) Task=`595edd88-c185-45f2-ab11-2e1302234ff5`::ref 1 aborting False >Thread-774::DEBUG::2013-03-01 13:04:40,946::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-774::DEBUG::2013-03-01 13:04:40,950::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:40,996::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739853 s, 13.8 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,014::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,044::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299933 s, 1.7 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,059::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299933 s, 1.7 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,062::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,075::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316722 s, 1.6 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,076::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316722 s, 1.6 MB/s'], size: 512 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,077::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be (qcow2) START >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,080::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:41,091::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >Thread-105::DEBUG::2013-03-01 13:04:41,280::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:41,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:04:41,293::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000337568 s, 12.1 MB/s\n'; <rc> = 0 >Thread-774::DEBUG::2013-03-01 13:04:41,305::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-774::DEBUG::2013-03-01 13:04:41,307::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-774::INFO::2013-03-01 13:04:41,308::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-774::DEBUG::2013-03-01 13:04:41,308::task::1151::TaskManager.Task::(prepare) Task=`595edd88-c185-45f2-ab11-2e1302234ff5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-774::DEBUG::2013-03-01 13:04:41,308::task::568::TaskManager.Task::(_updateState) Task=`595edd88-c185-45f2-ab11-2e1302234ff5`::moving from state preparing -> state finished >Thread-774::DEBUG::2013-03-01 13:04:41,308::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-774::DEBUG::2013-03-01 13:04:41,308::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-774::DEBUG::2013-03-01 13:04:41,309::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-774::DEBUG::2013-03-01 13:04:41,309::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-774::DEBUG::2013-03-01 13:04:41,309::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-774::DEBUG::2013-03-01 13:04:41,309::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-774::DEBUG::2013-03-01 13:04:41,310::task::957::TaskManager.Task::(_decref) Task=`595edd88-c185-45f2-ab11-2e1302234ff5`::ref 0 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,707::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,707::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/46e8b230-ef40-4738-aed4-250016777727 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be DONE >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:42,707::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:46e8b230-ef40-4738-aed4-250016777727 -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:c1aea8aa-b030-4379-b2da-a4f4aee5a6be >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:42,707::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727 justme False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,708::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,708::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,708::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,932::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,933::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,933::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,933::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.46e8b230-ef40-4738-aed4-250016777727', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,934::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:42,935::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:43,104::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,183::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,216::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::INFO::2013-03-01 13:04:43,218::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be justme False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,218::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,220::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,221::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,226::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:43,257::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455074 s, 22.5 MB/s\n'; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,433::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,434::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,434::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,435::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.c1aea8aa-b030-4379-b2da-a4f4aee5a6be', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,435::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,436::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,627::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,643::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,644::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,644::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,645::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,645::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.9d2cd1d4-c395-4299-9840-65d1af86acc0', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,645::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,646::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,646::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,646::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,647::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,647::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,647::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.46e8b230-ef40-4738-aed4-250016777727', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,648::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,648::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,648::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,648::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.c517d142-d8c1-4f81-927b-d95764a45afa', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,649::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.a178bac1-309b-4737-846b-0b43463f11b7', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,649::task::568::TaskManager.Task::(_updateState) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::moving from state running -> state finished >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,650::task::719::TaskManager.Task::(_save) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/960462ff-13ef-4792-9b10-fec2943aa7ab.temp >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,661::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,662::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,662::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,662::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,663::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,663::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,663::task::880::TaskManager.Task::(_runJobs) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::Task.run: exit - success: result {'uuid': 'c1aea8aa-b030-4379-b2da-a4f4aee5a6be'} >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,664::task::957::TaskManager.Task::(_decref) Task=`960462ff-13ef-4792-9b10-fec2943aa7ab`::ref 0 aborting False >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:43,664::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:04:45,276::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:45,381::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403329 s, 25.4 MB/s\n'; <rc> = 0 >Thread-777::DEBUG::2013-03-01 13:04:46,660::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-777::DEBUG::2013-03-01 13:04:46,660::task::568::TaskManager.Task::(_updateState) Task=`8dd66896-a153-4e06-bc50-fae4539f55f3`::moving from state init -> state preparing >Thread-777::INFO::2013-03-01 13:04:46,661::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-777::DEBUG::2013-03-01 13:04:46,661::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-777::DEBUG::2013-03-01 13:04:46,661::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 960462ff-13ef-4792-9b10-fec2943aa7ab >Thread-777::DEBUG::2013-03-01 13:04:46,661::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'} >Thread-777::DEBUG::2013-03-01 13:04:46,662::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'960462ff-13ef-4792-9b10-fec2943aa7ab': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'}} >Thread-777::INFO::2013-03-01 13:04:46,662::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'960462ff-13ef-4792-9b10-fec2943aa7ab': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'}}} >Thread-777::DEBUG::2013-03-01 13:04:46,662::task::1151::TaskManager.Task::(prepare) Task=`8dd66896-a153-4e06-bc50-fae4539f55f3`::finished: {'allTasksStatus': {'960462ff-13ef-4792-9b10-fec2943aa7ab': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '960462ff-13ef-4792-9b10-fec2943aa7ab'}}} >Thread-777::DEBUG::2013-03-01 13:04:46,663::task::568::TaskManager.Task::(_updateState) Task=`8dd66896-a153-4e06-bc50-fae4539f55f3`::moving from state preparing -> state finished >Thread-777::DEBUG::2013-03-01 13:04:46,663::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-777::DEBUG::2013-03-01 13:04:46,663::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-777::DEBUG::2013-03-01 13:04:46,663::task::957::TaskManager.Task::(_decref) Task=`8dd66896-a153-4e06-bc50-fae4539f55f3`::ref 0 aborting False >Thread-778::DEBUG::2013-03-01 13:04:46,720::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-778::DEBUG::2013-03-01 13:04:46,721::task::568::TaskManager.Task::(_updateState) Task=`b1322023-8e60-452f-9619-e3cd6fd184ed`::moving from state init -> state preparing >Thread-778::INFO::2013-03-01 13:04:46,721::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='9d2cd1d4-c395-4299-9840-65d1af86acc0', volUUID='c1aea8aa-b030-4379-b2da-a4f4aee5a6be', options=None) >Thread-778::DEBUG::2013-03-01 13:04:46,722::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`491315d8-de22-4471-ace5-578eeddf6ab9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-778::DEBUG::2013-03-01 13:04:46,722::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-778::DEBUG::2013-03-01 13:04:46,723::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-778::DEBUG::2013-03-01 13:04:46,723::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`491315d8-de22-4471-ace5-578eeddf6ab9`::Granted request >Thread-778::DEBUG::2013-03-01 13:04:46,723::task::794::TaskManager.Task::(resourceAcquired) Task=`b1322023-8e60-452f-9619-e3cd6fd184ed`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-778::DEBUG::2013-03-01 13:04:46,724::task::957::TaskManager.Task::(_decref) Task=`b1322023-8e60-452f-9619-e3cd6fd184ed`::ref 1 aborting False >Thread-778::INFO::2013-03-01 13:04:46,724::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=9d2cd1d4-c395-4299-9840-65d1af86acc0 volUUID = c1aea8aa-b030-4379-b2da-a4f4aee5a6be >Thread-778::DEBUG::2013-03-01 13:04:46,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-778::DEBUG::2013-03-01 13:04:46,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000384388 s, 1.3 MB/s\n'; <rc> = 0 >Thread-778::DEBUG::2013-03-01 13:04:46,736::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000384388 s, 1.3 MB/s'], size: 512 >Thread-778::DEBUG::2013-03-01 13:04:46,737::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-778::DEBUG::2013-03-01 13:04:46,747::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000346482 s, 1.5 MB/s\n'; <rc> = 0 >Thread-778::DEBUG::2013-03-01 13:04:46,747::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000346482 s, 1.5 MB/s'], size: 512 >Thread-778::DEBUG::2013-03-01 13:04:46,748::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-778::DEBUG::2013-03-01 13:04:46,749::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-778::DEBUG::2013-03-01 13:04:46,994::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-778::DEBUG::2013-03-01 13:04:47,009::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-778::INFO::2013-03-01 13:04:47,010::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '9d2cd1d4-c395-4299-9840-65d1af86acc0', 'ctime': '1362135874', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135880', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'c1aea8aa-b030-4379-b2da-a4f4aee5a6be', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-778::INFO::2013-03-01 13:04:47,011::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '9d2cd1d4-c395-4299-9840-65d1af86acc0', 'ctime': '1362135874', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135880', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'c1aea8aa-b030-4379-b2da-a4f4aee5a6be', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-778::DEBUG::2013-03-01 13:04:47,011::task::1151::TaskManager.Task::(prepare) Task=`b1322023-8e60-452f-9619-e3cd6fd184ed`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '9d2cd1d4-c395-4299-9840-65d1af86acc0', 'ctime': '1362135874', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135880', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'c1aea8aa-b030-4379-b2da-a4f4aee5a6be', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-778::DEBUG::2013-03-01 13:04:47,011::task::568::TaskManager.Task::(_updateState) Task=`b1322023-8e60-452f-9619-e3cd6fd184ed`::moving from state preparing -> state finished >Thread-778::DEBUG::2013-03-01 13:04:47,012::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-778::DEBUG::2013-03-01 13:04:47,012::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-778::DEBUG::2013-03-01 13:04:47,012::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-778::DEBUG::2013-03-01 13:04:47,013::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-778::DEBUG::2013-03-01 13:04:47,013::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-778::DEBUG::2013-03-01 13:04:47,013::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-778::DEBUG::2013-03-01 13:04:47,014::task::957::TaskManager.Task::(_decref) Task=`b1322023-8e60-452f-9619-e3cd6fd184ed`::ref 0 aborting False >Thread-779::DEBUG::2013-03-01 13:04:47,078::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-779::DEBUG::2013-03-01 13:04:47,078::task::568::TaskManager.Task::(_updateState) Task=`ab042463-a04d-471c-8d3d-ff8b964baf50`::moving from state init -> state preparing >Thread-779::INFO::2013-03-01 13:04:47,079::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='960462ff-13ef-4792-9b10-fec2943aa7ab', spUUID=None, options=None) >Thread-779::DEBUG::2013-03-01 13:04:47,079::taskManager::161::TaskManager::(clearTask) Entry. taskID: 960462ff-13ef-4792-9b10-fec2943aa7ab >Thread-779::DEBUG::2013-03-01 13:04:47,080::taskManager::166::TaskManager::(clearTask) Return. >Thread-779::INFO::2013-03-01 13:04:47,081::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-779::DEBUG::2013-03-01 13:04:47,081::task::1151::TaskManager.Task::(prepare) Task=`ab042463-a04d-471c-8d3d-ff8b964baf50`::finished: None >Thread-779::DEBUG::2013-03-01 13:04:47,081::task::568::TaskManager.Task::(_updateState) Task=`ab042463-a04d-471c-8d3d-ff8b964baf50`::moving from state preparing -> state finished >Thread-779::DEBUG::2013-03-01 13:04:47,081::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-779::DEBUG::2013-03-01 13:04:47,082::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-779::DEBUG::2013-03-01 13:04:47,082::task::957::TaskManager.Task::(_decref) Task=`ab042463-a04d-471c-8d3d-ff8b964baf50`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:04:47,400::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:47,509::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487967 s, 21.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:04:48,147::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:48,157::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000302928 s, 13.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:49,529::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:49,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485179 s, 21.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:04:51,299::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:04:51,311::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000325567 s, 12.6 MB/s\n'; <rc> = 0 >Thread-781::DEBUG::2013-03-01 13:04:51,365::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-781::DEBUG::2013-03-01 13:04:51,366::task::568::TaskManager.Task::(_updateState) Task=`2a13462a-5f33-4040-b068-45495a836e4e`::moving from state init -> state preparing >Thread-781::INFO::2013-03-01 13:04:51,367::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-781::INFO::2013-03-01 13:04:51,367::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-781::DEBUG::2013-03-01 13:04:51,367::task::1151::TaskManager.Task::(prepare) Task=`2a13462a-5f33-4040-b068-45495a836e4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-781::DEBUG::2013-03-01 13:04:51,368::task::568::TaskManager.Task::(_updateState) Task=`2a13462a-5f33-4040-b068-45495a836e4e`::moving from state preparing -> state finished >Thread-781::DEBUG::2013-03-01 13:04:51,368::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-781::DEBUG::2013-03-01 13:04:51,368::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-781::DEBUG::2013-03-01 13:04:51,368::task::957::TaskManager.Task::(_decref) Task=`2a13462a-5f33-4040-b068-45495a836e4e`::ref 0 aborting False >Thread-782::DEBUG::2013-03-01 13:04:51,399::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-782::DEBUG::2013-03-01 13:04:51,400::task::568::TaskManager.Task::(_updateState) Task=`5f5782eb-4609-402c-9fc4-27e22395a103`::moving from state init -> state preparing >Thread-782::INFO::2013-03-01 13:04:51,400::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-782::DEBUG::2013-03-01 13:04:51,401::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`11de644c-2b50-44b7-b51f-2007821cbfce`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-782::DEBUG::2013-03-01 13:04:51,401::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-782::DEBUG::2013-03-01 13:04:51,401::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-782::DEBUG::2013-03-01 13:04:51,402::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`11de644c-2b50-44b7-b51f-2007821cbfce`::Granted request >Thread-782::DEBUG::2013-03-01 13:04:51,402::task::794::TaskManager.Task::(resourceAcquired) Task=`5f5782eb-4609-402c-9fc4-27e22395a103`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-782::DEBUG::2013-03-01 13:04:51,402::task::957::TaskManager.Task::(_decref) Task=`5f5782eb-4609-402c-9fc4-27e22395a103`::ref 1 aborting False >Thread-782::INFO::2013-03-01 13:04:51,404::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-782::DEBUG::2013-03-01 13:04:51,404::task::1151::TaskManager.Task::(prepare) Task=`5f5782eb-4609-402c-9fc4-27e22395a103`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-782::DEBUG::2013-03-01 13:04:51,405::task::568::TaskManager.Task::(_updateState) Task=`5f5782eb-4609-402c-9fc4-27e22395a103`::moving from state preparing -> state finished >Thread-782::DEBUG::2013-03-01 13:04:51,405::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-782::DEBUG::2013-03-01 13:04:51,405::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-782::DEBUG::2013-03-01 13:04:51,405::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-782::DEBUG::2013-03-01 13:04:51,406::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-782::DEBUG::2013-03-01 13:04:51,406::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-782::DEBUG::2013-03-01 13:04:51,406::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-782::DEBUG::2013-03-01 13:04:51,407::task::957::TaskManager.Task::(_decref) Task=`5f5782eb-4609-402c-9fc4-27e22395a103`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:04:51,636::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:51,750::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491658 s, 20.8 MB/s\n'; <rc> = 0 >Thread-783::DEBUG::2013-03-01 13:04:51,852::task::568::TaskManager.Task::(_updateState) Task=`e66b5b3a-0f35-4e2e-a9b7-a00d197e5792`::moving from state init -> state preparing >Thread-783::INFO::2013-03-01 13:04:51,852::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-783::INFO::2013-03-01 13:04:51,853::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102739334106', 'lastCheck': '3.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0128350257874', 'lastCheck': '0.5', 'code': 0, 'valid': True}} >Thread-783::DEBUG::2013-03-01 13:04:51,853::task::1151::TaskManager.Task::(prepare) Task=`e66b5b3a-0f35-4e2e-a9b7-a00d197e5792`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102739334106', 'lastCheck': '3.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0128350257874', 'lastCheck': '0.5', 'code': 0, 'valid': True}} >Thread-783::DEBUG::2013-03-01 13:04:51,853::task::568::TaskManager.Task::(_updateState) Task=`e66b5b3a-0f35-4e2e-a9b7-a00d197e5792`::moving from state preparing -> state finished >Thread-783::DEBUG::2013-03-01 13:04:51,853::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-783::DEBUG::2013-03-01 13:04:51,854::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-783::DEBUG::2013-03-01 13:04:51,854::task::957::TaskManager.Task::(_decref) Task=`e66b5b3a-0f35-4e2e-a9b7-a00d197e5792`::ref 0 aborting False >Thread-785::DEBUG::2013-03-01 13:04:53,136::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-785::DEBUG::2013-03-01 13:04:53,137::task::568::TaskManager.Task::(_updateState) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::moving from state init -> state preparing >Thread-785::INFO::2013-03-01 13:04:53,137::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='a178bac1-309b-4737-846b-0b43463f11b7', postZero='false', force='false') >Thread-785::INFO::2013-03-01 13:04:53,138::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-785::DEBUG::2013-03-01 13:04:53,138::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-785::DEBUG::2013-03-01 13:04:53,353::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-785::DEBUG::2013-03-01 13:04:53,354::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,355::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,355::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,356::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,356::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-785::DEBUG::2013-03-01 13:04:53,604::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-785::DEBUG::2013-03-01 13:04:53,606::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,607::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-785::DEBUG::2013-03-01 13:04:53,608::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`f339c37c-6027-4025-a252-ba39067797fa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-785::DEBUG::2013-03-01 13:04:53,608::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a178bac1-309b-4737-846b-0b43463f11b7' for lock type 'exclusive' >Thread-785::DEBUG::2013-03-01 13:04:53,609::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a178bac1-309b-4737-846b-0b43463f11b7' is free. Now locking as 'exclusive' (1 active user) >Thread-785::DEBUG::2013-03-01 13:04:53,609::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a178bac1-309b-4737-846b-0b43463f11b7`ReqID=`f339c37c-6027-4025-a252-ba39067797fa`::Granted request >Thread-785::DEBUG::2013-03-01 13:04:53,610::task::794::TaskManager.Task::(resourceAcquired) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_resourcesAcquired: Storage.a178bac1-309b-4737-846b-0b43463f11b7 (exclusive) >Thread-785::DEBUG::2013-03-01 13:04:53,610::task::957::TaskManager.Task::(_decref) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::ref 1 aborting False >Thread-785::DEBUG::2013-03-01 13:04:53,610::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e94a532d-9a7d-4b5f-887a-e88bbb323e3f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-785::DEBUG::2013-03-01 13:04:53,610::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-785::DEBUG::2013-03-01 13:04:53,611::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-785::DEBUG::2013-03-01 13:04:53,611::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e94a532d-9a7d-4b5f-887a-e88bbb323e3f`::Granted request >Thread-785::DEBUG::2013-03-01 13:04:53,611::task::794::TaskManager.Task::(resourceAcquired) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-785::DEBUG::2013-03-01 13:04:53,612::task::957::TaskManager.Task::(_decref) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::ref 1 aborting False >Thread-785::DEBUG::2013-03-01 13:04:53,612::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,613::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:53,769::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-785::DEBUG::2013-03-01 13:04:53,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-785::DEBUG::2013-03-01 13:04:53,910::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:53,921::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/46e8b230-ef40-4738-aed4-250016777727 a558fc2a-a4a3-4118-9b81-d1d601eaa295/c517d142-d8c1-4f81-927b-d95764a45afa' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:53,946::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423739 s, 24.2 MB/s\n'; <rc> = 0 >Thread-785::DEBUG::2013-03-01 13:04:54,125::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-785::DEBUG::2013-03-01 13:04:54,126::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:54,127::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:54,127::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:54,127::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-785::DEBUG::2013-03-01 13:04:54,128::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7/c517d142-d8c1-4f81-927b-d95764a45afa'] >Thread-785::DEBUG::2013-03-01 13:04:54,128::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/a178bac1-309b-4737-846b-0b43463f11b7 >Thread-785::DEBUG::2013-03-01 13:04:54,130::task::719::TaskManager.Task::(_save) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c.temp >Thread-785::DEBUG::2013-03-01 13:04:54,137::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_a178bac1-309b-4737-846b-0b43463f11b7 for task 3116cf8e-5431-4be8-9a26-4e61691ab87c >Thread-785::INFO::2013-03-01 13:04:54,137::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-785::DEBUG::2013-03-01 13:04:54,138::task::1146::TaskManager.Task::(prepare) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::Prepare: 1 jobs exist, move to acquiring >Thread-785::DEBUG::2013-03-01 13:04:54,138::task::568::TaskManager.Task::(_updateState) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::moving from state preparing -> state acquiring >Thread-785::DEBUG::2013-03-01 13:04:54,139::task::719::TaskManager.Task::(_save) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c.temp >Thread-785::DEBUG::2013-03-01 13:04:54,147::task::568::TaskManager.Task::(_updateState) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::moving from state acquiring -> state queued >Thread-785::DEBUG::2013-03-01 13:04:54,148::task::719::TaskManager.Task::(_save) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c.temp >Thread-785::DEBUG::2013-03-01 13:04:54,155::taskManager::50::TaskManager::(_queueTask) queuing task: 3116cf8e-5431-4be8-9a26-4e61691ab87c >d309adb4-fd76-4b1a-a905-11a97ff643d8::DEBUG::2013-03-01 13:04:54,155::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-785::DEBUG::2013-03-01 13:04:54,155::taskManager::56::TaskManager::(_queueTask) task queued: 3116cf8e-5431-4be8-9a26-4e61691ab87c >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,157::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 3116cf8e-5431-4be8-9a26-4e61691ab87c running: <bound method Task.commit of <storage.task.Task instance at 0x7f15c012e758>> with: None >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,159::task::1159::TaskManager.Task::(commit) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::committing task: 3116cf8e-5431-4be8-9a26-4e61691ab87c >Thread-785::DEBUG::2013-03-01 13:04:54,158::task::1148::TaskManager.Task::(prepare) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::returning >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,160::task::568::TaskManager.Task::(_updateState) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::moving from state queued -> state running >Thread-785::DEBUG::2013-03-01 13:04:54,162::task::957::TaskManager.Task::(_decref) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::ref 1 aborting False >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,165::task::719::TaskManager.Task::(_save) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c.temp >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,177::task::872::TaskManager.Task::(_runJobs) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::Task.run: running job 0: deleteImage_a178bac1-309b-4737-846b-0b43463f11b7: <function <lambda> at 0x7f15e00e6c08> (args: () kwargs: {}) >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,177::task::304::TaskManager.Task::(run) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::Job.run: running deleteImage_a178bac1-309b-4737-846b-0b43463f11b7: <function <lambda> at 0x7f15e00e6c08> (args: () kwargs: {}) callback None >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,178::task::568::TaskManager.Task::(_updateState) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::moving from state running -> state finished >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,179::task::719::TaskManager.Task::(_save) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3116cf8e-5431-4be8-9a26-4e61691ab87c.temp >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,189::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.a178bac1-309b-4737-846b-0b43463f11b7': < ResourceRef 'Storage.a178bac1-309b-4737-846b-0b43463f11b7', isValid: 'True' obj: 'None'>} >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,189::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,190::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,190::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,190::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,191::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,191::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a178bac1-309b-4737-846b-0b43463f11b7' >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,191::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a178bac1-309b-4737-846b-0b43463f11b7' (0 active users) >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,192::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a178bac1-309b-4737-846b-0b43463f11b7' is free, finding out if anyone is waiting for it. >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,192::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a178bac1-309b-4737-846b-0b43463f11b7', Clearing records. >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,192::task::880::TaskManager.Task::(_runJobs) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::Task.run: exit - success: result True >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,193::task::957::TaskManager.Task::(_decref) Task=`3116cf8e-5431-4be8-9a26-4e61691ab87c`::ref 0 aborting False >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:04:54,193::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-786::DEBUG::2013-03-01 13:04:54,205::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-786::DEBUG::2013-03-01 13:04:54,206::task::568::TaskManager.Task::(_updateState) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::moving from state init -> state preparing >Thread-786::INFO::2013-03-01 13:04:54,206::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='9d2cd1d4-c395-4299-9840-65d1af86acc0', postZero='false', force='false') >Thread-786::INFO::2013-03-01 13:04:54,207::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-786::DEBUG::2013-03-01 13:04:54,207::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-786::DEBUG::2013-03-01 13:04:54,446::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-786::DEBUG::2013-03-01 13:04:54,447::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,447::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,448::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,448::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,448::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-786::DEBUG::2013-03-01 13:04:54,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-786::DEBUG::2013-03-01 13:04:54,760::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,761::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-786::DEBUG::2013-03-01 13:04:54,762::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0`ReqID=`79616033-e49f-4363-85a0-8a444a8b73ac`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-786::DEBUG::2013-03-01 13:04:54,762::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0' for lock type 'exclusive' >Thread-786::DEBUG::2013-03-01 13:04:54,763::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0' is free. Now locking as 'exclusive' (1 active user) >Thread-786::DEBUG::2013-03-01 13:04:54,763::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0`ReqID=`79616033-e49f-4363-85a0-8a444a8b73ac`::Granted request >Thread-786::DEBUG::2013-03-01 13:04:54,764::task::794::TaskManager.Task::(resourceAcquired) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_resourcesAcquired: Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0 (exclusive) >Thread-786::DEBUG::2013-03-01 13:04:54,764::task::957::TaskManager.Task::(_decref) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::ref 1 aborting False >Thread-786::DEBUG::2013-03-01 13:04:54,764::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d14a3711-3ad8-41e8-a68a-2b3982b08449`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-786::DEBUG::2013-03-01 13:04:54,765::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-786::DEBUG::2013-03-01 13:04:54,765::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-786::DEBUG::2013-03-01 13:04:54,765::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d14a3711-3ad8-41e8-a68a-2b3982b08449`::Granted request >Thread-786::DEBUG::2013-03-01 13:04:54,766::task::794::TaskManager.Task::(resourceAcquired) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-786::DEBUG::2013-03-01 13:04:54,766::task::957::TaskManager.Task::(_decref) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::ref 1 aborting False >Thread-786::DEBUG::2013-03-01 13:04:54,766::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:54,767::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-786::DEBUG::2013-03-01 13:04:55,003::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-786::DEBUG::2013-03-01 13:04:55,016::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:55,017::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/c1aea8aa-b030-4379-b2da-a4f4aee5a6be' (cwd None) >Thread-786::DEBUG::2013-03-01 13:04:55,272::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-786::DEBUG::2013-03-01 13:04:55,273::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:55,273::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-786::DEBUG::2013-03-01 13:04:55,274::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0/c1aea8aa-b030-4379-b2da-a4f4aee5a6be'] >Thread-786::DEBUG::2013-03-01 13:04:55,274::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/9d2cd1d4-c395-4299-9840-65d1af86acc0 >Thread-786::DEBUG::2013-03-01 13:04:55,276::task::719::TaskManager.Task::(_save) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd.temp >Thread-786::DEBUG::2013-03-01 13:04:55,283::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_9d2cd1d4-c395-4299-9840-65d1af86acc0 for task 408b3f9b-b144-4002-a399-f3b3ef9f47dd >Thread-786::INFO::2013-03-01 13:04:55,283::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-786::DEBUG::2013-03-01 13:04:55,283::task::1146::TaskManager.Task::(prepare) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::Prepare: 1 jobs exist, move to acquiring >Thread-786::DEBUG::2013-03-01 13:04:55,284::task::568::TaskManager.Task::(_updateState) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::moving from state preparing -> state acquiring >Thread-786::DEBUG::2013-03-01 13:04:55,285::task::719::TaskManager.Task::(_save) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd.temp >Thread-786::DEBUG::2013-03-01 13:04:55,292::task::568::TaskManager.Task::(_updateState) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::moving from state acquiring -> state queued >Thread-786::DEBUG::2013-03-01 13:04:55,292::task::719::TaskManager.Task::(_save) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd.temp >Thread-786::DEBUG::2013-03-01 13:04:55,300::taskManager::50::TaskManager::(_queueTask) queuing task: 408b3f9b-b144-4002-a399-f3b3ef9f47dd >960462ff-13ef-4792-9b10-fec2943aa7ab::DEBUG::2013-03-01 13:04:55,300::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-786::DEBUG::2013-03-01 13:04:55,300::taskManager::56::TaskManager::(_queueTask) task queued: 408b3f9b-b144-4002-a399-f3b3ef9f47dd >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,302::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 408b3f9b-b144-4002-a399-f3b3ef9f47dd running: <bound method Task.commit of <storage.task.Task instance at 0x16eb320>> with: None >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,304::task::1159::TaskManager.Task::(commit) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::committing task: 408b3f9b-b144-4002-a399-f3b3ef9f47dd >Thread-786::DEBUG::2013-03-01 13:04:55,303::task::1148::TaskManager.Task::(prepare) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::returning >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,306::task::568::TaskManager.Task::(_updateState) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::moving from state queued -> state running >Thread-786::DEBUG::2013-03-01 13:04:55,307::task::957::TaskManager.Task::(_decref) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::ref 1 aborting False >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,311::task::719::TaskManager.Task::(_save) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd.temp >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,322::task::872::TaskManager.Task::(_runJobs) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::Task.run: running job 0: deleteImage_9d2cd1d4-c395-4299-9840-65d1af86acc0: <function <lambda> at 0x7f15e00ca0c8> (args: () kwargs: {}) >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,322::task::304::TaskManager.Task::(run) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::Job.run: running deleteImage_9d2cd1d4-c395-4299-9840-65d1af86acc0: <function <lambda> at 0x7f15e00ca0c8> (args: () kwargs: {}) callback None >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,322::task::568::TaskManager.Task::(_updateState) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::moving from state running -> state finished >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,323::task::719::TaskManager.Task::(_save) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/408b3f9b-b144-4002-a399-f3b3ef9f47dd.temp >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,331::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0': < ResourceRef 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0', isValid: 'True' obj: 'None'>} >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,331::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,332::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,332::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,332::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,333::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,333::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0' >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,333::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0' (0 active users) >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,334::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0' is free, finding out if anyone is waiting for it. >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,334::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9d2cd1d4-c395-4299-9840-65d1af86acc0', Clearing records. >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,334::task::880::TaskManager.Task::(_runJobs) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::Task.run: exit - success: result True >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,335::task::957::TaskManager.Task::(_decref) Task=`408b3f9b-b144-4002-a399-f3b3ef9f47dd`::ref 0 aborting False >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:04:55,335::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:04:55,959::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:04:56,060::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478416 s, 21.4 MB/s\n'; <rc> = 0 >Thread-788::DEBUG::2013-03-01 13:04:56,700::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-788::DEBUG::2013-03-01 13:04:56,700::task::568::TaskManager.Task::(_updateState) Task=`9675e8f2-b078-4360-a576-4aae828450a6`::moving from state init -> state preparing >Thread-788::INFO::2013-03-01 13:04:56,701::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-788::DEBUG::2013-03-01 13:04:56,701::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-788::DEBUG::2013-03-01 13:04:56,701::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3116cf8e-5431-4be8-9a26-4e61691ab87c >Thread-788::DEBUG::2013-03-01 13:04:56,701::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3116cf8e-5431-4be8-9a26-4e61691ab87c'} >Thread-788::DEBUG::2013-03-01 13:04:56,702::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 408b3f9b-b144-4002-a399-f3b3ef9f47dd >Thread-788::DEBUG::2013-03-01 13:04:56,702::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '408b3f9b-b144-4002-a399-f3b3ef9f47dd'} >Thread-788::DEBUG::2013-03-01 13:04:56,702::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'3116cf8e-5431-4be8-9a26-4e61691ab87c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3116cf8e-5431-4be8-9a26-4e61691ab87c'}, '408b3f9b-b144-4002-a399-f3b3ef9f47dd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '408b3f9b-b144-4002-a399-f3b3ef9f47dd'}} >Thread-788::INFO::2013-03-01 13:04:56,703::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3116cf8e-5431-4be8-9a26-4e61691ab87c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3116cf8e-5431-4be8-9a26-4e61691ab87c'}, '408b3f9b-b144-4002-a399-f3b3ef9f47dd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '408b3f9b-b144-4002-a399-f3b3ef9f47dd'}}} >Thread-788::DEBUG::2013-03-01 13:04:56,703::task::1151::TaskManager.Task::(prepare) Task=`9675e8f2-b078-4360-a576-4aae828450a6`::finished: {'allTasksStatus': {'3116cf8e-5431-4be8-9a26-4e61691ab87c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3116cf8e-5431-4be8-9a26-4e61691ab87c'}, '408b3f9b-b144-4002-a399-f3b3ef9f47dd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '408b3f9b-b144-4002-a399-f3b3ef9f47dd'}}} >Thread-788::DEBUG::2013-03-01 13:04:56,703::task::568::TaskManager.Task::(_updateState) Task=`9675e8f2-b078-4360-a576-4aae828450a6`::moving from state preparing -> state finished >Thread-788::DEBUG::2013-03-01 13:04:56,703::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-788::DEBUG::2013-03-01 13:04:56,704::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-788::DEBUG::2013-03-01 13:04:56,704::task::957::TaskManager.Task::(_decref) Task=`9675e8f2-b078-4360-a576-4aae828450a6`::ref 0 aborting False >Thread-789::DEBUG::2013-03-01 13:04:56,783::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-789::DEBUG::2013-03-01 13:04:56,784::task::568::TaskManager.Task::(_updateState) Task=`a1548728-dd1f-4841-8063-461c88cfa59b`::moving from state init -> state preparing >Thread-789::INFO::2013-03-01 13:04:56,784::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='408b3f9b-b144-4002-a399-f3b3ef9f47dd', spUUID=None, options=None) >Thread-789::DEBUG::2013-03-01 13:04:56,784::taskManager::161::TaskManager::(clearTask) Entry. taskID: 408b3f9b-b144-4002-a399-f3b3ef9f47dd >Thread-789::DEBUG::2013-03-01 13:04:56,785::taskManager::166::TaskManager::(clearTask) Return. >Thread-789::INFO::2013-03-01 13:04:56,786::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-789::DEBUG::2013-03-01 13:04:56,786::task::1151::TaskManager.Task::(prepare) Task=`a1548728-dd1f-4841-8063-461c88cfa59b`::finished: None >Thread-789::DEBUG::2013-03-01 13:04:56,786::task::568::TaskManager.Task::(_updateState) Task=`a1548728-dd1f-4841-8063-461c88cfa59b`::moving from state preparing -> state finished >Thread-789::DEBUG::2013-03-01 13:04:56,786::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-789::DEBUG::2013-03-01 13:04:56,787::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-789::DEBUG::2013-03-01 13:04:56,787::task::957::TaskManager.Task::(_decref) Task=`a1548728-dd1f-4841-8063-461c88cfa59b`::ref 0 aborting False >Thread-790::DEBUG::2013-03-01 13:04:56,815::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-790::DEBUG::2013-03-01 13:04:56,815::task::568::TaskManager.Task::(_updateState) Task=`4da3ca98-97da-4421-a810-a890606cd328`::moving from state init -> state preparing >Thread-790::INFO::2013-03-01 13:04:56,816::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='3116cf8e-5431-4be8-9a26-4e61691ab87c', spUUID=None, options=None) >Thread-790::DEBUG::2013-03-01 13:04:56,816::taskManager::161::TaskManager::(clearTask) Entry. taskID: 3116cf8e-5431-4be8-9a26-4e61691ab87c >Thread-790::DEBUG::2013-03-01 13:04:56,817::taskManager::166::TaskManager::(clearTask) Return. >Thread-790::INFO::2013-03-01 13:04:56,817::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-790::DEBUG::2013-03-01 13:04:56,818::task::1151::TaskManager.Task::(prepare) Task=`4da3ca98-97da-4421-a810-a890606cd328`::finished: None >Thread-790::DEBUG::2013-03-01 13:04:56,818::task::568::TaskManager.Task::(_updateState) Task=`4da3ca98-97da-4421-a810-a890606cd328`::moving from state preparing -> state finished >Thread-790::DEBUG::2013-03-01 13:04:56,818::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-790::DEBUG::2013-03-01 13:04:56,818::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-790::DEBUG::2013-03-01 13:04:56,819::task::957::TaskManager.Task::(_decref) Task=`4da3ca98-97da-4421-a810-a890606cd328`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:04:58,079::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:58,160::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:04:58,181::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000278374 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:04:58,197::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386022 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:00,218::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:01,349::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:05:01,420::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-793::DEBUG::2013-03-01 13:05:01,742::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-793::DEBUG::2013-03-01 13:05:01,782::task::568::TaskManager.Task::(_updateState) Task=`13d426e4-c91e-4c54-a23f-66288dbd1abf`::moving from state init -> state preparing >Thread-793::INFO::2013-03-01 13:05:01,811::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-793::INFO::2013-03-01 13:05:01,836::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-793::DEBUG::2013-03-01 13:05:01,861::task::1151::TaskManager.Task::(prepare) Task=`13d426e4-c91e-4c54-a23f-66288dbd1abf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-793::DEBUG::2013-03-01 13:05:01,886::task::568::TaskManager.Task::(_updateState) Task=`13d426e4-c91e-4c54-a23f-66288dbd1abf`::moving from state preparing -> state finished >Thread-793::DEBUG::2013-03-01 13:05:01,888::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-793::DEBUG::2013-03-01 13:05:01,890::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-793::DEBUG::2013-03-01 13:05:01,892::task::957::TaskManager.Task::(_decref) Task=`13d426e4-c91e-4c54-a23f-66288dbd1abf`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:01,912::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.469309 s, 2.2 MB/s\n'; <rc> = 0 >Thread-794::DEBUG::2013-03-01 13:05:01,925::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-794::DEBUG::2013-03-01 13:05:01,925::task::568::TaskManager.Task::(_updateState) Task=`7723578e-8c5c-4698-ad97-b51be851fc6c`::moving from state init -> state preparing >Thread-794::INFO::2013-03-01 13:05:01,925::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-794::DEBUG::2013-03-01 13:05:01,926::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`ded8db43-03a1-409c-83ca-c9a7c571f982`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-794::DEBUG::2013-03-01 13:05:01,926::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-794::DEBUG::2013-03-01 13:05:01,926::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-794::DEBUG::2013-03-01 13:05:01,926::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`ded8db43-03a1-409c-83ca-c9a7c571f982`::Granted request >Thread-794::DEBUG::2013-03-01 13:05:01,927::task::794::TaskManager.Task::(resourceAcquired) Task=`7723578e-8c5c-4698-ad97-b51be851fc6c`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-794::DEBUG::2013-03-01 13:05:01,927::task::957::TaskManager.Task::(_decref) Task=`7723578e-8c5c-4698-ad97-b51be851fc6c`::ref 1 aborting False >Thread-794::DEBUG::2013-03-01 13:05:01,928::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-794::DEBUG::2013-03-01 13:05:01,928::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-794::DEBUG::2013-03-01 13:05:02,113::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-794::INFO::2013-03-01 13:05:02,116::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-794::DEBUG::2013-03-01 13:05:02,116::task::1151::TaskManager.Task::(prepare) Task=`7723578e-8c5c-4698-ad97-b51be851fc6c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-794::DEBUG::2013-03-01 13:05:02,116::task::568::TaskManager.Task::(_updateState) Task=`7723578e-8c5c-4698-ad97-b51be851fc6c`::moving from state preparing -> state finished >Thread-794::DEBUG::2013-03-01 13:05:02,116::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-794::DEBUG::2013-03-01 13:05:02,117::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-794::DEBUG::2013-03-01 13:05:02,117::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-794::DEBUG::2013-03-01 13:05:02,117::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-794::DEBUG::2013-03-01 13:05:02,118::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-794::DEBUG::2013-03-01 13:05:02,118::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-794::DEBUG::2013-03-01 13:05:02,118::task::957::TaskManager.Task::(_decref) Task=`7723578e-8c5c-4698-ad97-b51be851fc6c`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:05:02,131::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:05:02,133::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:05:02,133::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:02,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000321889 s, 12.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:03,925::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:04,032::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421383 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:06,054::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-796::DEBUG::2013-03-01 13:05:07,444::task::568::TaskManager.Task::(_updateState) Task=`7e841cca-5f5d-459b-8c3b-9798e58f15e4`::moving from state init -> state preparing >Thread-797::DEBUG::2013-03-01 13:05:07,469::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-796::INFO::2013-03-01 13:05:07,485::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-797::DEBUG::2013-03-01 13:05:07,512::task::568::TaskManager.Task::(_updateState) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::moving from state init -> state preparing >Thread-796::INFO::2013-03-01 13:05:07,521::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0248799324036', 'lastCheck': '9.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0127201080322', 'lastCheck': '5.4', 'code': 0, 'valid': True}} >Thread-797::INFO::2013-03-01 13:05:07,543::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='bae6764b-ba3d-4d6b-9c50-c68e3475557a', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-796::DEBUG::2013-03-01 13:05:07,544::task::1151::TaskManager.Task::(prepare) Task=`7e841cca-5f5d-459b-8c3b-9798e58f15e4`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0248799324036', 'lastCheck': '9.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0127201080322', 'lastCheck': '5.4', 'code': 0, 'valid': True}} >Thread-796::DEBUG::2013-03-01 13:05:07,572::task::568::TaskManager.Task::(_updateState) Task=`7e841cca-5f5d-459b-8c3b-9798e58f15e4`::moving from state preparing -> state finished >Thread-797::INFO::2013-03-01 13:05:07,571::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-796::DEBUG::2013-03-01 13:05:07,596::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-796::DEBUG::2013-03-01 13:05:07,617::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-796::DEBUG::2013-03-01 13:05:07,641::task::957::TaskManager.Task::(_decref) Task=`7e841cca-5f5d-459b-8c3b-9798e58f15e4`::ref 0 aborting False >Thread-797::DEBUG::2013-03-01 13:05:07,658::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:08,019::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.518185 s, 2.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:05:08,212::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:08,494::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00500417 s, 819 kB/s\n'; <rc> = 0 >Thread-797::DEBUG::2013-03-01 13:05:08,616::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-797::DEBUG::2013-03-01 13:05:08,617::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-797::DEBUG::2013-03-01 13:05:08,617::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-797::DEBUG::2013-03-01 13:05:08,617::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-797::DEBUG::2013-03-01 13:05:08,618::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-797::DEBUG::2013-03-01 13:05:08,618::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-797::DEBUG::2013-03-01 13:05:08,619::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-797::DEBUG::2013-03-01 13:05:08,863::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-797::DEBUG::2013-03-01 13:05:08,865::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-797::DEBUG::2013-03-01 13:05:08,865::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-797::DEBUG::2013-03-01 13:05:08,867::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9c46b545-1177-4fe5-ab73-c60854b0d2b9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-797::DEBUG::2013-03-01 13:05:08,867::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-797::DEBUG::2013-03-01 13:05:08,868::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-797::DEBUG::2013-03-01 13:05:08,868::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9c46b545-1177-4fe5-ab73-c60854b0d2b9`::Granted request >Thread-797::DEBUG::2013-03-01 13:05:08,869::task::794::TaskManager.Task::(resourceAcquired) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-797::DEBUG::2013-03-01 13:05:08,869::task::957::TaskManager.Task::(_decref) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::ref 1 aborting False >Thread-797::DEBUG::2013-03-01 13:05:08,871::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >Thread-797::DEBUG::2013-03-01 13:05:08,878::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 7616755b-1a5c-46af-91a2-7d78373e99de >Thread-797::INFO::2013-03-01 13:05:08,878::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-797::DEBUG::2013-03-01 13:05:08,878::task::1146::TaskManager.Task::(prepare) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::Prepare: 1 jobs exist, move to acquiring >Thread-797::DEBUG::2013-03-01 13:05:08,878::task::568::TaskManager.Task::(_updateState) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::moving from state preparing -> state acquiring >Thread-797::DEBUG::2013-03-01 13:05:08,879::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >Thread-797::DEBUG::2013-03-01 13:05:08,887::task::568::TaskManager.Task::(_updateState) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::moving from state acquiring -> state queued >Thread-797::DEBUG::2013-03-01 13:05:08,887::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >Thread-797::DEBUG::2013-03-01 13:05:08,895::taskManager::50::TaskManager::(_queueTask) queuing task: 7616755b-1a5c-46af-91a2-7d78373e99de >cf2b464d-085d-49bc-a9f5-533578a13e86::DEBUG::2013-03-01 13:05:08,896::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-797::DEBUG::2013-03-01 13:05:08,895::taskManager::56::TaskManager::(_queueTask) task queued: 7616755b-1a5c-46af-91a2-7d78373e99de >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,897::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 7616755b-1a5c-46af-91a2-7d78373e99de running: <bound method Task.commit of <storage.task.Task instance at 0x178f5f0>> with: None >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,898::task::1159::TaskManager.Task::(commit) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::committing task: 7616755b-1a5c-46af-91a2-7d78373e99de >Thread-797::DEBUG::2013-03-01 13:05:08,898::task::1148::TaskManager.Task::(prepare) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::returning >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,900::task::568::TaskManager.Task::(_updateState) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::moving from state queued -> state running >Thread-797::DEBUG::2013-03-01 13:05:08,902::task::957::TaskManager.Task::(_decref) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::ref 1 aborting False >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,905::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,916::task::872::TaskManager.Task::(_runJobs) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '95f46aaa-0648-4571-8edc-11c392259094', 12582912, 4, 2, 2, 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,916::task::304::TaskManager.Task::(run) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '95f46aaa-0648-4571-8edc-11c392259094', 12582912, 4, 2, 2, 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,917::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094`ReqID=`76749723-4cb6-4e22-a872-305d3ca7dce3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,917::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' for lock type 'exclusive' >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,918::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:08,919::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,162::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,175::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,176::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 95f46aaa-0648-4571-8edc-11c392259094 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,176::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' is free. Now locking as 'exclusive' (1 active user) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,176::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094`ReqID=`76749723-4cb6-4e22-a872-305d3ca7dce3`::Granted request >7616755b-1a5c-46af-91a2-7d78373e99de::INFO::2013-03-01 13:05:09,177::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094 for image's volumes >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,178::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,187::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,188::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,435::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,444::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::WARNING::2013-03-01 13:05:09,444::lvm::593::Storage.LVM::(getLv) lv: bae6764b-ba3d-4d6b-9c50-c68e3475557a not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >7616755b-1a5c-46af-91a2-7d78373e99de::INFO::2013-03-01 13:05:09,445::volume::457::Storage.Volume::(create) Creating volume bae6764b-ba3d-4d6b-9c50-c68e3475557a >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,446::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,455::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:09,466::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name bae6764b-ba3d-4d6b-9c50-c68e3475557a a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:10,505::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:10,605::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476559 s, 21.5 MB/s\n'; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,110::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,111::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,117::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,118::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,118::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::INFO::2013-03-01 13:05:11,119::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a with size = 12582912 sectors >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,120::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a 6291456K' (cwd None) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,132::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,133::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,134::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,392::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,405::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::WARNING::2013-03-01 13:05:11,406::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,406::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,407::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_7 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_95f46aaa-0648-4571-8edc-11c392259094 a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a' (cwd None) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,619::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,620::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,620::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,622::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a' (cwd None) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,883::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,884::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,884::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,886::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,898::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=bae6764b-ba3d-4d6b-9c50-c68e3475557a sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 7) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,908::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,918::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,918::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' (0 active users) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,918::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' is free, finding out if anyone is waiting for it. >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,919::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094', Clearing records. >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,919::task::568::TaskManager.Task::(_updateState) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::moving from state running -> state finished >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,920::task::719::TaskManager.Task::(_save) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/7616755b-1a5c-46af-91a2-7d78373e99de.temp >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,930::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,931::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,931::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,931::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,932::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,932::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,932::task::880::TaskManager.Task::(_runJobs) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::Task.run: exit - success: result {'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a'} >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,933::task::957::TaskManager.Task::(_decref) Task=`7616755b-1a5c-46af-91a2-7d78373e99de`::ref 0 aborting False >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:11,933::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-105::DEBUG::2013-03-01 13:05:12,151::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:05:12,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-800::DEBUG::2013-03-01 13:05:12,163::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-800::DEBUG::2013-03-01 13:05:12,164::task::568::TaskManager.Task::(_updateState) Task=`27b2b7a2-9e2d-4a2c-8cdc-a4fa417facab`::moving from state init -> state preparing >Thread-800::INFO::2013-03-01 13:05:12,165::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-800::INFO::2013-03-01 13:05:12,165::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-800::DEBUG::2013-03-01 13:05:12,166::task::1151::TaskManager.Task::(prepare) Task=`27b2b7a2-9e2d-4a2c-8cdc-a4fa417facab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-800::DEBUG::2013-03-01 13:05:12,166::task::568::TaskManager.Task::(_updateState) Task=`27b2b7a2-9e2d-4a2c-8cdc-a4fa417facab`::moving from state preparing -> state finished >Thread-800::DEBUG::2013-03-01 13:05:12,166::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-800::DEBUG::2013-03-01 13:05:12,167::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-800::DEBUG::2013-03-01 13:05:12,167::task::957::TaskManager.Task::(_decref) Task=`27b2b7a2-9e2d-4a2c-8cdc-a4fa417facab`::ref 0 aborting False >Thread-801::DEBUG::2013-03-01 13:05:12,192::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-801::DEBUG::2013-03-01 13:05:12,192::task::568::TaskManager.Task::(_updateState) Task=`e4ed3901-be04-4ee6-9f15-23a7e39cc667`::moving from state init -> state preparing >Thread-801::INFO::2013-03-01 13:05:12,193::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-801::DEBUG::2013-03-01 13:05:12,195::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`31afb7bc-edb3-4ef7-b323-494317ae36fd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-801::DEBUG::2013-03-01 13:05:12,195::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-801::DEBUG::2013-03-01 13:05:12,195::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-801::DEBUG::2013-03-01 13:05:12,196::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`31afb7bc-edb3-4ef7-b323-494317ae36fd`::Granted request >Thread-801::DEBUG::2013-03-01 13:05:12,196::task::794::TaskManager.Task::(resourceAcquired) Task=`e4ed3901-be04-4ee6-9f15-23a7e39cc667`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-801::DEBUG::2013-03-01 13:05:12,196::task::957::TaskManager.Task::(_decref) Task=`e4ed3901-be04-4ee6-9f15-23a7e39cc667`::ref 1 aborting False >Thread-801::DEBUG::2013-03-01 13:05:12,197::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-801::DEBUG::2013-03-01 13:05:12,198::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:12,557::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:05:12,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:12,571::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000349274 s, 11.7 MB/s\n'; <rc> = 0 >Thread-801::DEBUG::2013-03-01 13:05:12,588::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-801::DEBUG::2013-03-01 13:05:12,590::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-801::INFO::2013-03-01 13:05:12,592::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-801::DEBUG::2013-03-01 13:05:12,592::task::1151::TaskManager.Task::(prepare) Task=`e4ed3901-be04-4ee6-9f15-23a7e39cc667`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-801::DEBUG::2013-03-01 13:05:12,593::task::568::TaskManager.Task::(_updateState) Task=`e4ed3901-be04-4ee6-9f15-23a7e39cc667`::moving from state preparing -> state finished >Thread-801::DEBUG::2013-03-01 13:05:12,593::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-801::DEBUG::2013-03-01 13:05:12,593::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-801::DEBUG::2013-03-01 13:05:12,594::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-801::DEBUG::2013-03-01 13:05:12,594::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-801::DEBUG::2013-03-01 13:05:12,594::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-801::DEBUG::2013-03-01 13:05:12,595::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-801::DEBUG::2013-03-01 13:05:12,595::task::957::TaskManager.Task::(_decref) Task=`e4ed3901-be04-4ee6-9f15-23a7e39cc667`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:12,624::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:12,712::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042205 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:14,725::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:14,836::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458202 s, 22.3 MB/s\n'; <rc> = 0 >Thread-803::DEBUG::2013-03-01 13:05:16,748::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-803::DEBUG::2013-03-01 13:05:16,749::task::568::TaskManager.Task::(_updateState) Task=`024b19a8-4e3f-41ac-9401-197761fa6be1`::moving from state init -> state preparing >Thread-803::INFO::2013-03-01 13:05:16,750::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-803::DEBUG::2013-03-01 13:05:16,750::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-803::DEBUG::2013-03-01 13:05:16,750::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7616755b-1a5c-46af-91a2-7d78373e99de >Thread-803::DEBUG::2013-03-01 13:05:16,750::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7616755b-1a5c-46af-91a2-7d78373e99de'} >Thread-803::DEBUG::2013-03-01 13:05:16,750::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7616755b-1a5c-46af-91a2-7d78373e99de': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7616755b-1a5c-46af-91a2-7d78373e99de'}} >Thread-803::INFO::2013-03-01 13:05:16,751::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7616755b-1a5c-46af-91a2-7d78373e99de': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7616755b-1a5c-46af-91a2-7d78373e99de'}}} >Thread-803::DEBUG::2013-03-01 13:05:16,751::task::1151::TaskManager.Task::(prepare) Task=`024b19a8-4e3f-41ac-9401-197761fa6be1`::finished: {'allTasksStatus': {'7616755b-1a5c-46af-91a2-7d78373e99de': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7616755b-1a5c-46af-91a2-7d78373e99de'}}} >Thread-803::DEBUG::2013-03-01 13:05:16,751::task::568::TaskManager.Task::(_updateState) Task=`024b19a8-4e3f-41ac-9401-197761fa6be1`::moving from state preparing -> state finished >Thread-803::DEBUG::2013-03-01 13:05:16,751::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-803::DEBUG::2013-03-01 13:05:16,752::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-803::DEBUG::2013-03-01 13:05:16,752::task::957::TaskManager.Task::(_decref) Task=`024b19a8-4e3f-41ac-9401-197761fa6be1`::ref 0 aborting False >Thread-804::DEBUG::2013-03-01 13:05:16,825::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-804::DEBUG::2013-03-01 13:05:16,826::task::568::TaskManager.Task::(_updateState) Task=`5618e013-560f-4f46-a763-2bd2de7e7ee6`::moving from state init -> state preparing >Thread-804::INFO::2013-03-01 13:05:16,826::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', volUUID='bae6764b-ba3d-4d6b-9c50-c68e3475557a', options=None) >Thread-804::DEBUG::2013-03-01 13:05:16,827::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d396c6e8-ea82-4278-9135-63d07b9d4dcf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-804::DEBUG::2013-03-01 13:05:16,827::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-804::DEBUG::2013-03-01 13:05:16,827::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-804::DEBUG::2013-03-01 13:05:16,828::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d396c6e8-ea82-4278-9135-63d07b9d4dcf`::Granted request >Thread-804::DEBUG::2013-03-01 13:05:16,828::task::794::TaskManager.Task::(resourceAcquired) Task=`5618e013-560f-4f46-a763-2bd2de7e7ee6`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-804::DEBUG::2013-03-01 13:05:16,828::task::957::TaskManager.Task::(_decref) Task=`5618e013-560f-4f46-a763-2bd2de7e7ee6`::ref 1 aborting False >Thread-804::DEBUG::2013-03-01 13:05:16,829::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-804::DEBUG::2013-03-01 13:05:16,830::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:16,856::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:16,945::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372343 s, 27.5 MB/s\n'; <rc> = 0 >Thread-804::DEBUG::2013-03-01 13:05:17,062::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-804::DEBUG::2013-03-01 13:05:17,074::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-804::INFO::2013-03-01 13:05:17,074::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=95f46aaa-0648-4571-8edc-11c392259094 volUUID = bae6764b-ba3d-4d6b-9c50-c68e3475557a >Thread-804::DEBUG::2013-03-01 13:05:17,075::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-804::DEBUG::2013-03-01 13:05:17,085::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000329456 s, 1.6 MB/s\n'; <rc> = 0 >Thread-804::DEBUG::2013-03-01 13:05:17,085::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000329456 s, 1.6 MB/s'], size: 512 >Thread-804::DEBUG::2013-03-01 13:05:17,086::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-804::DEBUG::2013-03-01 13:05:17,096::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00032796 s, 1.6 MB/s\n'; <rc> = 0 >Thread-804::DEBUG::2013-03-01 13:05:17,097::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00032796 s, 1.6 MB/s'], size: 512 >Thread-804::DEBUG::2013-03-01 13:05:17,097::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-804::DEBUG::2013-03-01 13:05:17,098::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-804::DEBUG::2013-03-01 13:05:17,344::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-804::DEBUG::2013-03-01 13:05:17,353::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-804::INFO::2013-03-01 13:05:17,354::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-804::INFO::2013-03-01 13:05:17,354::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-804::DEBUG::2013-03-01 13:05:17,354::task::1151::TaskManager.Task::(prepare) Task=`5618e013-560f-4f46-a763-2bd2de7e7ee6`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-804::DEBUG::2013-03-01 13:05:17,355::task::568::TaskManager.Task::(_updateState) Task=`5618e013-560f-4f46-a763-2bd2de7e7ee6`::moving from state preparing -> state finished >Thread-804::DEBUG::2013-03-01 13:05:17,355::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-804::DEBUG::2013-03-01 13:05:17,355::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-804::DEBUG::2013-03-01 13:05:17,355::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-804::DEBUG::2013-03-01 13:05:17,356::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-804::DEBUG::2013-03-01 13:05:17,356::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-804::DEBUG::2013-03-01 13:05:17,356::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-804::DEBUG::2013-03-01 13:05:17,356::task::957::TaskManager.Task::(_decref) Task=`5618e013-560f-4f46-a763-2bd2de7e7ee6`::ref 0 aborting False >Thread-805::DEBUG::2013-03-01 13:05:17,403::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-805::DEBUG::2013-03-01 13:05:17,404::task::568::TaskManager.Task::(_updateState) Task=`59ddef0e-ba71-43a2-9998-117c89858eec`::moving from state init -> state preparing >Thread-805::INFO::2013-03-01 13:05:17,404::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='7616755b-1a5c-46af-91a2-7d78373e99de', spUUID=None, options=None) >Thread-805::DEBUG::2013-03-01 13:05:17,404::taskManager::161::TaskManager::(clearTask) Entry. taskID: 7616755b-1a5c-46af-91a2-7d78373e99de >Thread-805::DEBUG::2013-03-01 13:05:17,406::taskManager::166::TaskManager::(clearTask) Return. >Thread-805::INFO::2013-03-01 13:05:17,406::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-805::DEBUG::2013-03-01 13:05:17,406::task::1151::TaskManager.Task::(prepare) Task=`59ddef0e-ba71-43a2-9998-117c89858eec`::finished: None >Thread-805::DEBUG::2013-03-01 13:05:17,407::task::568::TaskManager.Task::(_updateState) Task=`59ddef0e-ba71-43a2-9998-117c89858eec`::moving from state preparing -> state finished >Thread-805::DEBUG::2013-03-01 13:05:17,407::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-805::DEBUG::2013-03-01 13:05:17,407::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-805::DEBUG::2013-03-01 13:05:17,407::task::957::TaskManager.Task::(_decref) Task=`59ddef0e-ba71-43a2-9998-117c89858eec`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:05:18,497::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:18,506::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000346732 s, 11.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:18,965::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:19,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422362 s, 24.2 MB/s\n'; <rc> = 0 >Thread-807::DEBUG::2013-03-01 13:05:19,983::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-807::DEBUG::2013-03-01 13:05:19,983::task::568::TaskManager.Task::(_updateState) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::moving from state init -> state preparing >Thread-807::INFO::2013-03-01 13:05:19,984::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='afd24d51-5438-4385-bd13-288c4e5c4d5e', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-807::INFO::2013-03-01 13:05:19,984::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-807::DEBUG::2013-03-01 13:05:19,985::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-807::DEBUG::2013-03-01 13:05:20,216::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-807::DEBUG::2013-03-01 13:05:20,217::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-807::DEBUG::2013-03-01 13:05:20,217::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-807::DEBUG::2013-03-01 13:05:20,218::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-807::DEBUG::2013-03-01 13:05:20,218::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-807::DEBUG::2013-03-01 13:05:20,218::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-807::DEBUG::2013-03-01 13:05:20,219::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-807::DEBUG::2013-03-01 13:05:20,454::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-807::DEBUG::2013-03-01 13:05:20,457::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-807::DEBUG::2013-03-01 13:05:20,457::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-807::DEBUG::2013-03-01 13:05:20,458::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`6c87da59-f4f2-4ed8-857e-9ddf6e99607c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-807::DEBUG::2013-03-01 13:05:20,459::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-807::DEBUG::2013-03-01 13:05:20,459::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-807::DEBUG::2013-03-01 13:05:20,459::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`6c87da59-f4f2-4ed8-857e-9ddf6e99607c`::Granted request >Thread-807::DEBUG::2013-03-01 13:05:20,460::task::794::TaskManager.Task::(resourceAcquired) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-807::DEBUG::2013-03-01 13:05:20,460::task::957::TaskManager.Task::(_decref) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::ref 1 aborting False >Thread-807::DEBUG::2013-03-01 13:05:20,461::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >Thread-807::DEBUG::2013-03-01 13:05:20,467::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task f75ede85-8a68-4e8e-aa0e-d41087dfcfec >Thread-807::INFO::2013-03-01 13:05:20,467::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-807::DEBUG::2013-03-01 13:05:20,467::task::1146::TaskManager.Task::(prepare) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::Prepare: 1 jobs exist, move to acquiring >Thread-807::DEBUG::2013-03-01 13:05:20,467::task::568::TaskManager.Task::(_updateState) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::moving from state preparing -> state acquiring >Thread-807::DEBUG::2013-03-01 13:05:20,468::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >Thread-807::DEBUG::2013-03-01 13:05:20,473::task::568::TaskManager.Task::(_updateState) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::moving from state acquiring -> state queued >Thread-807::DEBUG::2013-03-01 13:05:20,474::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >Thread-807::DEBUG::2013-03-01 13:05:20,479::taskManager::50::TaskManager::(_queueTask) queuing task: f75ede85-8a68-4e8e-aa0e-d41087dfcfec >7616755b-1a5c-46af-91a2-7d78373e99de::DEBUG::2013-03-01 13:05:20,480::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-807::DEBUG::2013-03-01 13:05:20,480::taskManager::56::TaskManager::(_queueTask) task queued: f75ede85-8a68-4e8e-aa0e-d41087dfcfec >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,481::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: f75ede85-8a68-4e8e-aa0e-d41087dfcfec running: <bound method Task.commit of <storage.task.Task instance at 0x17c05a8>> with: None >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,482::task::1159::TaskManager.Task::(commit) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::committing task: f75ede85-8a68-4e8e-aa0e-d41087dfcfec >Thread-807::DEBUG::2013-03-01 13:05:20,482::task::1148::TaskManager.Task::(prepare) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::returning >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,483::task::568::TaskManager.Task::(_updateState) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::moving from state queued -> state running >Thread-807::DEBUG::2013-03-01 13:05:20,484::task::957::TaskManager.Task::(_decref) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::ref 1 aborting False >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,486::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,496::task::872::TaskManager.Task::(_runJobs) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 12582912, 4, 2, 2, 'afd24d51-5438-4385-bd13-288c4e5c4d5e', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,497::task::304::TaskManager.Task::(run) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 12582912, 4, 2, 2, 'afd24d51-5438-4385-bd13-288c4e5c4d5e', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,497::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`a7878619-8774-41d4-b044-019f91c3c750`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,497::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' for lock type 'exclusive' >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,498::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,499::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,738::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,748::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,749::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,749::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free. Now locking as 'exclusive' (1 active user) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,749::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`a7878619-8774-41d4-b044-019f91c3c750`::Granted request >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::INFO::2013-03-01 13:05:20,750::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 for image's volumes >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,750::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,758::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:20,759::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:21,007::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:21,017::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::WARNING::2013-03-01 13:05:21,017::lvm::593::Storage.LVM::(getLv) lv: afd24d51-5438-4385-bd13-288c4e5c4d5e not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::INFO::2013-03-01 13:05:21,018::volume::457::Storage.Volume::(create) Creating volume afd24d51-5438-4385-bd13-288c4e5c4d5e >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:21,019::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:21,029::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:21,039::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name afd24d51-5438-4385-bd13-288c4e5c4d5e a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:21,065::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:21,152::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041938 s, 24.4 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:05:22,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:22,591::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0004065 s, 10.1 MB/s\n'; <rc> = 0 >Thread-809::DEBUG::2013-03-01 13:05:22,645::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-809::DEBUG::2013-03-01 13:05:22,646::task::568::TaskManager.Task::(_updateState) Task=`6af0eeca-e213-438a-bfe6-5c302f9caffe`::moving from state init -> state preparing >Thread-809::INFO::2013-03-01 13:05:22,647::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-809::INFO::2013-03-01 13:05:22,647::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-809::DEBUG::2013-03-01 13:05:22,648::task::1151::TaskManager.Task::(prepare) Task=`6af0eeca-e213-438a-bfe6-5c302f9caffe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-809::DEBUG::2013-03-01 13:05:22,648::task::568::TaskManager.Task::(_updateState) Task=`6af0eeca-e213-438a-bfe6-5c302f9caffe`::moving from state preparing -> state finished >Thread-809::DEBUG::2013-03-01 13:05:22,649::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-809::DEBUG::2013-03-01 13:05:22,649::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-809::DEBUG::2013-03-01 13:05:22,650::task::957::TaskManager.Task::(_decref) Task=`6af0eeca-e213-438a-bfe6-5c302f9caffe`::ref 0 aborting False >Thread-810::DEBUG::2013-03-01 13:05:22,675::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-810::DEBUG::2013-03-01 13:05:22,676::task::568::TaskManager.Task::(_updateState) Task=`99f079ca-e734-4f16-a427-2540d59f4c7d`::moving from state init -> state preparing >Thread-810::INFO::2013-03-01 13:05:22,677::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-810::DEBUG::2013-03-01 13:05:22,677::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b698737d-3b53-495f-b5c3-f411063db5fb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-810::DEBUG::2013-03-01 13:05:22,678::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-810::DEBUG::2013-03-01 13:05:22,678::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-810::DEBUG::2013-03-01 13:05:22,678::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`b698737d-3b53-495f-b5c3-f411063db5fb`::Granted request >Thread-810::DEBUG::2013-03-01 13:05:22,679::task::794::TaskManager.Task::(resourceAcquired) Task=`99f079ca-e734-4f16-a427-2540d59f4c7d`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-810::DEBUG::2013-03-01 13:05:22,679::task::957::TaskManager.Task::(_decref) Task=`99f079ca-e734-4f16-a427-2540d59f4c7d`::ref 1 aborting False >Thread-810::INFO::2013-03-01 13:05:22,680::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-810::DEBUG::2013-03-01 13:05:22,680::task::1151::TaskManager.Task::(prepare) Task=`99f079ca-e734-4f16-a427-2540d59f4c7d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '44828721152', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-810::DEBUG::2013-03-01 13:05:22,681::task::568::TaskManager.Task::(_updateState) Task=`99f079ca-e734-4f16-a427-2540d59f4c7d`::moving from state preparing -> state finished >Thread-810::DEBUG::2013-03-01 13:05:22,681::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-810::DEBUG::2013-03-01 13:05:22,681::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-810::DEBUG::2013-03-01 13:05:22,681::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-810::DEBUG::2013-03-01 13:05:22,682::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-810::DEBUG::2013-03-01 13:05:22,682::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-810::DEBUG::2013-03-01 13:05:22,682::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-810::DEBUG::2013-03-01 13:05:22,682::task::957::TaskManager.Task::(_decref) Task=`99f079ca-e734-4f16-a427-2540d59f4c7d`::ref 0 aborting False >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,692::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,692::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,693::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,693::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,693::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::INFO::2013-03-01 13:05:22,694::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e with size = 12582912 sectors >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,694::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e 6291456K' (cwd None) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,706::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,707::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,708::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,954::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,971::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::WARNING::2013-03-01 13:05:22,971::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,972::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 8 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:22,972::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag MD_8 a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:23,166::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,198::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,200::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:23,278::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655868 s, 15.6 MB/s\n'; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,425::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,426::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,426::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,427::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,437::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=afd24d51-5438-4385-bd13-288c4e5c4d5e sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,443::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,452::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,452::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' (0 active users) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,453::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free, finding out if anyone is waiting for it. >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,453::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', Clearing records. >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,453::task::568::TaskManager.Task::(_updateState) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::moving from state running -> state finished >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,454::task::719::TaskManager.Task::(_save) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/f75ede85-8a68-4e8e-aa0e-d41087dfcfec.temp >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,464::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,465::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,465::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,465::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,466::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,466::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,466::task::880::TaskManager.Task::(_runJobs) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::Task.run: exit - success: result {'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e'} >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,467::task::957::TaskManager.Task::(_decref) Task=`f75ede85-8a68-4e8e-aa0e-d41087dfcfec`::ref 0 aborting False >f75ede85-8a68-4e8e-aa0e-d41087dfcfec::DEBUG::2013-03-01 13:05:23,467::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-811::DEBUG::2013-03-01 13:05:23,734::task::568::TaskManager.Task::(_updateState) Task=`b73e25b7-131b-43a7-88b3-8219df09f265`::moving from state init -> state preparing >Thread-811::INFO::2013-03-01 13:05:23,734::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-811::INFO::2013-03-01 13:05:23,735::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102298259735', 'lastCheck': '5.2', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0134060382843', 'lastCheck': '1.1', 'code': 0, 'valid': True}} >Thread-811::DEBUG::2013-03-01 13:05:23,735::task::1151::TaskManager.Task::(prepare) Task=`b73e25b7-131b-43a7-88b3-8219df09f265`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102298259735', 'lastCheck': '5.2', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0134060382843', 'lastCheck': '1.1', 'code': 0, 'valid': True}} >Thread-811::DEBUG::2013-03-01 13:05:23,735::task::568::TaskManager.Task::(_updateState) Task=`b73e25b7-131b-43a7-88b3-8219df09f265`::moving from state preparing -> state finished >Thread-811::DEBUG::2013-03-01 13:05:23,736::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-811::DEBUG::2013-03-01 13:05:23,736::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-811::DEBUG::2013-03-01 13:05:23,736::task::957::TaskManager.Task::(_decref) Task=`b73e25b7-131b-43a7-88b3-8219df09f265`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:25,292::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:25,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415912 s, 24.6 MB/s\n'; <rc> = 0 >Thread-813::DEBUG::2013-03-01 13:05:26,788::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-813::DEBUG::2013-03-01 13:05:26,789::task::568::TaskManager.Task::(_updateState) Task=`d9fb5263-0d33-4f06-a936-fbbe0e1fd43f`::moving from state init -> state preparing >Thread-813::INFO::2013-03-01 13:05:26,789::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-813::DEBUG::2013-03-01 13:05:26,789::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-813::DEBUG::2013-03-01 13:05:26,790::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f75ede85-8a68-4e8e-aa0e-d41087dfcfec >Thread-813::DEBUG::2013-03-01 13:05:26,790::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f75ede85-8a68-4e8e-aa0e-d41087dfcfec'} >Thread-813::DEBUG::2013-03-01 13:05:26,790::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'f75ede85-8a68-4e8e-aa0e-d41087dfcfec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f75ede85-8a68-4e8e-aa0e-d41087dfcfec'}} >Thread-813::INFO::2013-03-01 13:05:26,791::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'f75ede85-8a68-4e8e-aa0e-d41087dfcfec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f75ede85-8a68-4e8e-aa0e-d41087dfcfec'}}} >Thread-813::DEBUG::2013-03-01 13:05:26,791::task::1151::TaskManager.Task::(prepare) Task=`d9fb5263-0d33-4f06-a936-fbbe0e1fd43f`::finished: {'allTasksStatus': {'f75ede85-8a68-4e8e-aa0e-d41087dfcfec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f75ede85-8a68-4e8e-aa0e-d41087dfcfec'}}} >Thread-813::DEBUG::2013-03-01 13:05:26,791::task::568::TaskManager.Task::(_updateState) Task=`d9fb5263-0d33-4f06-a936-fbbe0e1fd43f`::moving from state preparing -> state finished >Thread-813::DEBUG::2013-03-01 13:05:26,791::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-813::DEBUG::2013-03-01 13:05:26,792::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-813::DEBUG::2013-03-01 13:05:26,792::task::957::TaskManager.Task::(_decref) Task=`d9fb5263-0d33-4f06-a936-fbbe0e1fd43f`::ref 0 aborting False >Thread-815::DEBUG::2013-03-01 13:05:26,872::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-815::DEBUG::2013-03-01 13:05:26,873::task::568::TaskManager.Task::(_updateState) Task=`28a68a80-0587-4b32-80ee-55c77a94a835`::moving from state init -> state preparing >Thread-815::INFO::2013-03-01 13:05:26,873::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', volUUID='afd24d51-5438-4385-bd13-288c4e5c4d5e', options=None) >Thread-815::DEBUG::2013-03-01 13:05:26,874::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`05009056-fc82-4f8f-ae2d-e584aedd41cc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-815::DEBUG::2013-03-01 13:05:26,874::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-815::DEBUG::2013-03-01 13:05:26,875::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-815::DEBUG::2013-03-01 13:05:26,875::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`05009056-fc82-4f8f-ae2d-e584aedd41cc`::Granted request >Thread-815::DEBUG::2013-03-01 13:05:26,876::task::794::TaskManager.Task::(resourceAcquired) Task=`28a68a80-0587-4b32-80ee-55c77a94a835`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-815::DEBUG::2013-03-01 13:05:26,876::task::957::TaskManager.Task::(_decref) Task=`28a68a80-0587-4b32-80ee-55c77a94a835`::ref 1 aborting False >Thread-815::DEBUG::2013-03-01 13:05:26,877::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-815::DEBUG::2013-03-01 13:05:26,878::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-815::DEBUG::2013-03-01 13:05:27,075::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-815::DEBUG::2013-03-01 13:05:27,087::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-815::INFO::2013-03-01 13:05:27,088::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 volUUID = afd24d51-5438-4385-bd13-288c4e5c4d5e >Thread-815::DEBUG::2013-03-01 13:05:27,088::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-815::DEBUG::2013-03-01 13:05:27,098::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000323739 s, 1.6 MB/s\n'; <rc> = 0 >Thread-815::DEBUG::2013-03-01 13:05:27,099::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000323739 s, 1.6 MB/s'], size: 512 >Thread-815::DEBUG::2013-03-01 13:05:27,100::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-815::DEBUG::2013-03-01 13:05:27,110::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000347662 s, 1.5 MB/s\n'; <rc> = 0 >Thread-815::DEBUG::2013-03-01 13:05:27,110::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000347662 s, 1.5 MB/s'], size: 512 >Thread-815::DEBUG::2013-03-01 13:05:27,111::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-815::DEBUG::2013-03-01 13:05:27,112::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-815::DEBUG::2013-03-01 13:05:27,357::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-815::DEBUG::2013-03-01 13:05:27,373::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-815::INFO::2013-03-01 13:05:27,374::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-815::INFO::2013-03-01 13:05:27,374::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-815::DEBUG::2013-03-01 13:05:27,374::task::1151::TaskManager.Task::(prepare) Task=`28a68a80-0587-4b32-80ee-55c77a94a835`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-815::DEBUG::2013-03-01 13:05:27,375::task::568::TaskManager.Task::(_updateState) Task=`28a68a80-0587-4b32-80ee-55c77a94a835`::moving from state preparing -> state finished >Thread-815::DEBUG::2013-03-01 13:05:27,375::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-815::DEBUG::2013-03-01 13:05:27,375::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-815::DEBUG::2013-03-01 13:05:27,376::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-815::DEBUG::2013-03-01 13:05:27,376::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-815::DEBUG::2013-03-01 13:05:27,376::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-815::DEBUG::2013-03-01 13:05:27,377::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-815::DEBUG::2013-03-01 13:05:27,377::task::957::TaskManager.Task::(_decref) Task=`28a68a80-0587-4b32-80ee-55c77a94a835`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:27,403::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-816::DEBUG::2013-03-01 13:05:27,439::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-816::DEBUG::2013-03-01 13:05:27,443::task::568::TaskManager.Task::(_updateState) Task=`811e41d9-3f82-46bd-bbe5-60282bce46ee`::moving from state init -> state preparing >Thread-816::INFO::2013-03-01 13:05:27,445::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='f75ede85-8a68-4e8e-aa0e-d41087dfcfec', spUUID=None, options=None) >Thread-816::DEBUG::2013-03-01 13:05:27,446::taskManager::161::TaskManager::(clearTask) Entry. taskID: f75ede85-8a68-4e8e-aa0e-d41087dfcfec >Thread-816::DEBUG::2013-03-01 13:05:27,450::taskManager::166::TaskManager::(clearTask) Return. >Thread-816::INFO::2013-03-01 13:05:27,452::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-816::DEBUG::2013-03-01 13:05:27,453::task::1151::TaskManager.Task::(prepare) Task=`811e41d9-3f82-46bd-bbe5-60282bce46ee`::finished: None >Thread-816::DEBUG::2013-03-01 13:05:27,454::task::568::TaskManager.Task::(_updateState) Task=`811e41d9-3f82-46bd-bbe5-60282bce46ee`::moving from state preparing -> state finished >Thread-816::DEBUG::2013-03-01 13:05:27,455::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-816::DEBUG::2013-03-01 13:05:27,457::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-816::DEBUG::2013-03-01 13:05:27,459::task::957::TaskManager.Task::(_decref) Task=`811e41d9-3f82-46bd-bbe5-60282bce46ee`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:27,540::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0721514 s, 14.2 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:05:28,508::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:28,518::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000317634 s, 12.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:29,560::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:29,673::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483571 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:31,693::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:31,799::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0418052 s, 24.5 MB/s\n'; <rc> = 0 >Thread-818::DEBUG::2013-03-01 13:05:32,547::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-818::DEBUG::2013-03-01 13:05:32,548::task::568::TaskManager.Task::(_updateState) Task=`76c68b44-0b7c-473c-9f1f-88028fd8c217`::moving from state init -> state preparing >Thread-818::INFO::2013-03-01 13:05:32,548::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', volUUID='afd24d51-5438-4385-bd13-288c4e5c4d5e', options=None) >Thread-818::DEBUG::2013-03-01 13:05:32,549::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`90256121-ba22-4590-bdce-47458d597748`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-818::DEBUG::2013-03-01 13:05:32,550::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-818::DEBUG::2013-03-01 13:05:32,550::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-818::DEBUG::2013-03-01 13:05:32,551::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`90256121-ba22-4590-bdce-47458d597748`::Granted request >Thread-818::DEBUG::2013-03-01 13:05:32,551::task::794::TaskManager.Task::(resourceAcquired) Task=`76c68b44-0b7c-473c-9f1f-88028fd8c217`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-818::DEBUG::2013-03-01 13:05:32,551::task::957::TaskManager.Task::(_decref) Task=`76c68b44-0b7c-473c-9f1f-88028fd8c217`::ref 1 aborting False >Thread-818::INFO::2013-03-01 13:05:32,552::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 volUUID = afd24d51-5438-4385-bd13-288c4e5c4d5e >Thread-818::DEBUG::2013-03-01 13:05:32,553::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-818::DEBUG::2013-03-01 13:05:32,562::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000358723 s, 1.4 MB/s\n'; <rc> = 0 >Thread-818::DEBUG::2013-03-01 13:05:32,562::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000358723 s, 1.4 MB/s'], size: 512 >Thread-818::DEBUG::2013-03-01 13:05:32,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-818::DEBUG::2013-03-01 13:05:32,575::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000339446 s, 1.5 MB/s\n'; <rc> = 0 >Thread-818::DEBUG::2013-03-01 13:05:32,575::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000339446 s, 1.5 MB/s'], size: 512 >Thread-818::DEBUG::2013-03-01 13:05:32,576::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-818::DEBUG::2013-03-01 13:05:32,577::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:32,598::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:05:32,599::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-818::DEBUG::2013-03-01 13:05:32,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-818::INFO::2013-03-01 13:05:32,802::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-818::INFO::2013-03-01 13:05:32,803::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-818::DEBUG::2013-03-01 13:05:32,803::task::1151::TaskManager.Task::(prepare) Task=`76c68b44-0b7c-473c-9f1f-88028fd8c217`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-818::DEBUG::2013-03-01 13:05:32,803::task::568::TaskManager.Task::(_updateState) Task=`76c68b44-0b7c-473c-9f1f-88028fd8c217`::moving from state preparing -> state finished >Thread-818::DEBUG::2013-03-01 13:05:32,803::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-818::DEBUG::2013-03-01 13:05:32,803::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-818::DEBUG::2013-03-01 13:05:32,804::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-818::DEBUG::2013-03-01 13:05:32,804::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-818::DEBUG::2013-03-01 13:05:32,804::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-818::DEBUG::2013-03-01 13:05:32,804::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-818::DEBUG::2013-03-01 13:05:32,805::task::957::TaskManager.Task::(_decref) Task=`76c68b44-0b7c-473c-9f1f-88028fd8c217`::ref 0 aborting False >Thread-819::DEBUG::2013-03-01 13:05:32,830::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-819::DEBUG::2013-03-01 13:05:32,866::task::568::TaskManager.Task::(_updateState) Task=`921ed394-ef9a-4d40-aa7d-cdd047967e3d`::moving from state init -> state preparing >Thread-819::INFO::2013-03-01 13:05:32,866::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', volUUID='bae6764b-ba3d-4d6b-9c50-c68e3475557a', options=None) >Thread-819::DEBUG::2013-03-01 13:05:32,867::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`821cbb59-5a47-48e3-a714-019cadd6ab22`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-819::DEBUG::2013-03-01 13:05:32,867::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-819::DEBUG::2013-03-01 13:05:32,867::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-819::DEBUG::2013-03-01 13:05:32,868::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`821cbb59-5a47-48e3-a714-019cadd6ab22`::Granted request >Thread-819::DEBUG::2013-03-01 13:05:32,868::task::794::TaskManager.Task::(resourceAcquired) Task=`921ed394-ef9a-4d40-aa7d-cdd047967e3d`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-819::DEBUG::2013-03-01 13:05:32,868::task::957::TaskManager.Task::(_decref) Task=`921ed394-ef9a-4d40-aa7d-cdd047967e3d`::ref 1 aborting False >Thread-819::INFO::2013-03-01 13:05:32,869::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=95f46aaa-0648-4571-8edc-11c392259094 volUUID = bae6764b-ba3d-4d6b-9c50-c68e3475557a >Thread-819::DEBUG::2013-03-01 13:05:32,869::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-819::DEBUG::2013-03-01 13:05:32,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000289515 s, 1.8 MB/s\n'; <rc> = 0 >Thread-819::DEBUG::2013-03-01 13:05:32,894::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000289515 s, 1.8 MB/s'], size: 512 >Thread-819::DEBUG::2013-03-01 13:05:32,895::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-819::DEBUG::2013-03-01 13:05:32,904::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311467 s, 1.6 MB/s\n'; <rc> = 0 >Thread-819::DEBUG::2013-03-01 13:05:32,905::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311467 s, 1.6 MB/s'], size: 512 >Thread-819::DEBUG::2013-03-01 13:05:32,905::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-819::DEBUG::2013-03-01 13:05:32,908::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:32,943::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:05:32,945::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:32,957::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319688 s, 12.8 MB/s\n'; <rc> = 0 >Thread-819::DEBUG::2013-03-01 13:05:33,166::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-819::DEBUG::2013-03-01 13:05:33,180::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-819::INFO::2013-03-01 13:05:33,181::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-819::INFO::2013-03-01 13:05:33,181::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-819::DEBUG::2013-03-01 13:05:33,181::task::1151::TaskManager.Task::(prepare) Task=`921ed394-ef9a-4d40-aa7d-cdd047967e3d`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-819::DEBUG::2013-03-01 13:05:33,181::task::568::TaskManager.Task::(_updateState) Task=`921ed394-ef9a-4d40-aa7d-cdd047967e3d`::moving from state preparing -> state finished >Thread-819::DEBUG::2013-03-01 13:05:33,182::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-819::DEBUG::2013-03-01 13:05:33,182::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-819::DEBUG::2013-03-01 13:05:33,182::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-819::DEBUG::2013-03-01 13:05:33,182::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-819::DEBUG::2013-03-01 13:05:33,183::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-819::DEBUG::2013-03-01 13:05:33,183::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-819::DEBUG::2013-03-01 13:05:33,183::task::957::TaskManager.Task::(_decref) Task=`921ed394-ef9a-4d40-aa7d-cdd047967e3d`::ref 0 aborting False >Thread-821::DEBUG::2013-03-01 13:05:33,221::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-821::DEBUG::2013-03-01 13:05:33,222::task::568::TaskManager.Task::(_updateState) Task=`9e20c1f2-cffd-4ec4-8b0f-7fc7b9721b0e`::moving from state init -> state preparing >Thread-821::INFO::2013-03-01 13:05:33,223::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-821::INFO::2013-03-01 13:05:33,223::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-821::DEBUG::2013-03-01 13:05:33,223::task::1151::TaskManager.Task::(prepare) Task=`9e20c1f2-cffd-4ec4-8b0f-7fc7b9721b0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-821::DEBUG::2013-03-01 13:05:33,224::task::568::TaskManager.Task::(_updateState) Task=`9e20c1f2-cffd-4ec4-8b0f-7fc7b9721b0e`::moving from state preparing -> state finished >Thread-821::DEBUG::2013-03-01 13:05:33,224::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-821::DEBUG::2013-03-01 13:05:33,224::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-821::DEBUG::2013-03-01 13:05:33,224::task::957::TaskManager.Task::(_decref) Task=`9e20c1f2-cffd-4ec4-8b0f-7fc7b9721b0e`::ref 0 aborting False >Thread-822::DEBUG::2013-03-01 13:05:33,257::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-822::DEBUG::2013-03-01 13:05:33,257::task::568::TaskManager.Task::(_updateState) Task=`1dbabe94-7e40-4534-9f65-4a90ca989c66`::moving from state init -> state preparing >Thread-822::INFO::2013-03-01 13:05:33,258::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-822::DEBUG::2013-03-01 13:05:33,258::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`46765043-c2b2-4a2e-b998-d0e130b78427`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-822::DEBUG::2013-03-01 13:05:33,258::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-822::DEBUG::2013-03-01 13:05:33,259::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-822::DEBUG::2013-03-01 13:05:33,259::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`46765043-c2b2-4a2e-b998-d0e130b78427`::Granted request >Thread-822::DEBUG::2013-03-01 13:05:33,259::task::794::TaskManager.Task::(resourceAcquired) Task=`1dbabe94-7e40-4534-9f65-4a90ca989c66`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-822::DEBUG::2013-03-01 13:05:33,260::task::957::TaskManager.Task::(_decref) Task=`1dbabe94-7e40-4534-9f65-4a90ca989c66`::ref 1 aborting False >Thread-822::INFO::2013-03-01 13:05:33,261::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-822::DEBUG::2013-03-01 13:05:33,261::task::1151::TaskManager.Task::(prepare) Task=`1dbabe94-7e40-4534-9f65-4a90ca989c66`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-822::DEBUG::2013-03-01 13:05:33,261::task::568::TaskManager.Task::(_updateState) Task=`1dbabe94-7e40-4534-9f65-4a90ca989c66`::moving from state preparing -> state finished >Thread-822::DEBUG::2013-03-01 13:05:33,262::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-822::DEBUG::2013-03-01 13:05:33,262::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-822::DEBUG::2013-03-01 13:05:33,262::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-822::DEBUG::2013-03-01 13:05:33,263::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-822::DEBUG::2013-03-01 13:05:33,263::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-822::DEBUG::2013-03-01 13:05:33,263::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-822::DEBUG::2013-03-01 13:05:33,263::task::957::TaskManager.Task::(_decref) Task=`1dbabe94-7e40-4534-9f65-4a90ca989c66`::ref 0 aborting False >Thread-823::DEBUG::2013-03-01 13:05:33,300::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-823::DEBUG::2013-03-01 13:05:33,301::task::568::TaskManager.Task::(_updateState) Task=`1dae3379-fa33-40d2-96e6-db533b3c38e9`::moving from state init -> state preparing >Thread-823::INFO::2013-03-01 13:05:33,301::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', volUUID='afd24d51-5438-4385-bd13-288c4e5c4d5e', options=None) >Thread-823::DEBUG::2013-03-01 13:05:33,301::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`3e41c406-5aec-4121-8583-0d42e8e6ec45`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-823::DEBUG::2013-03-01 13:05:33,302::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-823::DEBUG::2013-03-01 13:05:33,302::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-823::DEBUG::2013-03-01 13:05:33,302::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`3e41c406-5aec-4121-8583-0d42e8e6ec45`::Granted request >Thread-823::DEBUG::2013-03-01 13:05:33,303::task::794::TaskManager.Task::(resourceAcquired) Task=`1dae3379-fa33-40d2-96e6-db533b3c38e9`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-823::DEBUG::2013-03-01 13:05:33,303::task::957::TaskManager.Task::(_decref) Task=`1dae3379-fa33-40d2-96e6-db533b3c38e9`::ref 1 aborting False >Thread-823::INFO::2013-03-01 13:05:33,303::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 volUUID = afd24d51-5438-4385-bd13-288c4e5c4d5e >Thread-823::DEBUG::2013-03-01 13:05:33,304::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-823::DEBUG::2013-03-01 13:05:33,313::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000345494 s, 1.5 MB/s\n'; <rc> = 0 >Thread-823::DEBUG::2013-03-01 13:05:33,314::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000345494 s, 1.5 MB/s'], size: 512 >Thread-823::DEBUG::2013-03-01 13:05:33,315::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-823::DEBUG::2013-03-01 13:05:33,325::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000441205 s, 1.2 MB/s\n'; <rc> = 0 >Thread-823::DEBUG::2013-03-01 13:05:33,326::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000441205 s, 1.2 MB/s'], size: 512 >Thread-823::DEBUG::2013-03-01 13:05:33,326::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-823::DEBUG::2013-03-01 13:05:33,327::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-823::DEBUG::2013-03-01 13:05:33,517::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-823::DEBUG::2013-03-01 13:05:33,528::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-823::INFO::2013-03-01 13:05:33,529::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-823::INFO::2013-03-01 13:05:33,529::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-823::DEBUG::2013-03-01 13:05:33,529::task::1151::TaskManager.Task::(prepare) Task=`1dae3379-fa33-40d2-96e6-db533b3c38e9`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135923', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135923', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-823::DEBUG::2013-03-01 13:05:33,529::task::568::TaskManager.Task::(_updateState) Task=`1dae3379-fa33-40d2-96e6-db533b3c38e9`::moving from state preparing -> state finished >Thread-823::DEBUG::2013-03-01 13:05:33,530::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-823::DEBUG::2013-03-01 13:05:33,530::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-823::DEBUG::2013-03-01 13:05:33,530::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-823::DEBUG::2013-03-01 13:05:33,530::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-823::DEBUG::2013-03-01 13:05:33,531::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-823::DEBUG::2013-03-01 13:05:33,531::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-823::DEBUG::2013-03-01 13:05:33,531::task::957::TaskManager.Task::(_decref) Task=`1dae3379-fa33-40d2-96e6-db533b3c38e9`::ref 0 aborting False >Thread-824::DEBUG::2013-03-01 13:05:33,562::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-824::DEBUG::2013-03-01 13:05:33,562::task::568::TaskManager.Task::(_updateState) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::moving from state init -> state preparing >Thread-824::INFO::2013-03-01 13:05:33,563::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='2802458b-c98e-4b45-9c22-291d956c393d', desc='', srcImgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', srcVolUUID='afd24d51-5438-4385-bd13-288c4e5c4d5e') >Thread-824::INFO::2013-03-01 13:05:33,563::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-824::DEBUG::2013-03-01 13:05:33,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-824::DEBUG::2013-03-01 13:05:33,754::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-824::DEBUG::2013-03-01 13:05:33,754::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-824::DEBUG::2013-03-01 13:05:33,755::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-824::DEBUG::2013-03-01 13:05:33,755::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-824::DEBUG::2013-03-01 13:05:33,755::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-824::DEBUG::2013-03-01 13:05:33,756::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-824::DEBUG::2013-03-01 13:05:33,756::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:33,819::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:33,905::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343555 s, 29.8 MB/s\n'; <rc> = 0 >Thread-824::DEBUG::2013-03-01 13:05:33,965::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-824::DEBUG::2013-03-01 13:05:33,967::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-824::DEBUG::2013-03-01 13:05:33,967::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-824::DEBUG::2013-03-01 13:05:33,968::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9fe9db52-139d-4b4a-8f8c-3c6f10a437f5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-824::DEBUG::2013-03-01 13:05:33,969::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-824::DEBUG::2013-03-01 13:05:33,969::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-824::DEBUG::2013-03-01 13:05:33,969::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`9fe9db52-139d-4b4a-8f8c-3c6f10a437f5`::Granted request >Thread-824::DEBUG::2013-03-01 13:05:33,970::task::794::TaskManager.Task::(resourceAcquired) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-824::DEBUG::2013-03-01 13:05:33,970::task::957::TaskManager.Task::(_decref) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::ref 1 aborting False >Thread-824::DEBUG::2013-03-01 13:05:33,971::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >Thread-824::DEBUG::2013-03-01 13:05:33,976::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 3251b1dd-9391-47e8-bc11-7dd8c169e832 >Thread-824::INFO::2013-03-01 13:05:33,977::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-824::DEBUG::2013-03-01 13:05:33,977::task::1146::TaskManager.Task::(prepare) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::Prepare: 1 jobs exist, move to acquiring >Thread-824::DEBUG::2013-03-01 13:05:33,977::task::568::TaskManager.Task::(_updateState) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::moving from state preparing -> state acquiring >Thread-824::DEBUG::2013-03-01 13:05:33,978::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >Thread-824::DEBUG::2013-03-01 13:05:33,983::task::568::TaskManager.Task::(_updateState) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::moving from state acquiring -> state queued >Thread-824::DEBUG::2013-03-01 13:05:33,984::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >Thread-824::DEBUG::2013-03-01 13:05:33,989::taskManager::50::TaskManager::(_queueTask) queuing task: 3251b1dd-9391-47e8-bc11-7dd8c169e832 >Thread-824::DEBUG::2013-03-01 13:05:33,989::taskManager::56::TaskManager::(_queueTask) task queued: 3251b1dd-9391-47e8-bc11-7dd8c169e832 >408b3f9b-b144-4002-a399-f3b3ef9f47dd::DEBUG::2013-03-01 13:05:33,990::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-824::DEBUG::2013-03-01 13:05:33,990::task::1148::TaskManager.Task::(prepare) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::returning >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:33,991::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 3251b1dd-9391-47e8-bc11-7dd8c169e832 running: <bound method Task.commit of <storage.task.Task instance at 0x17b3518>> with: None >Thread-824::DEBUG::2013-03-01 13:05:33,991::task::957::TaskManager.Task::(_decref) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::ref 0 aborting False >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:33,992::task::1159::TaskManager.Task::(commit) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::committing task: 3251b1dd-9391-47e8-bc11-7dd8c169e832 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:33,993::task::568::TaskManager.Task::(_updateState) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::moving from state queued -> state running >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:33,995::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,001::task::872::TaskManager.Task::(_runJobs) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 12582912, 4, 2, 2, '2802458b-c98e-4b45-9c22-291d956c393d', '', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'afd24d51-5438-4385-bd13-288c4e5c4d5e') kwargs: {}) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,001::task::304::TaskManager.Task::(run) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 12582912, 4, 2, 2, '2802458b-c98e-4b45-9c22-291d956c393d', '', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'afd24d51-5438-4385-bd13-288c4e5c4d5e') kwargs: {}) callback None >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,002::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`70c885e2-f4f3-44c0-8a75-8861242dbc87`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,002::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' for lock type 'exclusive' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,002::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,003::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-825::DEBUG::2013-03-01 13:05:34,043::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-825::DEBUG::2013-03-01 13:05:34,044::task::568::TaskManager.Task::(_updateState) Task=`6cfa1278-ceb3-428a-b18e-2769bb7ba239`::moving from state init -> state preparing >Thread-825::INFO::2013-03-01 13:05:34,044::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', volUUID='bae6764b-ba3d-4d6b-9c50-c68e3475557a', options=None) >Thread-825::DEBUG::2013-03-01 13:05:34,045::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d497f532-ab68-4de3-8d91-6b26393cc3ed`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-825::DEBUG::2013-03-01 13:05:34,045::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-825::DEBUG::2013-03-01 13:05:34,046::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-825::DEBUG::2013-03-01 13:05:34,046::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`d497f532-ab68-4de3-8d91-6b26393cc3ed`::Granted request >Thread-825::DEBUG::2013-03-01 13:05:34,047::task::794::TaskManager.Task::(resourceAcquired) Task=`6cfa1278-ceb3-428a-b18e-2769bb7ba239`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-825::DEBUG::2013-03-01 13:05:34,047::task::957::TaskManager.Task::(_decref) Task=`6cfa1278-ceb3-428a-b18e-2769bb7ba239`::ref 1 aborting False >Thread-825::DEBUG::2013-03-01 13:05:34,048::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-825::DEBUG::2013-03-01 13:05:34,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,245::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,269::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000225373 s, 2.3 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,270::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000225373 s, 2.3 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,280::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00029408 s, 1.7 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,281::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00029408 s, 1.7 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::INFO::2013-03-01 13:05:34,281::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f803bb10>] >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,282::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`3a902c3e-e743-4609-a2fa-60d4d9ff6dee`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,282::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' for lock type 'exclusive' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,283::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free. Now locking as 'exclusive' (1 active user) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,284::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`3a902c3e-e743-4609-a2fa-60d4d9ff6dee`::Granted request >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,286::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free. Now locking as 'exclusive' (1 active user) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,287::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`70c885e2-f4f3-44c0-8a75-8861242dbc87`::Granted request >Thread-825::DEBUG::2013-03-01 13:05:34,288::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,296::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-825::INFO::2013-03-01 13:05:34,319::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=95f46aaa-0648-4571-8edc-11c392259094 volUUID = bae6764b-ba3d-4d6b-9c50-c68e3475557a >Thread-825::DEBUG::2013-03-01 13:05:34,319::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-825::DEBUG::2013-03-01 13:05:34,329::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000304948 s, 1.7 MB/s\n'; <rc> = 0 >Thread-825::DEBUG::2013-03-01 13:05:34,329::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000304948 s, 1.7 MB/s'], size: 512 >Thread-825::DEBUG::2013-03-01 13:05:34,330::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-825::DEBUG::2013-03-01 13:05:34,340::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000368171 s, 1.4 MB/s\n'; <rc> = 0 >Thread-825::DEBUG::2013-03-01 13:05:34,341::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000368171 s, 1.4 MB/s'], size: 512 >Thread-825::DEBUG::2013-03-01 13:05:34,341::lvm::414::OperationMutex::(_reloadlvs) Got the operational mutex >Thread-825::DEBUG::2013-03-01 13:05:34,342::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,507::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::WARNING::2013-03-01 13:05:34,519::lvm::593::Storage.LVM::(getLv) lv: 2802458b-c98e-4b45-9c22-291d956c393d not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,520::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00027135 s, 1.9 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,531::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00027135 s, 1.9 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,532::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-825::DEBUG::2013-03-01 13:05:34,545::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,559::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000288321 s, 1.8 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,561::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000288321 s, 1.8 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::INFO::2013-03-01 13:05:34,562::volume::457::Storage.Volume::(create) Creating volume 2802458b-c98e-4b45-9c22-291d956c393d >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,567::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >Thread-825::DEBUG::2013-03-01 13:05:34,574::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-825::INFO::2013-03-01 13:05:34,576::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-825::INFO::2013-03-01 13:05:34,578::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-825::DEBUG::2013-03-01 13:05:34,580::task::1151::TaskManager.Task::(prepare) Task=`6cfa1278-ceb3-428a-b18e-2769bb7ba239`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135911', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135911', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-825::DEBUG::2013-03-01 13:05:34,581::task::568::TaskManager.Task::(_updateState) Task=`6cfa1278-ceb3-428a-b18e-2769bb7ba239`::moving from state preparing -> state finished >Thread-825::DEBUG::2013-03-01 13:05:34,582::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-825::DEBUG::2013-03-01 13:05:34,583::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-825::DEBUG::2013-03-01 13:05:34,585::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-825::DEBUG::2013-03-01 13:05:34,588::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (1 active users) >Thread-825::DEBUG::2013-03-01 13:05:34,589::task::957::TaskManager.Task::(_decref) Task=`6cfa1278-ceb3-428a-b18e-2769bb7ba239`::ref 0 aborting False >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,602::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:34,615::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 2802458b-c98e-4b45-9c22-291d956c393d a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-826::DEBUG::2013-03-01 13:05:34,625::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-826::DEBUG::2013-03-01 13:05:34,626::task::568::TaskManager.Task::(_updateState) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::moving from state init -> state preparing >Thread-826::INFO::2013-03-01 13:05:34,626::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', size='6442450944', volFormat=4, preallocate=2, diskType=2, volUUID='f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', desc='', srcImgUUID='95f46aaa-0648-4571-8edc-11c392259094', srcVolUUID='bae6764b-ba3d-4d6b-9c50-c68e3475557a') >Thread-826::INFO::2013-03-01 13:05:34,626::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-826::DEBUG::2013-03-01 13:05:34,627::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:35,924::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:36,027::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556478 s, 18.4 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,239::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,239::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,240::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,241::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,241::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::INFO::2013-03-01 13:05:36,242::blockVolume::182::Storage.Volume::(_create) Request to create snapshot 2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/2802458b-c98e-4b45-9c22-291d956c393d of volume 2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,244::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,259::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,269::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000324761 s, 1.6 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,270::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000324761 s, 1.6 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,270::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-826::DEBUG::2013-03-01 13:05:36,279::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-826::DEBUG::2013-03-01 13:05:36,282::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-826::DEBUG::2013-03-01 13:05:36,284::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,287::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000288833 s, 1.8 MB/s\n'; <rc> = 0 >Thread-826::DEBUG::2013-03-01 13:05:36,287::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,288::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000288833 s, 1.8 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,290::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... >Thread-826::DEBUG::2013-03-01 13:05:36,291::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,291::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-826::DEBUG::2013-03-01 13:05:36,293::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,296::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-826::DEBUG::2013-03-01 13:05:36,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,495::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-826::DEBUG::2013-03-01 13:05:36,644::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-826::DEBUG::2013-03-01 13:05:36,646::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-826::DEBUG::2013-03-01 13:05:36,646::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >3251b1dd-9391-47e8-bc11-7dd8c169e832::INFO::2013-03-01 13:05:36,648::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e >Thread-826::DEBUG::2013-03-01 13:05:36,652::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`2b25830c-f2c5-4ae0-8c7b-926c4ef7e6d8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-826::DEBUG::2013-03-01 13:05:36,654::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,654::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-826::DEBUG::2013-03-01 13:05:36,656::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-826::DEBUG::2013-03-01 13:05:36,667::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`2b25830c-f2c5-4ae0-8c7b-926c4ef7e6d8`::Granted request >Thread-826::DEBUG::2013-03-01 13:05:36,674::task::794::TaskManager.Task::(resourceAcquired) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-826::DEBUG::2013-03-01 13:05:36,677::task::957::TaskManager.Task::(_decref) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::ref 1 aborting False >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,679::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000345261 s, 1.5 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,682::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000345261 s, 1.5 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,685::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`5871a3e0-0113-434e-8317-2670372e2845`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,686::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' for lock type 'shared' >Thread-826::DEBUG::2013-03-01 13:05:36,692::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:36,693::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e' (cwd None) >Thread-826::DEBUG::2013-03-01 13:05:36,710::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >Thread-826::INFO::2013-03-01 13:05:36,711::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-826::DEBUG::2013-03-01 13:05:36,711::task::1146::TaskManager.Task::(prepare) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::Prepare: 1 jobs exist, move to acquiring >Thread-826::DEBUG::2013-03-01 13:05:36,711::task::568::TaskManager.Task::(_updateState) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::moving from state preparing -> state acquiring >Thread-826::DEBUG::2013-03-01 13:05:36,712::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >Thread-826::DEBUG::2013-03-01 13:05:36,719::task::568::TaskManager.Task::(_updateState) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::moving from state acquiring -> state queued >Thread-826::DEBUG::2013-03-01 13:05:36,720::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >Thread-826::DEBUG::2013-03-01 13:05:36,727::taskManager::50::TaskManager::(_queueTask) queuing task: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >Thread-826::DEBUG::2013-03-01 13:05:36,727::taskManager::56::TaskManager::(_queueTask) task queued: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >b2ef1a7d-a7e7-414e-ad1d-2e2515597c32::DEBUG::2013-03-01 13:05:36,728::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-826::DEBUG::2013-03-01 13:05:36,729::task::1148::TaskManager.Task::(prepare) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::returning >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,730::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 running: <bound method Task.commit of <storage.task.Task instance at 0x166bcf8>> with: None >Thread-826::DEBUG::2013-03-01 13:05:36,730::task::957::TaskManager.Task::(_decref) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::ref 0 aborting False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,731::task::1159::TaskManager.Task::(commit) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::committing task: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,732::task::568::TaskManager.Task::(_updateState) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::moving from state queued -> state running >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,736::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,743::task::872::TaskManager.Task::(_runJobs) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '95f46aaa-0648-4571-8edc-11c392259094', 12582912, 4, 2, 2, 'f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', '', '95f46aaa-0648-4571-8edc-11c392259094', 'bae6764b-ba3d-4d6b-9c50-c68e3475557a') kwargs: {}) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,743::task::304::TaskManager.Task::(run) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '95f46aaa-0648-4571-8edc-11c392259094', 12582912, 4, 2, 2, 'f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', '', '95f46aaa-0648-4571-8edc-11c392259094', 'bae6764b-ba3d-4d6b-9c50-c68e3475557a') kwargs: {}) callback None >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,743::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094`ReqID=`a484d59c-27d3-46dc-993a-97124519891e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,743::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' for lock type 'exclusive' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,744::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-828::DEBUG::2013-03-01 13:05:36,835::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-828::DEBUG::2013-03-01 13:05:36,835::task::568::TaskManager.Task::(_updateState) Task=`690e3caa-816d-46e9-8c64-3ee53a722ae4`::moving from state init -> state preparing >Thread-828::INFO::2013-03-01 13:05:36,836::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-828::DEBUG::2013-03-01 13:05:36,836::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-828::DEBUG::2013-03-01 13:05:36,836::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >Thread-828::DEBUG::2013-03-01 13:05:36,836::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'} >Thread-828::DEBUG::2013-03-01 13:05:36,836::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3251b1dd-9391-47e8-bc11-7dd8c169e832 >Thread-828::DEBUG::2013-03-01 13:05:36,837::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'} >Thread-828::DEBUG::2013-03-01 13:05:36,837::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'73f2e5a4-f231-4c81-98c3-b06dff5588c2': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'}, '3251b1dd-9391-47e8-bc11-7dd8c169e832': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'}} >Thread-828::INFO::2013-03-01 13:05:36,837::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'73f2e5a4-f231-4c81-98c3-b06dff5588c2': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'}, '3251b1dd-9391-47e8-bc11-7dd8c169e832': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'}}} >Thread-828::DEBUG::2013-03-01 13:05:36,837::task::1151::TaskManager.Task::(prepare) Task=`690e3caa-816d-46e9-8c64-3ee53a722ae4`::finished: {'allTasksStatus': {'73f2e5a4-f231-4c81-98c3-b06dff5588c2': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'}, '3251b1dd-9391-47e8-bc11-7dd8c169e832': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'}}} >Thread-828::DEBUG::2013-03-01 13:05:36,837::task::568::TaskManager.Task::(_updateState) Task=`690e3caa-816d-46e9-8c64-3ee53a722ae4`::moving from state preparing -> state finished >Thread-828::DEBUG::2013-03-01 13:05:36,838::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-828::DEBUG::2013-03-01 13:05:36,838::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-828::DEBUG::2013-03-01 13:05:36,838::task::957::TaskManager.Task::(_decref) Task=`690e3caa-816d-46e9-8c64-3ee53a722ae4`::ref 0 aborting False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,933::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,944::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,944::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,953::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299861 s, 1.7 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,953::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299861 s, 1.7 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,954::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,962::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000283285 s, 1.8 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,962::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000283285 s, 1.8 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::INFO::2013-03-01 13:05:36,962::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=95f46aaa-0648-4571-8edc-11c392259094 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f802e590>] >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,963::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a`ReqID=`a47bb1fd-e0f1-448d-9065-8db0397c288b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,963::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' for lock type 'exclusive' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,963::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' is free. Now locking as 'exclusive' (1 active user) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,964::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a`ReqID=`a47bb1fd-e0f1-448d-9065-8db0397c288b`::Granted request >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,964::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' is free. Now locking as 'exclusive' (1 active user) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,964::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094`ReqID=`a484d59c-27d3-46dc-993a-97124519891e`::Granted request >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,965::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:36,966::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,153::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,168::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::WARNING::2013-03-01 13:05:37,168::lvm::593::Storage.LVM::(getLv) lv: f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,169::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,179::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000301657 s, 1.7 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,180::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000301657 s, 1.7 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,181::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,190::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000331496 s, 1.5 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,191::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000331496 s, 1.5 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::INFO::2013-03-01 13:05:37,191::volume::457::Storage.Volume::(create) Creating volume f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,192::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,201::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:37,211::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:38,040::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:38,152::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469571 s, 21.8 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,267::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,268::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,268::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free. Now locking as 'shared' (1 active user) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,269::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`5871a3e0-0113-434e-8317-2670372e2845`::Granted request >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,270::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:38,272::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:38,520::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:38,530::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000284156 s, 14.4 MB/s\n'; <rc> = 0 >Thread-829::DEBUG::2013-03-01 13:05:38,998::task::568::TaskManager.Task::(_updateState) Task=`13814c43-b68e-4f4f-8d57-ddc761dbe659`::moving from state init -> state preparing >Thread-829::INFO::2013-03-01 13:05:38,999::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-829::INFO::2013-03-01 13:05:38,999::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.011127948761', 'lastCheck': '0.5', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129539966583', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-829::DEBUG::2013-03-01 13:05:38,999::task::1151::TaskManager.Task::(prepare) Task=`13814c43-b68e-4f4f-8d57-ddc761dbe659`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.011127948761', 'lastCheck': '0.5', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129539966583', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-829::DEBUG::2013-03-01 13:05:38,999::task::568::TaskManager.Task::(_updateState) Task=`13814c43-b68e-4f4f-8d57-ddc761dbe659`::moving from state preparing -> state finished >Thread-829::DEBUG::2013-03-01 13:05:39,000::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-829::DEBUG::2013-03-01 13:05:39,000::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-829::DEBUG::2013-03-01 13:05:39,000::task::957::TaskManager.Task::(_decref) Task=`13814c43-b68e-4f4f-8d57-ddc761dbe659`::ref 0 aborting False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:39,968::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:39,969::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:39,996::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,008::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,009::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/2802458b-c98e-4b45-9c22-291d956c393d >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,010::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,014::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,026::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,030::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::INFO::2013-03-01 13:05:40,033::blockVolume::182::Storage.Volume::(_create) Request to create snapshot 95f46aaa-0648-4571-8edc-11c392259094/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 of volume 95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,039::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000329777 s, 1.6 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,040::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,041::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000329777 s, 1.6 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,045::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,068::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327407 s, 1.6 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,070::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327407 s, 1.6 MB/s'], size: 512 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,074::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/2802458b-c98e-4b45-9c22-291d956c393d' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,092::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::INFO::2013-03-01 13:05:40,094::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e justme False >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,095::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,096::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' (0 active users) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,096::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free, finding out if anyone is waiting for it. >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,097::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,107::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,117::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000306735 s, 1.7 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,118::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000306735 s, 1.7 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,119::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,128::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000327475 s, 1.6 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,128::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000327475 s, 1.6 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::INFO::2013-03-01 13:05:40,130::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,140::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00031439 s, 1.6 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,141::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00031439 s, 1.6 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,141::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a`ReqID=`8d85536f-0751-4a27-8baf-5e7f8954e1fe`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,142::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' for lock type 'shared' >Dummy-173::DEBUG::2013-03-01 13:05:40,172::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:40,259::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423628 s, 24.2 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,323::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,323::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,324::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,324::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e', Clearing records. >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,327::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:40,330::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,341::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,599::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,600::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,600::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,805::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,817::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::WARNING::2013-03-01 13:05:40,817::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/2802458b-c98e-4b45-9c22-291d956c393d >3251b1dd-9391-47e8-bc11-7dd8c169e832::WARNING::2013-03-01 13:05:40,818::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,818::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 9 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:40,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_afd24d51-5438-4385-bd13-288c4e5c4d5e --addtag IU_2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 --addtag MD_9 a558fc2a-a4a3-4118-9b81-d1d601eaa295/2802458b-c98e-4b45-9c22-291d956c393d' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,003::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,024::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,025::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,025::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' is free. Now locking as 'shared' (1 active user) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,025::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a`ReqID=`8d85536f-0751-4a27-8baf-5e7f8954e1fe`::Granted request >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,026::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,054::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,055::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:42,272::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,302::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,303::volume::258::Storage.Volume::(clone) Volume.clone: /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,305::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,318::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,331::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/2802458b-c98e-4b45-9c22-291d956c393d' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,345::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00029478 s, 1.7 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,347::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00029478 s, 1.7 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,362::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000344914 s, 1.5 MB/s\n'; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,363::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000344914 s, 1.5 MB/s'], size: 512 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,367::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 -F qcow2 -b ../95f46aaa-0648-4571-8edc-11c392259094/bae6764b-ba3d-4d6b-9c50-c68e3475557a /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8' (cwd /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,383::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::INFO::2013-03-01 13:05:42,384::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a justme False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,385::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,387::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' (0 active users) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,388::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' is free, finding out if anyone is waiting for it. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,392::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:42,461::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142948 s, 7.2 MB/s\n'; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,570::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,570::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,571::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,572::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,581::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=2802458b-c98e-4b45-9c22-291d956c393d sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 9) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,587::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,593::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,593::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' (0 active users) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,593::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free, finding out if anyone is waiting for it. >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,594::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,594::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' (0 active users) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,594::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free, finding out if anyone is waiting for it. >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,594::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e', Clearing records. >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,595::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', Clearing records. >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,595::task::568::TaskManager.Task::(_updateState) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::moving from state running -> state finished >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,596::task::719::TaskManager.Task::(_save) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/3251b1dd-9391-47e8-bc11-7dd8c169e832.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,597::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,599::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,601::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,602::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a', Clearing records. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,603::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,606::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,627::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,628::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,628::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,629::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (1 active users) >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,629::task::880::TaskManager.Task::(_runJobs) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::Task.run: exit - success: result {'uuid': '2802458b-c98e-4b45-9c22-291d956c393d'} >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,629::task::957::TaskManager.Task::(_decref) Task=`3251b1dd-9391-47e8-bc11-7dd8c169e832`::ref 0 aborting False >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:05:42,630::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,801::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,816::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,817::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:42,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:42,963::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:05:42,964::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,011::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::WARNING::2013-03-01 13:05:43,022::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,022::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 10 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,023::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_95f46aaa-0648-4571-8edc-11c392259094 --addtag PU_bae6764b-ba3d-4d6b-9c50-c68e3475557a --addtag MD_10 a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:43,262::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:05:43,265::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:05:43,266::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:43,276::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000312831 s, 13.1 MB/s\n'; <rc> = 0 >Thread-832::DEBUG::2013-03-01 13:05:43,303::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-832::DEBUG::2013-03-01 13:05:43,304::task::568::TaskManager.Task::(_updateState) Task=`47363037-96ea-4380-8c32-705708151d7b`::moving from state init -> state preparing >Thread-832::INFO::2013-03-01 13:05:43,304::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-832::INFO::2013-03-01 13:05:43,305::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-832::DEBUG::2013-03-01 13:05:43,305::task::1151::TaskManager.Task::(prepare) Task=`47363037-96ea-4380-8c32-705708151d7b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-832::DEBUG::2013-03-01 13:05:43,306::task::568::TaskManager.Task::(_updateState) Task=`47363037-96ea-4380-8c32-705708151d7b`::moving from state preparing -> state finished >Thread-832::DEBUG::2013-03-01 13:05:43,308::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,309::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-832::DEBUG::2013-03-01 13:05:43,310::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,311::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-832::DEBUG::2013-03-01 13:05:43,312::task::957::TaskManager.Task::(_decref) Task=`47363037-96ea-4380-8c32-705708151d7b`::ref 0 aborting False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,313::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,316::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8' (cwd None) >Thread-833::DEBUG::2013-03-01 13:05:43,344::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-833::DEBUG::2013-03-01 13:05:43,345::task::568::TaskManager.Task::(_updateState) Task=`8cf51d32-7958-4f0e-966e-088b331bffe7`::moving from state init -> state preparing >Thread-833::INFO::2013-03-01 13:05:43,345::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-833::DEBUG::2013-03-01 13:05:43,346::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f963878b-446b-473d-abd2-acc6e6799231`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-833::DEBUG::2013-03-01 13:05:43,346::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-833::DEBUG::2013-03-01 13:05:43,347::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-833::DEBUG::2013-03-01 13:05:43,347::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f963878b-446b-473d-abd2-acc6e6799231`::Granted request >Thread-833::DEBUG::2013-03-01 13:05:43,348::task::794::TaskManager.Task::(resourceAcquired) Task=`8cf51d32-7958-4f0e-966e-088b331bffe7`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-833::DEBUG::2013-03-01 13:05:43,348::task::957::TaskManager.Task::(_decref) Task=`8cf51d32-7958-4f0e-966e-088b331bffe7`::ref 1 aborting False >Thread-833::INFO::2013-03-01 13:05:43,349::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-833::DEBUG::2013-03-01 13:05:43,349::task::1151::TaskManager.Task::(prepare) Task=`8cf51d32-7958-4f0e-966e-088b331bffe7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-833::DEBUG::2013-03-01 13:05:43,349::task::568::TaskManager.Task::(_updateState) Task=`8cf51d32-7958-4f0e-966e-088b331bffe7`::moving from state preparing -> state finished >Thread-833::DEBUG::2013-03-01 13:05:43,350::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-833::DEBUG::2013-03-01 13:05:43,350::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-833::DEBUG::2013-03-01 13:05:43,350::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-833::DEBUG::2013-03-01 13:05:43,350::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-833::DEBUG::2013-03-01 13:05:43,351::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-833::DEBUG::2013-03-01 13:05:43,351::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-833::DEBUG::2013-03-01 13:05:43,351::task::957::TaskManager.Task::(_decref) Task=`8cf51d32-7958-4f0e-966e-088b331bffe7`::ref 0 aborting False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,572::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,572::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,573::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,574::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,585::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 10) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,590::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,598::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,599::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' (0 active users) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,599::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094' is free, finding out if anyone is waiting for it. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,600::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,600::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' (0 active users) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,600::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a' is free, finding out if anyone is waiting for it. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,600::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.bae6764b-ba3d-4d6b-9c50-c68e3475557a', Clearing records. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,601::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.95f46aaa-0648-4571-8edc-11c392259094', Clearing records. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,601::task::568::TaskManager.Task::(_updateState) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::moving from state running -> state finished >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,602::task::719::TaskManager.Task::(_save) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/73f2e5a4-f231-4c81-98c3-b06dff5588c2.temp >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,611::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,611::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,611::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,612::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,612::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,612::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,613::task::880::TaskManager.Task::(_runJobs) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::Task.run: exit - success: result {'uuid': 'f3b73d7e-e7bb-4feb-8943-ab1bd39963b8'} >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,613::task::957::TaskManager.Task::(_decref) Task=`73f2e5a4-f231-4c81-98c3-b06dff5588c2`::ref 0 aborting False >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:05:43,613::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:05:44,475::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:44,589::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046489 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:46,605::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-835::DEBUG::2013-03-01 13:05:46,971::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-835::DEBUG::2013-03-01 13:05:46,986::task::568::TaskManager.Task::(_updateState) Task=`ad4dd978-51ba-4698-94c9-de5af7435776`::moving from state init -> state preparing >Thread-835::INFO::2013-03-01 13:05:46,992::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-835::DEBUG::2013-03-01 13:05:46,996::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-835::DEBUG::2013-03-01 13:05:47,000::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >Thread-835::DEBUG::2013-03-01 13:05:47,004::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'} >Thread-835::DEBUG::2013-03-01 13:05:47,008::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3251b1dd-9391-47e8-bc11-7dd8c169e832 >Thread-835::DEBUG::2013-03-01 13:05:47,012::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'} >Thread-835::DEBUG::2013-03-01 13:05:47,016::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'73f2e5a4-f231-4c81-98c3-b06dff5588c2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'}, '3251b1dd-9391-47e8-bc11-7dd8c169e832': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'}} >Thread-835::INFO::2013-03-01 13:05:47,022::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'73f2e5a4-f231-4c81-98c3-b06dff5588c2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'}, '3251b1dd-9391-47e8-bc11-7dd8c169e832': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'}}} >Thread-835::DEBUG::2013-03-01 13:05:47,027::task::1151::TaskManager.Task::(prepare) Task=`ad4dd978-51ba-4698-94c9-de5af7435776`::finished: {'allTasksStatus': {'73f2e5a4-f231-4c81-98c3-b06dff5588c2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '73f2e5a4-f231-4c81-98c3-b06dff5588c2'}, '3251b1dd-9391-47e8-bc11-7dd8c169e832': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3251b1dd-9391-47e8-bc11-7dd8c169e832'}}} >Thread-835::DEBUG::2013-03-01 13:05:47,032::task::568::TaskManager.Task::(_updateState) Task=`ad4dd978-51ba-4698-94c9-de5af7435776`::moving from state preparing -> state finished >Thread-835::DEBUG::2013-03-01 13:05:47,036::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-835::DEBUG::2013-03-01 13:05:47,040::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-835::DEBUG::2013-03-01 13:05:47,046::task::957::TaskManager.Task::(_decref) Task=`ad4dd978-51ba-4698-94c9-de5af7435776`::ref 0 aborting False >Thread-836::DEBUG::2013-03-01 13:05:47,190::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-836::DEBUG::2013-03-01 13:05:47,199::task::568::TaskManager.Task::(_updateState) Task=`347a455e-d2f0-4643-b516-e8b41977ad3c`::moving from state init -> state preparing >Thread-836::INFO::2013-03-01 13:05:47,203::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', volUUID='2802458b-c98e-4b45-9c22-291d956c393d', options=None) >Thread-836::DEBUG::2013-03-01 13:05:47,215::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`56b46b77-daa8-4ed4-a3d3-b19a745f0454`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-836::DEBUG::2013-03-01 13:05:47,220::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-836::DEBUG::2013-03-01 13:05:47,228::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-836::DEBUG::2013-03-01 13:05:47,232::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`56b46b77-daa8-4ed4-a3d3-b19a745f0454`::Granted request >Thread-836::DEBUG::2013-03-01 13:05:47,243::task::794::TaskManager.Task::(resourceAcquired) Task=`347a455e-d2f0-4643-b516-e8b41977ad3c`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-836::DEBUG::2013-03-01 13:05:47,248::task::957::TaskManager.Task::(_decref) Task=`347a455e-d2f0-4643-b516-e8b41977ad3c`::ref 1 aborting False >Thread-836::INFO::2013-03-01 13:05:47,260::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 volUUID = 2802458b-c98e-4b45-9c22-291d956c393d >Thread-836::DEBUG::2013-03-01 13:05:47,267::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-836::DEBUG::2013-03-01 13:05:47,620::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00484152 s, 106 kB/s\n'; <rc> = 0 >Thread-836::DEBUG::2013-03-01 13:05:47,637::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00484152 s, 106 kB/s'], size: 512 >Thread-836::DEBUG::2013-03-01 13:05:47,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-836::DEBUG::2013-03-01 13:05:47,925::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00452632 s, 113 kB/s\n'; <rc> = 0 >Thread-836::DEBUG::2013-03-01 13:05:47,927::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00452632 s, 113 kB/s'], size: 512 >Thread-836::DEBUG::2013-03-01 13:05:47,929::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-836::DEBUG::2013-03-01 13:05:47,934::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:48,012::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.18275 s, 866 kB/s\n'; <rc> = 0 >Thread-836::DEBUG::2013-03-01 13:05:48,179::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-836::DEBUG::2013-03-01 13:05:48,194::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-836::INFO::2013-03-01 13:05:48,195::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/2802458b-c98e-4b45-9c22-291d956c393d info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135942', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '2802458b-c98e-4b45-9c22-291d956c393d', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-836::INFO::2013-03-01 13:05:48,195::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135942', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '2802458b-c98e-4b45-9c22-291d956c393d', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-836::DEBUG::2013-03-01 13:05:48,196::task::1151::TaskManager.Task::(prepare) Task=`347a455e-d2f0-4643-b516-e8b41977ad3c`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': 'afd24d51-5438-4385-bd13-288c4e5c4d5e', 'format': 'COW', 'image': '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'ctime': '1362135942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135942', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '2802458b-c98e-4b45-9c22-291d956c393d', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-836::DEBUG::2013-03-01 13:05:48,196::task::568::TaskManager.Task::(_updateState) Task=`347a455e-d2f0-4643-b516-e8b41977ad3c`::moving from state preparing -> state finished >Thread-836::DEBUG::2013-03-01 13:05:48,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-836::DEBUG::2013-03-01 13:05:48,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-836::DEBUG::2013-03-01 13:05:48,197::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-836::DEBUG::2013-03-01 13:05:48,197::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-836::DEBUG::2013-03-01 13:05:48,198::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-836::DEBUG::2013-03-01 13:05:48,198::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-836::DEBUG::2013-03-01 13:05:48,198::task::957::TaskManager.Task::(_decref) Task=`347a455e-d2f0-4643-b516-e8b41977ad3c`::ref 0 aborting False >Thread-838::DEBUG::2013-03-01 13:05:48,234::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-838::DEBUG::2013-03-01 13:05:48,234::task::568::TaskManager.Task::(_updateState) Task=`be7c0c53-8602-4cfb-aa06-62f8a61269c0`::moving from state init -> state preparing >Thread-838::INFO::2013-03-01 13:05:48,235::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', volUUID='f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', options=None) >Thread-838::DEBUG::2013-03-01 13:05:48,235::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`be89aadd-42f8-48f6-9f4f-4c46a3d6686d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-838::DEBUG::2013-03-01 13:05:48,236::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-838::DEBUG::2013-03-01 13:05:48,236::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-838::DEBUG::2013-03-01 13:05:48,236::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`be89aadd-42f8-48f6-9f4f-4c46a3d6686d`::Granted request >Thread-838::DEBUG::2013-03-01 13:05:48,237::task::794::TaskManager.Task::(resourceAcquired) Task=`be7c0c53-8602-4cfb-aa06-62f8a61269c0`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-838::DEBUG::2013-03-01 13:05:48,237::task::957::TaskManager.Task::(_decref) Task=`be7c0c53-8602-4cfb-aa06-62f8a61269c0`::ref 1 aborting False >Thread-838::INFO::2013-03-01 13:05:48,238::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=95f46aaa-0648-4571-8edc-11c392259094 volUUID = f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 >Thread-838::DEBUG::2013-03-01 13:05:48,238::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-838::DEBUG::2013-03-01 13:05:48,249::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00034148 s, 1.5 MB/s\n'; <rc> = 0 >Thread-838::DEBUG::2013-03-01 13:05:48,249::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00034148 s, 1.5 MB/s'], size: 512 >Thread-838::DEBUG::2013-03-01 13:05:48,280::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-838::DEBUG::2013-03-01 13:05:48,289::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000308721 s, 1.7 MB/s\n'; <rc> = 0 >Thread-838::DEBUG::2013-03-01 13:05:48,290::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000308721 s, 1.7 MB/s'], size: 512 >Thread-838::DEBUG::2013-03-01 13:05:48,290::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-838::DEBUG::2013-03-01 13:05:48,291::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:48,532::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:48,542::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210498 s, 19.5 MB/s\n'; <rc> = 0 >Thread-838::DEBUG::2013-03-01 13:05:48,557::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-838::DEBUG::2013-03-01 13:05:48,570::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-838::INFO::2013-03-01 13:05:48,571::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/95f46aaa-0648-4571-8edc-11c392259094/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135943', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135943', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-838::INFO::2013-03-01 13:05:48,571::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135943', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135943', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-838::DEBUG::2013-03-01 13:05:48,571::task::1151::TaskManager.Task::(prepare) Task=`be7c0c53-8602-4cfb-aa06-62f8a61269c0`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': 'bae6764b-ba3d-4d6b-9c50-c68e3475557a', 'format': 'COW', 'image': '95f46aaa-0648-4571-8edc-11c392259094', 'ctime': '1362135943', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135943', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': 'f3b73d7e-e7bb-4feb-8943-ab1bd39963b8', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-838::DEBUG::2013-03-01 13:05:48,572::task::568::TaskManager.Task::(_updateState) Task=`be7c0c53-8602-4cfb-aa06-62f8a61269c0`::moving from state preparing -> state finished >Thread-838::DEBUG::2013-03-01 13:05:48,572::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-838::DEBUG::2013-03-01 13:05:48,572::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-838::DEBUG::2013-03-01 13:05:48,573::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-838::DEBUG::2013-03-01 13:05:48,573::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-838::DEBUG::2013-03-01 13:05:48,573::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-838::DEBUG::2013-03-01 13:05:48,574::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-838::DEBUG::2013-03-01 13:05:48,574::task::957::TaskManager.Task::(_decref) Task=`be7c0c53-8602-4cfb-aa06-62f8a61269c0`::ref 0 aborting False >Thread-839::DEBUG::2013-03-01 13:05:48,623::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-839::DEBUG::2013-03-01 13:05:48,624::task::568::TaskManager.Task::(_updateState) Task=`cc099388-af1f-45fd-99a3-1cf95a70231e`::moving from state init -> state preparing >Thread-839::INFO::2013-03-01 13:05:48,624::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='3251b1dd-9391-47e8-bc11-7dd8c169e832', spUUID=None, options=None) >Thread-839::DEBUG::2013-03-01 13:05:48,625::taskManager::161::TaskManager::(clearTask) Entry. taskID: 3251b1dd-9391-47e8-bc11-7dd8c169e832 >Thread-839::DEBUG::2013-03-01 13:05:48,626::taskManager::166::TaskManager::(clearTask) Return. >Thread-839::INFO::2013-03-01 13:05:48,626::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-839::DEBUG::2013-03-01 13:05:48,626::task::1151::TaskManager.Task::(prepare) Task=`cc099388-af1f-45fd-99a3-1cf95a70231e`::finished: None >Thread-839::DEBUG::2013-03-01 13:05:48,627::task::568::TaskManager.Task::(_updateState) Task=`cc099388-af1f-45fd-99a3-1cf95a70231e`::moving from state preparing -> state finished >Thread-839::DEBUG::2013-03-01 13:05:48,627::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-839::DEBUG::2013-03-01 13:05:48,627::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-839::DEBUG::2013-03-01 13:05:48,627::task::957::TaskManager.Task::(_decref) Task=`cc099388-af1f-45fd-99a3-1cf95a70231e`::ref 0 aborting False >Thread-840::DEBUG::2013-03-01 13:05:48,657::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-840::DEBUG::2013-03-01 13:05:48,658::task::568::TaskManager.Task::(_updateState) Task=`c1e458ae-ff8c-401a-9f78-bc10ac2f5827`::moving from state init -> state preparing >Thread-840::INFO::2013-03-01 13:05:48,658::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='73f2e5a4-f231-4c81-98c3-b06dff5588c2', spUUID=None, options=None) >Thread-840::DEBUG::2013-03-01 13:05:48,658::taskManager::161::TaskManager::(clearTask) Entry. taskID: 73f2e5a4-f231-4c81-98c3-b06dff5588c2 >Thread-840::DEBUG::2013-03-01 13:05:48,659::taskManager::166::TaskManager::(clearTask) Return. >Thread-840::INFO::2013-03-01 13:05:48,660::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-840::DEBUG::2013-03-01 13:05:48,660::task::1151::TaskManager.Task::(prepare) Task=`c1e458ae-ff8c-401a-9f78-bc10ac2f5827`::finished: None >Thread-840::DEBUG::2013-03-01 13:05:48,660::task::568::TaskManager.Task::(_updateState) Task=`c1e458ae-ff8c-401a-9f78-bc10ac2f5827`::moving from state preparing -> state finished >Thread-840::DEBUG::2013-03-01 13:05:48,660::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-840::DEBUG::2013-03-01 13:05:48,661::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-840::DEBUG::2013-03-01 13:05:48,661::task::957::TaskManager.Task::(_decref) Task=`c1e458ae-ff8c-401a-9f78-bc10ac2f5827`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:50,031::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:50,146::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499739 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:52,166::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:52,272::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0418431 s, 24.5 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:05:53,281::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:05:53,293::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000368073 s, 11.1 MB/s\n'; <rc> = 0 >Thread-842::DEBUG::2013-03-01 13:05:53,390::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-842::DEBUG::2013-03-01 13:05:53,391::task::568::TaskManager.Task::(_updateState) Task=`ac71b2b7-ae0e-4f85-93d1-bbb7df0a0a65`::moving from state init -> state preparing >Thread-842::INFO::2013-03-01 13:05:53,392::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-842::INFO::2013-03-01 13:05:53,392::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-842::DEBUG::2013-03-01 13:05:53,392::task::1151::TaskManager.Task::(prepare) Task=`ac71b2b7-ae0e-4f85-93d1-bbb7df0a0a65`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-842::DEBUG::2013-03-01 13:05:53,393::task::568::TaskManager.Task::(_updateState) Task=`ac71b2b7-ae0e-4f85-93d1-bbb7df0a0a65`::moving from state preparing -> state finished >Thread-842::DEBUG::2013-03-01 13:05:53,393::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-842::DEBUG::2013-03-01 13:05:53,393::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-842::DEBUG::2013-03-01 13:05:53,393::task::957::TaskManager.Task::(_decref) Task=`ac71b2b7-ae0e-4f85-93d1-bbb7df0a0a65`::ref 0 aborting False >Thread-843::DEBUG::2013-03-01 13:05:53,418::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-843::DEBUG::2013-03-01 13:05:53,418::task::568::TaskManager.Task::(_updateState) Task=`7eddbeb4-e8c2-4907-abc0-564efb2801a5`::moving from state init -> state preparing >Thread-843::INFO::2013-03-01 13:05:53,419::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-843::DEBUG::2013-03-01 13:05:53,419::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`984439bf-9d02-48bf-b13f-6aad7153c82c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-843::DEBUG::2013-03-01 13:05:53,420::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-843::DEBUG::2013-03-01 13:05:53,420::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-843::DEBUG::2013-03-01 13:05:53,420::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`984439bf-9d02-48bf-b13f-6aad7153c82c`::Granted request >Thread-843::DEBUG::2013-03-01 13:05:53,421::task::794::TaskManager.Task::(resourceAcquired) Task=`7eddbeb4-e8c2-4907-abc0-564efb2801a5`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-843::DEBUG::2013-03-01 13:05:53,422::task::957::TaskManager.Task::(_decref) Task=`7eddbeb4-e8c2-4907-abc0-564efb2801a5`::ref 1 aborting False >Thread-843::INFO::2013-03-01 13:05:53,423::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-843::DEBUG::2013-03-01 13:05:53,423::task::1151::TaskManager.Task::(prepare) Task=`7eddbeb4-e8c2-4907-abc0-564efb2801a5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-843::DEBUG::2013-03-01 13:05:53,424::task::568::TaskManager.Task::(_updateState) Task=`7eddbeb4-e8c2-4907-abc0-564efb2801a5`::moving from state preparing -> state finished >Thread-843::DEBUG::2013-03-01 13:05:53,424::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-843::DEBUG::2013-03-01 13:05:53,424::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-843::DEBUG::2013-03-01 13:05:53,425::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-843::DEBUG::2013-03-01 13:05:53,425::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-843::DEBUG::2013-03-01 13:05:53,425::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-843::DEBUG::2013-03-01 13:05:53,426::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-843::DEBUG::2013-03-01 13:05:53,426::task::957::TaskManager.Task::(_decref) Task=`7eddbeb4-e8c2-4907-abc0-564efb2801a5`::ref 0 aborting False >Thread-844::DEBUG::2013-03-01 13:05:54,226::task::568::TaskManager.Task::(_updateState) Task=`35f4b70a-021f-4efa-a790-8ecbd0b31267`::moving from state init -> state preparing >Thread-844::INFO::2013-03-01 13:05:54,226::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-844::INFO::2013-03-01 13:05:54,226::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.010960817337', 'lastCheck': '5.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0321321487427', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-844::DEBUG::2013-03-01 13:05:54,226::task::1151::TaskManager.Task::(prepare) Task=`35f4b70a-021f-4efa-a790-8ecbd0b31267`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.010960817337', 'lastCheck': '5.7', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0321321487427', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-844::DEBUG::2013-03-01 13:05:54,227::task::568::TaskManager.Task::(_updateState) Task=`35f4b70a-021f-4efa-a790-8ecbd0b31267`::moving from state preparing -> state finished >Thread-844::DEBUG::2013-03-01 13:05:54,227::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-844::DEBUG::2013-03-01 13:05:54,227::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-844::DEBUG::2013-03-01 13:05:54,228::task::957::TaskManager.Task::(_decref) Task=`35f4b70a-021f-4efa-a790-8ecbd0b31267`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:05:54,292::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:54,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415799 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:56,399::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:05:56,505::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493862 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:58,525::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:58,544::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:05:58,559::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000320081 s, 12.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:05:58,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0660569 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:00,675::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:00,763::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377484 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:02,777::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:02,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441309 s, 23.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:03,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:03,331::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000384915 s, 10.6 MB/s\n'; <rc> = 0 >Thread-849::DEBUG::2013-03-01 13:06:03,465::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-849::DEBUG::2013-03-01 13:06:03,466::task::568::TaskManager.Task::(_updateState) Task=`82215b7a-9d86-4e2e-8f1f-0ef4d183fe64`::moving from state init -> state preparing >Thread-849::INFO::2013-03-01 13:06:03,466::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-849::INFO::2013-03-01 13:06:03,467::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-849::DEBUG::2013-03-01 13:06:03,467::task::1151::TaskManager.Task::(prepare) Task=`82215b7a-9d86-4e2e-8f1f-0ef4d183fe64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-849::DEBUG::2013-03-01 13:06:03,467::task::568::TaskManager.Task::(_updateState) Task=`82215b7a-9d86-4e2e-8f1f-0ef4d183fe64`::moving from state preparing -> state finished >Thread-849::DEBUG::2013-03-01 13:06:03,468::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-849::DEBUG::2013-03-01 13:06:03,468::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-849::DEBUG::2013-03-01 13:06:03,468::task::957::TaskManager.Task::(_decref) Task=`82215b7a-9d86-4e2e-8f1f-0ef4d183fe64`::ref 0 aborting False >Thread-850::DEBUG::2013-03-01 13:06:03,493::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-850::DEBUG::2013-03-01 13:06:03,493::task::568::TaskManager.Task::(_updateState) Task=`22210183-0ba8-4cc2-980b-d94eeb271815`::moving from state init -> state preparing >Thread-850::INFO::2013-03-01 13:06:03,494::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-850::DEBUG::2013-03-01 13:06:03,494::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e22f8caa-a321-4b30-8ff0-549176c61ff2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-850::DEBUG::2013-03-01 13:06:03,494::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-850::DEBUG::2013-03-01 13:06:03,495::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-850::DEBUG::2013-03-01 13:06:03,495::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e22f8caa-a321-4b30-8ff0-549176c61ff2`::Granted request >Thread-850::DEBUG::2013-03-01 13:06:03,496::task::794::TaskManager.Task::(resourceAcquired) Task=`22210183-0ba8-4cc2-980b-d94eeb271815`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-850::DEBUG::2013-03-01 13:06:03,496::task::957::TaskManager.Task::(_decref) Task=`22210183-0ba8-4cc2-980b-d94eeb271815`::ref 1 aborting False >Thread-850::INFO::2013-03-01 13:06:03,498::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-850::DEBUG::2013-03-01 13:06:03,498::task::1151::TaskManager.Task::(prepare) Task=`22210183-0ba8-4cc2-980b-d94eeb271815`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '41607495680', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-850::DEBUG::2013-03-01 13:06:03,498::task::568::TaskManager.Task::(_updateState) Task=`22210183-0ba8-4cc2-980b-d94eeb271815`::moving from state preparing -> state finished >Thread-850::DEBUG::2013-03-01 13:06:03,498::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-850::DEBUG::2013-03-01 13:06:03,499::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-850::DEBUG::2013-03-01 13:06:03,499::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-850::DEBUG::2013-03-01 13:06:03,499::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-850::DEBUG::2013-03-01 13:06:03,500::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-850::DEBUG::2013-03-01 13:06:03,500::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-850::DEBUG::2013-03-01 13:06:03,500::task::957::TaskManager.Task::(_decref) Task=`22210183-0ba8-4cc2-980b-d94eeb271815`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:04,913::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:05,027::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467771 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:07,047::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:07,136::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375755 s, 27.3 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:06:08,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:08,572::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000370757 s, 11.0 MB/s\n'; <rc> = 0 >Thread-852::DEBUG::2013-03-01 13:06:08,773::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-852::DEBUG::2013-03-01 13:06:08,774::task::568::TaskManager.Task::(_updateState) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::moving from state init -> state preparing >Thread-852::INFO::2013-03-01 13:06:08,774::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='95f46aaa-0648-4571-8edc-11c392259094', postZero='false', force='false') >Thread-852::INFO::2013-03-01 13:06:08,775::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-852::DEBUG::2013-03-01 13:06:08,776::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-852::DEBUG::2013-03-01 13:06:08,998::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-852::DEBUG::2013-03-01 13:06:08,999::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:08,999::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:08,999::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,000::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,000::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,001::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:09,150::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:09,249::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441478 s, 23.2 MB/s\n'; <rc> = 0 >Thread-852::DEBUG::2013-03-01 13:06:09,304::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-852::DEBUG::2013-03-01 13:06:09,306::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,307::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-852::DEBUG::2013-03-01 13:06:09,308::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.95f46aaa-0648-4571-8edc-11c392259094`ReqID=`22a0fe52-cdbf-47cd-9687-d095e4870f27`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-852::DEBUG::2013-03-01 13:06:09,308::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.95f46aaa-0648-4571-8edc-11c392259094' for lock type 'exclusive' >Thread-852::DEBUG::2013-03-01 13:06:09,309::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.95f46aaa-0648-4571-8edc-11c392259094' is free. Now locking as 'exclusive' (1 active user) >Thread-852::DEBUG::2013-03-01 13:06:09,309::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.95f46aaa-0648-4571-8edc-11c392259094`ReqID=`22a0fe52-cdbf-47cd-9687-d095e4870f27`::Granted request >Thread-852::DEBUG::2013-03-01 13:06:09,310::task::794::TaskManager.Task::(resourceAcquired) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_resourcesAcquired: Storage.95f46aaa-0648-4571-8edc-11c392259094 (exclusive) >Thread-852::DEBUG::2013-03-01 13:06:09,310::task::957::TaskManager.Task::(_decref) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::ref 1 aborting False >Thread-852::DEBUG::2013-03-01 13:06:09,311::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ed044ee8-2a94-47a6-9058-64fac2a00995`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-852::DEBUG::2013-03-01 13:06:09,311::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-852::DEBUG::2013-03-01 13:06:09,311::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-852::DEBUG::2013-03-01 13:06:09,312::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`ed044ee8-2a94-47a6-9058-64fac2a00995`::Granted request >Thread-852::DEBUG::2013-03-01 13:06:09,312::task::794::TaskManager.Task::(resourceAcquired) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-852::DEBUG::2013-03-01 13:06:09,312::task::957::TaskManager.Task::(_decref) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::ref 1 aborting False >Thread-852::DEBUG::2013-03-01 13:06:09,313::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,314::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-853::DEBUG::2013-03-01 13:06:09,448::task::568::TaskManager.Task::(_updateState) Task=`79c5e25e-99fb-4dee-9641-b313f943c50d`::moving from state init -> state preparing >Thread-853::INFO::2013-03-01 13:06:09,448::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-853::INFO::2013-03-01 13:06:09,449::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103688240051', 'lastCheck': '0.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129909515381', 'lastCheck': '6.1', 'code': 0, 'valid': True}} >Thread-853::DEBUG::2013-03-01 13:06:09,449::task::1151::TaskManager.Task::(prepare) Task=`79c5e25e-99fb-4dee-9641-b313f943c50d`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103688240051', 'lastCheck': '0.9', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129909515381', 'lastCheck': '6.1', 'code': 0, 'valid': True}} >Thread-853::DEBUG::2013-03-01 13:06:09,449::task::568::TaskManager.Task::(_updateState) Task=`79c5e25e-99fb-4dee-9641-b313f943c50d`::moving from state preparing -> state finished >Thread-853::DEBUG::2013-03-01 13:06:09,449::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-853::DEBUG::2013-03-01 13:06:09,450::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-853::DEBUG::2013-03-01 13:06:09,450::task::957::TaskManager.Task::(_decref) Task=`79c5e25e-99fb-4dee-9641-b313f943c50d`::ref 0 aborting False >Thread-852::DEBUG::2013-03-01 13:06:09,559::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-852::DEBUG::2013-03-01 13:06:09,572::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,573::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/bae6764b-ba3d-4d6b-9c50-c68e3475557a a558fc2a-a4a3-4118-9b81-d1d601eaa295/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8' (cwd None) >Thread-852::DEBUG::2013-03-01 13:06:09,840::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-852::DEBUG::2013-03-01 13:06:09,841::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,841::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,842::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,842::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2013-03-01 13:06:09,842::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094/f3b73d7e-e7bb-4feb-8943-ab1bd39963b8'] >Thread-852::DEBUG::2013-03-01 13:06:09,843::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/95f46aaa-0648-4571-8edc-11c392259094 >Thread-852::DEBUG::2013-03-01 13:06:09,844::task::719::TaskManager.Task::(_save) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67.temp >Thread-852::DEBUG::2013-03-01 13:06:09,850::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_95f46aaa-0648-4571-8edc-11c392259094 for task d803a7e4-5951-47c8-8515-0ccc6d24fa67 >Thread-852::INFO::2013-03-01 13:06:09,850::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-852::DEBUG::2013-03-01 13:06:09,850::task::1146::TaskManager.Task::(prepare) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::Prepare: 1 jobs exist, move to acquiring >Thread-852::DEBUG::2013-03-01 13:06:09,850::task::568::TaskManager.Task::(_updateState) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::moving from state preparing -> state acquiring >Thread-852::DEBUG::2013-03-01 13:06:09,851::task::719::TaskManager.Task::(_save) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67.temp >Thread-852::DEBUG::2013-03-01 13:06:09,857::task::568::TaskManager.Task::(_updateState) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::moving from state acquiring -> state queued >Thread-852::DEBUG::2013-03-01 13:06:09,858::task::719::TaskManager.Task::(_save) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67.temp >Thread-852::DEBUG::2013-03-01 13:06:09,865::taskManager::50::TaskManager::(_queueTask) queuing task: d803a7e4-5951-47c8-8515-0ccc6d24fa67 >73f2e5a4-f231-4c81-98c3-b06dff5588c2::DEBUG::2013-03-01 13:06:09,866::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-852::DEBUG::2013-03-01 13:06:09,866::taskManager::56::TaskManager::(_queueTask) task queued: d803a7e4-5951-47c8-8515-0ccc6d24fa67 >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,867::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: d803a7e4-5951-47c8-8515-0ccc6d24fa67 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15882f8b48>> with: None >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,869::task::1159::TaskManager.Task::(commit) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::committing task: d803a7e4-5951-47c8-8515-0ccc6d24fa67 >Thread-852::DEBUG::2013-03-01 13:06:09,869::task::1148::TaskManager.Task::(prepare) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::returning >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,871::task::568::TaskManager.Task::(_updateState) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::moving from state queued -> state running >Thread-852::DEBUG::2013-03-01 13:06:09,872::task::957::TaskManager.Task::(_decref) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::ref 1 aborting False >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,877::task::719::TaskManager.Task::(_save) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67.temp >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,887::task::872::TaskManager.Task::(_runJobs) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::Task.run: running job 0: deleteImage_95f46aaa-0648-4571-8edc-11c392259094: <function <lambda> at 0x7f15f0064cf8> (args: () kwargs: {}) >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,887::task::304::TaskManager.Task::(run) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::Job.run: running deleteImage_95f46aaa-0648-4571-8edc-11c392259094: <function <lambda> at 0x7f15f0064cf8> (args: () kwargs: {}) callback None >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,887::task::568::TaskManager.Task::(_updateState) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::moving from state running -> state finished >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,888::task::719::TaskManager.Task::(_save) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/d803a7e4-5951-47c8-8515-0ccc6d24fa67.temp >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,896::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.95f46aaa-0648-4571-8edc-11c392259094': < ResourceRef 'Storage.95f46aaa-0648-4571-8edc-11c392259094', isValid: 'True' obj: 'None'>} >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,896::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,897::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,897::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,897::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,897::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,898::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.95f46aaa-0648-4571-8edc-11c392259094' >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,898::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.95f46aaa-0648-4571-8edc-11c392259094' (0 active users) >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,899::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.95f46aaa-0648-4571-8edc-11c392259094' is free, finding out if anyone is waiting for it. >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,899::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.95f46aaa-0648-4571-8edc-11c392259094', Clearing records. >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,899::task::880::TaskManager.Task::(_runJobs) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::Task.run: exit - success: result True >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,900::task::957::TaskManager.Task::(_decref) Task=`d803a7e4-5951-47c8-8515-0ccc6d24fa67`::ref 0 aborting False >d803a7e4-5951-47c8-8515-0ccc6d24fa67::DEBUG::2013-03-01 13:06:09,900::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:06:11,269::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:11,379::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463731 s, 22.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:13,337::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:06:13,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:13,398::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:13,501::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374561 s, 27.3 MB/s\n'; <rc> = 0 >Thread-856::DEBUG::2013-03-01 13:06:13,540::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-856::DEBUG::2013-03-01 13:06:13,541::task::568::TaskManager.Task::(_updateState) Task=`0e9dcdf0-48a0-4d8c-ac08-04ecdb08b343`::moving from state init -> state preparing >Thread-856::INFO::2013-03-01 13:06:13,541::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-856::INFO::2013-03-01 13:06:13,542::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-856::DEBUG::2013-03-01 13:06:13,542::task::1151::TaskManager.Task::(prepare) Task=`0e9dcdf0-48a0-4d8c-ac08-04ecdb08b343`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-856::DEBUG::2013-03-01 13:06:13,542::task::568::TaskManager.Task::(_updateState) Task=`0e9dcdf0-48a0-4d8c-ac08-04ecdb08b343`::moving from state preparing -> state finished >Thread-856::DEBUG::2013-03-01 13:06:13,543::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-856::DEBUG::2013-03-01 13:06:13,543::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-856::DEBUG::2013-03-01 13:06:13,543::task::957::TaskManager.Task::(_decref) Task=`0e9dcdf0-48a0-4d8c-ac08-04ecdb08b343`::ref 0 aborting False >Thread-857::DEBUG::2013-03-01 13:06:13,568::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-857::DEBUG::2013-03-01 13:06:13,569::task::568::TaskManager.Task::(_updateState) Task=`c70da0e6-75c8-47ee-8052-ac46427b9737`::moving from state init -> state preparing >Thread-857::INFO::2013-03-01 13:06:13,569::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-857::DEBUG::2013-03-01 13:06:13,570::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f6e18486-2729-4703-8165-af8bd98c08ac`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-857::DEBUG::2013-03-01 13:06:13,570::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-857::DEBUG::2013-03-01 13:06:13,571::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-857::DEBUG::2013-03-01 13:06:13,571::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f6e18486-2729-4703-8165-af8bd98c08ac`::Granted request >Thread-857::DEBUG::2013-03-01 13:06:13,572::task::794::TaskManager.Task::(resourceAcquired) Task=`c70da0e6-75c8-47ee-8052-ac46427b9737`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-857::DEBUG::2013-03-01 13:06:13,572::task::957::TaskManager.Task::(_decref) Task=`c70da0e6-75c8-47ee-8052-ac46427b9737`::ref 1 aborting False >Thread-857::DEBUG::2013-03-01 13:06:13,573::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-857::DEBUG::2013-03-01 13:06:13,574::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:13,695::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:13,697::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:13,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000375684 s, 10.9 MB/s\n'; <rc> = 0 >Thread-857::DEBUG::2013-03-01 13:06:13,821::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-857::DEBUG::2013-03-01 13:06:13,823::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-857::INFO::2013-03-01 13:06:13,824::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-857::DEBUG::2013-03-01 13:06:13,824::task::1151::TaskManager.Task::(prepare) Task=`c70da0e6-75c8-47ee-8052-ac46427b9737`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-857::DEBUG::2013-03-01 13:06:13,824::task::568::TaskManager.Task::(_updateState) Task=`c70da0e6-75c8-47ee-8052-ac46427b9737`::moving from state preparing -> state finished >Thread-857::DEBUG::2013-03-01 13:06:13,825::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-857::DEBUG::2013-03-01 13:06:13,825::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-857::DEBUG::2013-03-01 13:06:13,825::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-857::DEBUG::2013-03-01 13:06:13,826::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-857::DEBUG::2013-03-01 13:06:13,826::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-857::DEBUG::2013-03-01 13:06:13,826::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-857::DEBUG::2013-03-01 13:06:13,827::task::957::TaskManager.Task::(_decref) Task=`c70da0e6-75c8-47ee-8052-ac46427b9737`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:15,518::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:15,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376153 s, 27.2 MB/s\n'; <rc> = 0 >Thread-859::DEBUG::2013-03-01 13:06:17,102::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-859::DEBUG::2013-03-01 13:06:17,103::task::568::TaskManager.Task::(_updateState) Task=`b0b580b9-f353-49db-8961-04e4cce8ed74`::moving from state init -> state preparing >Thread-859::INFO::2013-03-01 13:06:17,104::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-859::DEBUG::2013-03-01 13:06:17,104::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-859::DEBUG::2013-03-01 13:06:17,104::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d803a7e4-5951-47c8-8515-0ccc6d24fa67 >Thread-859::DEBUG::2013-03-01 13:06:17,104::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd803a7e4-5951-47c8-8515-0ccc6d24fa67'} >Thread-859::DEBUG::2013-03-01 13:06:17,105::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'d803a7e4-5951-47c8-8515-0ccc6d24fa67': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd803a7e4-5951-47c8-8515-0ccc6d24fa67'}} >Thread-859::INFO::2013-03-01 13:06:17,105::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d803a7e4-5951-47c8-8515-0ccc6d24fa67': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd803a7e4-5951-47c8-8515-0ccc6d24fa67'}}} >Thread-859::DEBUG::2013-03-01 13:06:17,105::task::1151::TaskManager.Task::(prepare) Task=`b0b580b9-f353-49db-8961-04e4cce8ed74`::finished: {'allTasksStatus': {'d803a7e4-5951-47c8-8515-0ccc6d24fa67': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd803a7e4-5951-47c8-8515-0ccc6d24fa67'}}} >Thread-859::DEBUG::2013-03-01 13:06:17,106::task::568::TaskManager.Task::(_updateState) Task=`b0b580b9-f353-49db-8961-04e4cce8ed74`::moving from state preparing -> state finished >Thread-859::DEBUG::2013-03-01 13:06:17,106::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-859::DEBUG::2013-03-01 13:06:17,106::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-859::DEBUG::2013-03-01 13:06:17,107::task::957::TaskManager.Task::(_decref) Task=`b0b580b9-f353-49db-8961-04e4cce8ed74`::ref 0 aborting False >Thread-860::DEBUG::2013-03-01 13:06:17,349::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-860::DEBUG::2013-03-01 13:06:17,350::task::568::TaskManager.Task::(_updateState) Task=`daa367ad-9771-4583-9d02-c2100a40d7db`::moving from state init -> state preparing >Thread-860::INFO::2013-03-01 13:06:17,350::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='d803a7e4-5951-47c8-8515-0ccc6d24fa67', spUUID=None, options=None) >Thread-860::DEBUG::2013-03-01 13:06:17,350::taskManager::161::TaskManager::(clearTask) Entry. taskID: d803a7e4-5951-47c8-8515-0ccc6d24fa67 >Thread-860::DEBUG::2013-03-01 13:06:17,351::taskManager::166::TaskManager::(clearTask) Return. >Thread-860::INFO::2013-03-01 13:06:17,352::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-860::DEBUG::2013-03-01 13:06:17,352::task::1151::TaskManager.Task::(prepare) Task=`daa367ad-9771-4583-9d02-c2100a40d7db`::finished: None >Thread-860::DEBUG::2013-03-01 13:06:17,352::task::568::TaskManager.Task::(_updateState) Task=`daa367ad-9771-4583-9d02-c2100a40d7db`::moving from state preparing -> state finished >Thread-860::DEBUG::2013-03-01 13:06:17,352::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-860::DEBUG::2013-03-01 13:06:17,353::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-860::DEBUG::2013-03-01 13:06:17,353::task::957::TaskManager.Task::(_decref) Task=`daa367ad-9771-4583-9d02-c2100a40d7db`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:17,642::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:17,753::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464978 s, 22.0 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:06:18,576::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:18,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000322055 s, 12.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:19,773::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:19,883::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465262 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:21,903::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:22,006::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388406 s, 26.4 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:23,717::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:23,729::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000375159 s, 10.9 MB/s\n'; <rc> = 0 >Thread-863::DEBUG::2013-03-01 13:06:23,882::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-863::DEBUG::2013-03-01 13:06:23,882::task::568::TaskManager.Task::(_updateState) Task=`7dbf1dba-65a5-4512-a9e0-d167e553464f`::moving from state init -> state preparing >Thread-863::INFO::2013-03-01 13:06:23,883::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-863::INFO::2013-03-01 13:06:23,883::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-863::DEBUG::2013-03-01 13:06:23,883::task::1151::TaskManager.Task::(prepare) Task=`7dbf1dba-65a5-4512-a9e0-d167e553464f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-863::DEBUG::2013-03-01 13:06:23,884::task::568::TaskManager.Task::(_updateState) Task=`7dbf1dba-65a5-4512-a9e0-d167e553464f`::moving from state preparing -> state finished >Thread-863::DEBUG::2013-03-01 13:06:23,884::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-863::DEBUG::2013-03-01 13:06:23,884::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-863::DEBUG::2013-03-01 13:06:23,885::task::957::TaskManager.Task::(_decref) Task=`7dbf1dba-65a5-4512-a9e0-d167e553464f`::ref 0 aborting False >Thread-864::DEBUG::2013-03-01 13:06:23,913::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-864::DEBUG::2013-03-01 13:06:23,913::task::568::TaskManager.Task::(_updateState) Task=`80e4a9a7-e920-4e6b-b25b-dfdef8d3b8b4`::moving from state init -> state preparing >Thread-864::INFO::2013-03-01 13:06:23,913::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-864::DEBUG::2013-03-01 13:06:23,914::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9664bf1a-7073-45ed-b2cc-9f7eda5fce57`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-864::DEBUG::2013-03-01 13:06:23,914::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-864::DEBUG::2013-03-01 13:06:23,915::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-864::DEBUG::2013-03-01 13:06:23,915::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`9664bf1a-7073-45ed-b2cc-9f7eda5fce57`::Granted request >Thread-864::DEBUG::2013-03-01 13:06:23,916::task::794::TaskManager.Task::(resourceAcquired) Task=`80e4a9a7-e920-4e6b-b25b-dfdef8d3b8b4`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-864::DEBUG::2013-03-01 13:06:23,916::task::957::TaskManager.Task::(_decref) Task=`80e4a9a7-e920-4e6b-b25b-dfdef8d3b8b4`::ref 1 aborting False >Thread-864::INFO::2013-03-01 13:06:23,917::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-864::DEBUG::2013-03-01 13:06:23,918::task::1151::TaskManager.Task::(prepare) Task=`80e4a9a7-e920-4e6b-b25b-dfdef8d3b8b4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '43754979328', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-864::DEBUG::2013-03-01 13:06:23,918::task::568::TaskManager.Task::(_updateState) Task=`80e4a9a7-e920-4e6b-b25b-dfdef8d3b8b4`::moving from state preparing -> state finished >Thread-864::DEBUG::2013-03-01 13:06:23,918::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-864::DEBUG::2013-03-01 13:06:23,919::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-864::DEBUG::2013-03-01 13:06:23,919::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-864::DEBUG::2013-03-01 13:06:23,919::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-864::DEBUG::2013-03-01 13:06:23,920::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-864::DEBUG::2013-03-01 13:06:23,920::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-864::DEBUG::2013-03-01 13:06:23,920::task::957::TaskManager.Task::(_decref) Task=`80e4a9a7-e920-4e6b-b25b-dfdef8d3b8b4`::ref 0 aborting False >Thread-865::DEBUG::2013-03-01 13:06:24,027::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Dummy-173::DEBUG::2013-03-01 13:06:24,029::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,030::task::568::TaskManager.Task::(_updateState) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::moving from state init -> state preparing >Thread-865::INFO::2013-03-01 13:06:24,042::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', vmUUID='', srcImgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', srcVolUUID='afd24d51-5438-4385-bd13-288c4e5c4d5e', dstImgUUID='06123103-957e-4c2c-a0df-279b9a7e7361', dstVolUUID='2dad636f-9a5b-4caf-9a69-72ad3a8a9603', description='', dstSdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', volType=8, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-865::INFO::2013-03-01 13:06:24,045::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-865::DEBUG::2013-03-01 13:06:24,053::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:24,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584605 s, 17.5 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,238::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,239::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,239::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,239::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,240::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,240::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,241::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,437::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,439::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,439::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-865::DEBUG::2013-03-01 13:06:24,440::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,441::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-866::DEBUG::2013-03-01 13:06:24,671::task::568::TaskManager.Task::(_updateState) Task=`36dfef58-64a2-4665-865b-7034b21cc836`::moving from state init -> state preparing >Thread-866::INFO::2013-03-01 13:06:24,672::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-866::INFO::2013-03-01 13:06:24,672::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0136969089508', 'lastCheck': '6.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0127048492432', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-866::DEBUG::2013-03-01 13:06:24,673::task::1151::TaskManager.Task::(prepare) Task=`36dfef58-64a2-4665-865b-7034b21cc836`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0136969089508', 'lastCheck': '6.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0127048492432', 'lastCheck': '0.9', 'code': 0, 'valid': True}} >Thread-866::DEBUG::2013-03-01 13:06:24,673::task::568::TaskManager.Task::(_updateState) Task=`36dfef58-64a2-4665-865b-7034b21cc836`::moving from state preparing -> state finished >Thread-866::DEBUG::2013-03-01 13:06:24,673::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-866::DEBUG::2013-03-01 13:06:24,674::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-866::DEBUG::2013-03-01 13:06:24,674::task::957::TaskManager.Task::(_decref) Task=`36dfef58-64a2-4665-865b-7034b21cc836`::ref 0 aborting False >Thread-865::DEBUG::2013-03-01 13:06:24,687::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,701::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-865::INFO::2013-03-01 13:06:24,701::image::458::Storage.Image::(isLegal) image 2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist ['2802458b-c98e-4b45-9c22-291d956c393d', 'afd24d51-5438-4385-bd13-288c4e5c4d5e'] >Thread-865::DEBUG::2013-03-01 13:06:24,702::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,711::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000330365 s, 1.5 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,713::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000330365 s, 1.5 MB/s'], size: 512 >Thread-865::DEBUG::2013-03-01 13:06:24,715::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,730::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000279581 s, 1.8 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,730::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000279581 s, 1.8 MB/s'], size: 512 >Thread-865::DEBUG::2013-03-01 13:06:24,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,740::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000303075 s, 1.7 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,741::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000303075 s, 1.7 MB/s'], size: 512 >Thread-865::DEBUG::2013-03-01 13:06:24,742::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,751::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000316645 s, 1.6 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,752::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000316645 s, 1.6 MB/s'], size: 512 >Thread-865::DEBUG::2013-03-01 13:06:24,753::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,754::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,944::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,955::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-865::DEBUG::2013-03-01 13:06:24,956::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,964::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000281472 s, 1.8 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,965::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000281472 s, 1.8 MB/s'], size: 512 >Thread-865::DEBUG::2013-03-01 13:06:24,966::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-865::DEBUG::2013-03-01 13:06:24,975::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000292743 s, 1.7 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2013-03-01 13:06:24,976::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000292743 s, 1.7 MB/s'], size: 512 >Thread-865::INFO::2013-03-01 13:06:24,976::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 chain=[<storage.blockVolume.BlockVolume object at 0x7f161002e390>, <storage.blockVolume.BlockVolume object at 0x7f15f802aa90>] >Thread-865::DEBUG::2013-03-01 13:06:24,977::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`3400f1de-6576-4a08-8133-d7290329c269`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-865::DEBUG::2013-03-01 13:06:24,977::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-865::DEBUG::2013-03-01 13:06:24,978::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-865::DEBUG::2013-03-01 13:06:24,978::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`3400f1de-6576-4a08-8133-d7290329c269`::Granted request >Thread-865::DEBUG::2013-03-01 13:06:24,979::task::794::TaskManager.Task::(resourceAcquired) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-865::DEBUG::2013-03-01 13:06:24,979::task::957::TaskManager.Task::(_decref) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::ref 1 aborting False >Thread-865::DEBUG::2013-03-01 13:06:24,981::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >Thread-865::DEBUG::2013-03-01 13:06:24,988::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_06123103-957e-4c2c-a0df-279b9a7e7361 for task ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-865::INFO::2013-03-01 13:06:24,988::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-865::DEBUG::2013-03-01 13:06:24,988::task::1146::TaskManager.Task::(prepare) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::Prepare: 1 jobs exist, move to acquiring >Thread-865::DEBUG::2013-03-01 13:06:24,989::task::568::TaskManager.Task::(_updateState) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::moving from state preparing -> state acquiring >Thread-865::DEBUG::2013-03-01 13:06:24,989::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >Thread-865::DEBUG::2013-03-01 13:06:24,997::task::568::TaskManager.Task::(_updateState) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::moving from state acquiring -> state queued >Thread-865::DEBUG::2013-03-01 13:06:24,998::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >Thread-865::DEBUG::2013-03-01 13:06:25,005::taskManager::50::TaskManager::(_queueTask) queuing task: ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-865::DEBUG::2013-03-01 13:06:25,005::taskManager::56::TaskManager::(_queueTask) task queued: ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-4::DEBUG::2013-03-01 13:06:25,006::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-865::DEBUG::2013-03-01 13:06:25,007::task::1148::TaskManager.Task::(prepare) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::returning >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,007::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: ebfa628d-d34f-45fa-a48d-fa4170f58bca running: <bound method Task.commit of <storage.task.Task instance at 0x17b4518>> with: None >Thread-865::DEBUG::2013-03-01 13:06:25,008::task::957::TaskManager.Task::(_decref) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::ref 0 aborting False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,008::task::1159::TaskManager.Task::(commit) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::committing task: ebfa628d-d34f-45fa-a48d-fa4170f58bca >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,010::task::568::TaskManager.Task::(_updateState) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::moving from state queued -> state running >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,013::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,020::task::872::TaskManager.Task::(_runJobs) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::Task.run: running job 0: copyImage_06123103-957e-4c2c-a0df-279b9a7e7361: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'afd24d51-5438-4385-bd13-288c4e5c4d5e', '06123103-957e-4c2c-a0df-279b9a7e7361', '2dad636f-9a5b-4caf-9a69-72ad3a8a9603', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,020::task::304::TaskManager.Task::(run) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::Job.run: running copyImage_06123103-957e-4c2c-a0df-279b9a7e7361: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x17a8e90>> (args: ('a558fc2a-a4a3-4118-9b81-d1d601eaa295', '', '2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', 'afd24d51-5438-4385-bd13-288c4e5c4d5e', '06123103-957e-4c2c-a0df-279b9a7e7361', '2dad636f-9a5b-4caf-9a69-72ad3a8a9603', '', 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 8, 4, 2, False, False) kwargs: {}) callback None >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,021::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`062fbfbd-53e2-451b-b9a0-28473b278bcc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,021::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' for lock type 'shared' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,022::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,023::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,212::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,223::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,224::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,234::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000336494 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,234::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000336494 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,235::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,245::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000342449 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,246::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000342449 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:25,246::image::345::Storage.Image::(getChain) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 chain=[<storage.blockVolume.BlockVolume object at 0x7f15f802a990>, <storage.blockVolume.BlockVolume object at 0x7f1588339b10>] >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,247::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d`ReqID=`ca844b4d-5f2c-4b67-b73b-fb1ac9ec7bca`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,247::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d' for lock type 'shared' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,248::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d' is free. Now locking as 'shared' (1 active user) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,248::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d`ReqID=`ca844b4d-5f2c-4b67-b73b-fb1ac9ec7bca`::Granted request >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,249::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`3780fb36-ae68-4f66-b017-dfb950f84374`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,249::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' for lock type 'shared' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,249::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free. Now locking as 'shared' (1 active user) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,249::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`3780fb36-ae68-4f66-b017-dfb950f84374`::Granted request >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,250::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free. Now locking as 'shared' (1 active user) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,250::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`062fbfbd-53e2-451b-b9a0-28473b278bcc`::Granted request >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,251::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361`ReqID=`8ba273b7-e550-4439-87b1-802a98a344c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,251::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361' for lock type 'exclusive' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,252::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,253::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,489::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,501::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,502::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 06123103-957e-4c2c-a0df-279b9a7e7361 does not exist in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,502::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361' is free. Now locking as 'exclusive' (1 active user) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,502::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361`ReqID=`8ba273b7-e550-4439-87b1-802a98a344c2`::Granted request >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:25,503::image::790::Storage.Image::(copy) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 vmUUID= srcImgUUID=2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 srcVolUUID=afd24d51-5438-4385-bd13-288c4e5c4d5e dstImgUUID=06123103-957e-4c2c-a0df-279b9a7e7361 dstVolUUID=2dad636f-9a5b-4caf-9a69-72ad3a8a9603 dstSdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,504::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,515::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000349257 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,515::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000349257 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,516::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,525::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00030698 s, 1.7 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,526::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00030698 s, 1.7 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,536::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000310485 s, 1.6 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,537::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000310485 s, 1.6 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,537::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,547::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000311793 s, 1.6 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,547::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000311793 s, 1.6 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,558::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000334484 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,559::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000334484 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,569::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000342029 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,569::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000342029 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:25,570::image::835::Storage.Image::(copy) copy source a558fc2a-a4a3-4118-9b81-d1d601eaa295:2a7ef410-9a24-4327-a3cc-3ab55d0a35e9:afd24d51-5438-4385-bd13-288c4e5c4d5e vol size 12582912 destination a558fc2a-a4a3-4118-9b81-d1d601eaa295:06123103-957e-4c2c-a0df-279b9a7e7361:2dad636f-9a5b-4caf-9a69-72ad3a8a9603 apparentsize 2097152 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,570::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,571::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,791::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,805::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:25,805::image::458::Storage.Image::(isLegal) image 06123103-957e-4c2c-a0df-279b9a7e7361 in domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 has vollist [] >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:25,806::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361 for image's volumes >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,807::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,816::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:25,816::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:26,008::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:26,019::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::WARNING::2013-03-01 13:06:26,020::lvm::593::Storage.LVM::(getLv) lv: 2dad636f-9a5b-4caf-9a69-72ad3a8a9603 not found in lvs vg: a558fc2a-a4a3-4118-9b81-d1d601eaa295 response >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:26,021::volume::457::Storage.Volume::(create) Creating volume 2dad636f-9a5b-4caf-9a69-72ad3a8a9603 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:26,022::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:26,030::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:26,042::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 2dad636f-9a5b-4caf-9a69-72ad3a8a9603 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:26,149::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:26,223::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305361 s, 33.5 MB/s\n'; <rc> = 0 >Thread-868::DEBUG::2013-03-01 13:06:27,142::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-868::DEBUG::2013-03-01 13:06:27,143::task::568::TaskManager.Task::(_updateState) Task=`1efc5979-05f3-426a-bd8f-3d126e102743`::moving from state init -> state preparing >Thread-868::INFO::2013-03-01 13:06:27,143::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-868::DEBUG::2013-03-01 13:06:27,144::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-868::DEBUG::2013-03-01 13:06:27,144::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-868::DEBUG::2013-03-01 13:06:27,144::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'} >Thread-868::DEBUG::2013-03-01 13:06:27,144::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}} >Thread-868::INFO::2013-03-01 13:06:27,144::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}}} >Thread-868::DEBUG::2013-03-01 13:06:27,145::task::1151::TaskManager.Task::(prepare) Task=`1efc5979-05f3-426a-bd8f-3d126e102743`::finished: {'allTasksStatus': {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}}} >Thread-868::DEBUG::2013-03-01 13:06:27,145::task::568::TaskManager.Task::(_updateState) Task=`1efc5979-05f3-426a-bd8f-3d126e102743`::moving from state preparing -> state finished >Thread-868::DEBUG::2013-03-01 13:06:27,145::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-868::DEBUG::2013-03-01 13:06:27,145::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-868::DEBUG::2013-03-01 13:06:27,145::task::957::TaskManager.Task::(_decref) Task=`1efc5979-05f3-426a-bd8f-3d126e102743`::ref 0 aborting False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,736::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,736::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,737::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,737::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:27,739::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 with size = 20480 sectors >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,739::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 10240K' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,752::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,753::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:27,754::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,023::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,038::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::WARNING::2013-03-01 13:06:28,045::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,045::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 10 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,046::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_06123103-957e-4c2c-a0df-279b9a7e7361 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag MD_10 a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:28,237::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,261::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,264::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,267::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:28,343::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0603884 s, 17.0 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,471::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,471::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,471::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,472::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,484::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=2dad636f-9a5b-4caf-9a69-72ad3a8a9603 sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295, metaId=('a558fc2a-a4a3-4118-9b81-d1d601eaa295', 10) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,490::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,499::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,500::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:28,591::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:28,601::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000309715 s, 13.2 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,746::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,766::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:28,766::blockVolume::280::Storage.Volume::(extend) Request to extend LV 2dad636f-9a5b-4caf-9a69-72ad3a8a9603 of image 06123103-957e-4c2c-a0df-279b9a7e7361 in VG a558fc2a-a4a3-4118-9b81-d1d601eaa295 with size = 2097152 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,767::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 1024m a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,959::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = " New size (8 extents) matches existing size (8 extents)\n Run `lvextend --help' for more information.\n"; <rc> = 3 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,963::lvm::1084::Storage.LVM::(extendLV) New size (in extents) matches existing size (in extents). >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,964::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,974::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000292128 s, 1.8 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,975::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000292128 s, 1.8 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:28,976::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,976::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,986::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000294851 s, 1.7 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,987::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000294851 s, 1.7 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,987::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`3328dd9e-e8df-4ff0-8b32-c99dc3d1a654`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,988::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' for lock type 'shared' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:28,989::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:30,362::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:31,698::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.524142 s, 2.0 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:33,744::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:06:33,756::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:33,929::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-872::DEBUG::2013-03-01 13:06:34,255::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-872::DEBUG::2013-03-01 13:06:34,273::task::568::TaskManager.Task::(_updateState) Task=`f3eaa48b-7a73-4697-97da-68b65480f7bb`::moving from state init -> state preparing >Thread-872::INFO::2013-03-01 13:06:34,281::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-872::INFO::2013-03-01 13:06:34,296::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-872::DEBUG::2013-03-01 13:06:34,303::task::1151::TaskManager.Task::(prepare) Task=`f3eaa48b-7a73-4697-97da-68b65480f7bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-872::DEBUG::2013-03-01 13:06:34,311::task::568::TaskManager.Task::(_updateState) Task=`f3eaa48b-7a73-4697-97da-68b65480f7bb`::moving from state preparing -> state finished >Thread-872::DEBUG::2013-03-01 13:06:34,316::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-872::DEBUG::2013-03-01 13:06:34,321::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-872::DEBUG::2013-03-01 13:06:34,327::task::957::TaskManager.Task::(_decref) Task=`f3eaa48b-7a73-4697-97da-68b65480f7bb`::ref 0 aborting False >Thread-873::DEBUG::2013-03-01 13:06:34,438::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-873::DEBUG::2013-03-01 13:06:34,452::task::568::TaskManager.Task::(_updateState) Task=`29cf346e-e588-4e9f-91a6-ee56d46f67f4`::moving from state init -> state preparing >Thread-873::INFO::2013-03-01 13:06:34,454::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-873::DEBUG::2013-03-01 13:06:34,455::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`c7dd3cfa-d673-4c5e-a433-0b199ae9797f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-873::DEBUG::2013-03-01 13:06:34,455::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-873::DEBUG::2013-03-01 13:06:34,456::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-873::DEBUG::2013-03-01 13:06:34,456::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`c7dd3cfa-d673-4c5e-a433-0b199ae9797f`::Granted request >Thread-873::DEBUG::2013-03-01 13:06:34,457::task::794::TaskManager.Task::(resourceAcquired) Task=`29cf346e-e588-4e9f-91a6-ee56d46f67f4`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-873::DEBUG::2013-03-01 13:06:34,457::task::957::TaskManager.Task::(_decref) Task=`29cf346e-e588-4e9f-91a6-ee56d46f67f4`::ref 1 aborting False >Thread-873::DEBUG::2013-03-01 13:06:34,458::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-873::DEBUG::2013-03-01 13:06:34,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,470::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,472::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Dummy-173::DEBUG::2013-03-01 13:06:34,526::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.40232 s, 2.5 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:34,748::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:34,750::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:34,764::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000375096 s, 10.9 MB/s\n'; <rc> = 0 >Thread-873::DEBUG::2013-03-01 13:06:34,776::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-873::DEBUG::2013-03-01 13:06:34,778::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,780::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,782::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-873::INFO::2013-03-01 13:06:34,782::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,783::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free. Now locking as 'shared' (1 active user) >Thread-873::DEBUG::2013-03-01 13:06:34,784::task::1151::TaskManager.Task::(prepare) Task=`29cf346e-e588-4e9f-91a6-ee56d46f67f4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,785::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e`ReqID=`3328dd9e-e8df-4ff0-8b32-c99dc3d1a654`::Granted request >Thread-873::DEBUG::2013-03-01 13:06:34,785::task::568::TaskManager.Task::(_updateState) Task=`29cf346e-e588-4e9f-91a6-ee56d46f67f4`::moving from state preparing -> state finished >Thread-873::DEBUG::2013-03-01 13:06:34,787::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,788::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-873::DEBUG::2013-03-01 13:06:34,788::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-873::DEBUG::2013-03-01 13:06:34,790::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:34,792::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-873::DEBUG::2013-03-01 13:06:34,792::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-873::DEBUG::2013-03-01 13:06:34,801::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-873::DEBUG::2013-03-01 13:06:34,801::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-873::DEBUG::2013-03-01 13:06:34,802::task::957::TaskManager.Task::(_decref) Task=`29cf346e-e588-4e9f-91a6-ee56d46f67f4`::ref 0 aborting False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,036::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,050::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:35,051::volume::709::Storage.Volume::(prepare) Volume: preparing volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,051::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,064::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000345947 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,066::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000345947 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,068::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,081::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000306315 s, 1.7 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,081::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000306315 s, 1.7 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,082::resourceManager::175::ResourceManager.Request::(__init__) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603`ReqID=`f2dfe492-324e-4ca0-82bb-ae3418b55a14`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,083::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603' for lock type 'exclusive' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:35,084::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:36,539::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:36,645::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408962 s, 25.0 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,797::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,797::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,798::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,798::resourceManager::528::ResourceManager::(registerResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603' is free. Now locking as 'exclusive' (1 active user) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,798::resourceManager::212::ResourceManager.Request::(grant) ResName=`a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603`ReqID=`f2dfe492-324e-4ca0-82bb-ae3418b55a14`::Granted request >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,799::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:36,800::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,048::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,064::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,065::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,075::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000299388 s, 1.7 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,076::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000299388 s, 1.7 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,077::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,095::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000343037 s, 1.5 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,096::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000343037 s, 1.5 MB/s'], size: 512 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,096::volume::1012::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e (qcow2) to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 (qcow2) START >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,097::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e -O qcow2 /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:37,106::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >Thread-874::DEBUG::2013-03-01 13:06:37,174::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-874::DEBUG::2013-03-01 13:06:37,175::task::568::TaskManager.Task::(_updateState) Task=`a707363e-d9e4-474a-b52c-6cfdfaad6500`::moving from state init -> state preparing >Thread-874::INFO::2013-03-01 13:06:37,175::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-874::DEBUG::2013-03-01 13:06:37,176::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-874::DEBUG::2013-03-01 13:06:37,176::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-874::DEBUG::2013-03-01 13:06:37,176::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'} >Thread-874::DEBUG::2013-03-01 13:06:37,177::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}} >Thread-874::INFO::2013-03-01 13:06:37,177::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}}} >Thread-874::DEBUG::2013-03-01 13:06:37,177::task::1151::TaskManager.Task::(prepare) Task=`a707363e-d9e4-474a-b52c-6cfdfaad6500`::finished: {'allTasksStatus': {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}}} >Thread-874::DEBUG::2013-03-01 13:06:37,178::task::568::TaskManager.Task::(_updateState) Task=`a707363e-d9e4-474a-b52c-6cfdfaad6500`::moving from state preparing -> state finished >Thread-874::DEBUG::2013-03-01 13:06:37,178::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-874::DEBUG::2013-03-01 13:06:37,178::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-874::DEBUG::2013-03-01 13:06:37,179::task::957::TaskManager.Task::(_decref) Task=`a707363e-d9e4-474a-b52c-6cfdfaad6500`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:06:38,603::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-255::DEBUG::2013-03-01 13:06:38,603::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-255::DEBUG::2013-03-01 13:06:38,604::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:38,614::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000312291 s, 6.6 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:06:38,615::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000312291 s, 6.6 MB/s'], size: 2048 >Thread-255::DEBUG::2013-03-01 13:06:38,615::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-255::WARNING::2013-03-01 13:06:38,615::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-255::DEBUG::2013-03-01 13:06:38,616::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-255::DEBUG::2013-03-01 13:06:38,616::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 13:06:38,617::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:06:38,617::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 13:06:38,618::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:06:38,618::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-255::DEBUG::2013-03-01 13:06:38,619::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:38,661::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,722::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,724::volume::1029::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/afd24d51-5438-4385-bd13-288c4e5c4d5e to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 DONE >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:38,724::image::903::Storage.Image::(copy) Finished copying a558fc2a-a4a3-4118-9b81-d1d601eaa295:afd24d51-5438-4385-bd13-288c4e5c4d5e -> a558fc2a-a4a3-4118-9b81-d1d601eaa295:2dad636f-9a5b-4caf-9a69-72ad3a8a9603 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:38,725::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e justme False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,726::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,727::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,728::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,733::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:38,785::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735051 s, 13.9 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:06:38,813::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:06:38,814::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-255::DEBUG::2013-03-01 13:06:38,814::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-255::WARNING::2013-03-01 13:06:38,815::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-255::WARNING::2013-03-01 13:06:38,816::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-255::WARNING::2013-03-01 13:06:38,816::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-255::DEBUG::2013-03-01 13:06:38,817::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,984::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,985::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,985::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,985::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.afd24d51-5438-4385-bd13-288c4e5c4d5e', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,986::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:38,986::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:38,998::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:06:38,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:39,007::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000289749 s, 14.1 MB/s\n'; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,230::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,244::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::INFO::2013-03-01 13:06:39,244::blockVolume::375::Storage.Volume::(teardown) Tearing down volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 justme False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,244::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,245::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,245::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,463::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,463::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,464::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,464::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS.2dad636f-9a5b-4caf-9a69-72ad3a8a9603', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,464::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,465::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,714::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,727::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,728::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,728::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,728::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,729::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.06123103-957e-4c2c-a0df-279b9a7e7361', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,729::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,729::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,730::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,730::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,730::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,731::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,731::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.2802458b-c98e-4b45-9c22-291d956c393d', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,731::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,732::resourceManager::553::ResourceManager::(releaseResource) Released resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,732::resourceManager::558::ResourceManager::(releaseResource) Resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,732::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS.afd24d51-5438-4385-bd13-288c4e5c4d5e', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,732::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,733::task::568::TaskManager.Task::(_updateState) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::moving from state running -> state finished >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,734::task::719::TaskManager.Task::(_save) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/ebfa628d-d34f-45fa-a48d-fa4170f58bca.temp >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,745::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,745::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,746::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,746::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,747::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,747::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,747::task::880::TaskManager.Task::(_runJobs) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::Task.run: exit - success: result {'uuid': '2dad636f-9a5b-4caf-9a69-72ad3a8a9603'} >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,747::task::957::TaskManager.Task::(_decref) Task=`ebfa628d-d34f-45fa-a48d-fa4170f58bca`::ref 0 aborting False >ebfa628d-d34f-45fa-a48d-fa4170f58bca::DEBUG::2013-03-01 13:06:39,748::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-876::DEBUG::2013-03-01 13:06:40,279::task::568::TaskManager.Task::(_updateState) Task=`d89c1f5a-2ac9-4589-90e1-0500093cd671`::moving from state init -> state preparing >Thread-876::INFO::2013-03-01 13:06:40,280::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-876::INFO::2013-03-01 13:06:40,280::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00953483581543', 'lastCheck': '1.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.014888048172', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-876::DEBUG::2013-03-01 13:06:40,280::task::1151::TaskManager.Task::(prepare) Task=`d89c1f5a-2ac9-4589-90e1-0500093cd671`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.00953483581543', 'lastCheck': '1.3', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.014888048172', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-876::DEBUG::2013-03-01 13:06:40,281::task::568::TaskManager.Task::(_updateState) Task=`d89c1f5a-2ac9-4589-90e1-0500093cd671`::moving from state preparing -> state finished >Thread-876::DEBUG::2013-03-01 13:06:40,281::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-876::DEBUG::2013-03-01 13:06:40,281::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-876::DEBUG::2013-03-01 13:06:40,281::task::957::TaskManager.Task::(_decref) Task=`d89c1f5a-2ac9-4589-90e1-0500093cd671`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:40,800::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:40,912::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049297 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:42,926::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:43,013::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413264 s, 24.8 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:44,772::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:44,785::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000434394 s, 9.4 MB/s\n'; <rc> = 0 >Thread-879::DEBUG::2013-03-01 13:06:44,949::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-879::DEBUG::2013-03-01 13:06:44,950::task::568::TaskManager.Task::(_updateState) Task=`6ca64db7-b988-4029-ad3b-ff691e9f5402`::moving from state init -> state preparing >Thread-879::INFO::2013-03-01 13:06:44,950::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-879::INFO::2013-03-01 13:06:44,950::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-879::DEBUG::2013-03-01 13:06:44,951::task::1151::TaskManager.Task::(prepare) Task=`6ca64db7-b988-4029-ad3b-ff691e9f5402`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-879::DEBUG::2013-03-01 13:06:44,951::task::568::TaskManager.Task::(_updateState) Task=`6ca64db7-b988-4029-ad3b-ff691e9f5402`::moving from state preparing -> state finished >Thread-879::DEBUG::2013-03-01 13:06:44,951::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-879::DEBUG::2013-03-01 13:06:44,952::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-879::DEBUG::2013-03-01 13:06:44,952::task::957::TaskManager.Task::(_decref) Task=`6ca64db7-b988-4029-ad3b-ff691e9f5402`::ref 0 aborting False >Thread-880::DEBUG::2013-03-01 13:06:44,976::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-880::DEBUG::2013-03-01 13:06:44,977::task::568::TaskManager.Task::(_updateState) Task=`4064dc33-490e-436f-89ba-7f693e706fd8`::moving from state init -> state preparing >Thread-880::INFO::2013-03-01 13:06:44,977::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-880::DEBUG::2013-03-01 13:06:44,978::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`6e2631c8-11de-499e-b519-c6956cf31b02`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-880::DEBUG::2013-03-01 13:06:44,978::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-880::DEBUG::2013-03-01 13:06:44,979::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-880::DEBUG::2013-03-01 13:06:44,979::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`6e2631c8-11de-499e-b519-c6956cf31b02`::Granted request >Thread-880::DEBUG::2013-03-01 13:06:44,980::task::794::TaskManager.Task::(resourceAcquired) Task=`4064dc33-490e-436f-89ba-7f693e706fd8`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-880::DEBUG::2013-03-01 13:06:44,980::task::957::TaskManager.Task::(_decref) Task=`4064dc33-490e-436f-89ba-7f693e706fd8`::ref 1 aborting False >Thread-880::INFO::2013-03-01 13:06:44,981::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-880::DEBUG::2013-03-01 13:06:44,982::task::1151::TaskManager.Task::(prepare) Task=`4064dc33-490e-436f-89ba-7f693e706fd8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-880::DEBUG::2013-03-01 13:06:44,982::task::568::TaskManager.Task::(_updateState) Task=`4064dc33-490e-436f-89ba-7f693e706fd8`::moving from state preparing -> state finished >Thread-880::DEBUG::2013-03-01 13:06:44,982::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-880::DEBUG::2013-03-01 13:06:44,983::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-880::DEBUG::2013-03-01 13:06:44,983::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-880::DEBUG::2013-03-01 13:06:44,984::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-880::DEBUG::2013-03-01 13:06:44,984::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-880::DEBUG::2013-03-01 13:06:44,984::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-880::DEBUG::2013-03-01 13:06:44,984::task::957::TaskManager.Task::(_decref) Task=`4064dc33-490e-436f-89ba-7f693e706fd8`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:45,027::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:45,142::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048812 s, 21.0 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:47,161::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-882::DEBUG::2013-03-01 13:06:47,208::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-882::DEBUG::2013-03-01 13:06:47,209::task::568::TaskManager.Task::(_updateState) Task=`7987a2c5-6b72-44e1-b6bb-9f85c4c47e75`::moving from state init -> state preparing >Thread-882::INFO::2013-03-01 13:06:47,210::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-882::DEBUG::2013-03-01 13:06:47,210::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-882::DEBUG::2013-03-01 13:06:47,210::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-882::DEBUG::2013-03-01 13:06:47,211::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'} >Thread-882::DEBUG::2013-03-01 13:06:47,211::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}} >Thread-882::INFO::2013-03-01 13:06:47,211::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}}} >Thread-882::DEBUG::2013-03-01 13:06:47,212::task::1151::TaskManager.Task::(prepare) Task=`7987a2c5-6b72-44e1-b6bb-9f85c4c47e75`::finished: {'allTasksStatus': {'ebfa628d-d34f-45fa-a48d-fa4170f58bca': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ebfa628d-d34f-45fa-a48d-fa4170f58bca'}}} >Thread-882::DEBUG::2013-03-01 13:06:47,212::task::568::TaskManager.Task::(_updateState) Task=`7987a2c5-6b72-44e1-b6bb-9f85c4c47e75`::moving from state preparing -> state finished >Thread-882::DEBUG::2013-03-01 13:06:47,212::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-882::DEBUG::2013-03-01 13:06:47,212::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-882::DEBUG::2013-03-01 13:06:47,213::task::957::TaskManager.Task::(_decref) Task=`7987a2c5-6b72-44e1-b6bb-9f85c4c47e75`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:47,252::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450031 s, 22.8 MB/s\n'; <rc> = 0 >Thread-883::DEBUG::2013-03-01 13:06:47,279::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-883::DEBUG::2013-03-01 13:06:47,280::task::568::TaskManager.Task::(_updateState) Task=`79b4f278-5f08-4f8e-9bb2-5b7608945f15`::moving from state init -> state preparing >Thread-883::INFO::2013-03-01 13:06:47,280::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='06123103-957e-4c2c-a0df-279b9a7e7361', volUUID='2dad636f-9a5b-4caf-9a69-72ad3a8a9603', options=None) >Thread-883::DEBUG::2013-03-01 13:06:47,280::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`514421eb-07eb-4d99-ab36-edd965e70ef7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-883::DEBUG::2013-03-01 13:06:47,281::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-883::DEBUG::2013-03-01 13:06:47,281::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-883::DEBUG::2013-03-01 13:06:47,281::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`514421eb-07eb-4d99-ab36-edd965e70ef7`::Granted request >Thread-883::DEBUG::2013-03-01 13:06:47,281::task::794::TaskManager.Task::(resourceAcquired) Task=`79b4f278-5f08-4f8e-9bb2-5b7608945f15`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-883::DEBUG::2013-03-01 13:06:47,282::task::957::TaskManager.Task::(_decref) Task=`79b4f278-5f08-4f8e-9bb2-5b7608945f15`::ref 1 aborting False >Thread-883::INFO::2013-03-01 13:06:47,282::volume::797::Storage.Volume::(getInfo) Info request: sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 imgUUID=06123103-957e-4c2c-a0df-279b9a7e7361 volUUID = 2dad636f-9a5b-4caf-9a69-72ad3a8a9603 >Thread-883::DEBUG::2013-03-01 13:06:47,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-883::DEBUG::2013-03-01 13:06:47,291::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000334015 s, 1.5 MB/s\n'; <rc> = 0 >Thread-883::DEBUG::2013-03-01 13:06:47,291::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000334015 s, 1.5 MB/s'], size: 512 >Thread-883::DEBUG::2013-03-01 13:06:47,292::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-883::DEBUG::2013-03-01 13:06:47,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000352871 s, 1.5 MB/s\n'; <rc> = 0 >Thread-883::DEBUG::2013-03-01 13:06:47,301::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000352871 s, 1.5 MB/s'], size: 512 >Thread-883::DEBUG::2013-03-01 13:06:47,302::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-883::DEBUG::2013-03-01 13:06:47,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-883::DEBUG::2013-03-01 13:06:47,548::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-883::DEBUG::2013-03-01 13:06:47,561::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-883::INFO::2013-03-01 13:06:47,561::volume::826::Storage.Volume::(getInfo) a558fc2a-a4a3-4118-9b81-d1d601eaa295/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603 info is {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '06123103-957e-4c2c-a0df-279b9a7e7361', 'ctime': '1362135988', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135996', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '2dad636f-9a5b-4caf-9a69-72ad3a8a9603', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-883::INFO::2013-03-01 13:06:47,562::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '06123103-957e-4c2c-a0df-279b9a7e7361', 'ctime': '1362135988', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135996', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '2dad636f-9a5b-4caf-9a69-72ad3a8a9603', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-883::DEBUG::2013-03-01 13:06:47,562::task::1151::TaskManager.Task::(prepare) Task=`79b4f278-5f08-4f8e-9bb2-5b7608945f15`::finished: {'info': {'status': 'OK', 'domain': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '06123103-957e-4c2c-a0df-279b9a7e7361', 'ctime': '1362135988', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1362135996', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '6442450944', 'uuid': '2dad636f-9a5b-4caf-9a69-72ad3a8a9603', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-883::DEBUG::2013-03-01 13:06:47,562::task::568::TaskManager.Task::(_updateState) Task=`79b4f278-5f08-4f8e-9bb2-5b7608945f15`::moving from state preparing -> state finished >Thread-883::DEBUG::2013-03-01 13:06:47,562::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-883::DEBUG::2013-03-01 13:06:47,563::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-883::DEBUG::2013-03-01 13:06:47,563::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-883::DEBUG::2013-03-01 13:06:47,563::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-883::DEBUG::2013-03-01 13:06:47,563::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-883::DEBUG::2013-03-01 13:06:47,564::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-883::DEBUG::2013-03-01 13:06:47,564::task::957::TaskManager.Task::(_decref) Task=`79b4f278-5f08-4f8e-9bb2-5b7608945f15`::ref 0 aborting False >Thread-884::DEBUG::2013-03-01 13:06:47,626::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-884::DEBUG::2013-03-01 13:06:47,627::task::568::TaskManager.Task::(_updateState) Task=`8d1d4a17-ec00-4e61-9d91-d6cdf67f23c0`::moving from state init -> state preparing >Thread-884::INFO::2013-03-01 13:06:47,627::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='ebfa628d-d34f-45fa-a48d-fa4170f58bca', spUUID=None, options=None) >Thread-884::DEBUG::2013-03-01 13:06:47,627::taskManager::161::TaskManager::(clearTask) Entry. taskID: ebfa628d-d34f-45fa-a48d-fa4170f58bca >Thread-884::DEBUG::2013-03-01 13:06:47,629::taskManager::166::TaskManager::(clearTask) Return. >Thread-884::INFO::2013-03-01 13:06:47,629::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-884::DEBUG::2013-03-01 13:06:47,629::task::1151::TaskManager.Task::(prepare) Task=`8d1d4a17-ec00-4e61-9d91-d6cdf67f23c0`::finished: None >Thread-884::DEBUG::2013-03-01 13:06:47,629::task::568::TaskManager.Task::(_updateState) Task=`8d1d4a17-ec00-4e61-9d91-d6cdf67f23c0`::moving from state preparing -> state finished >Thread-884::DEBUG::2013-03-01 13:06:47,630::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-884::DEBUG::2013-03-01 13:06:47,630::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-884::DEBUG::2013-03-01 13:06:47,630::task::957::TaskManager.Task::(_decref) Task=`8d1d4a17-ec00-4e61-9d91-d6cdf67f23c0`::ref 0 aborting False >Thread-255::DEBUG::2013-03-01 13:06:49,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:49,019::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000299982 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:49,274::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:49,371::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385065 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:51,391::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:51,490::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372949 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:06:53,510::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:53,609::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460538 s, 22.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:06:54,826::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:06:54,838::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000364364 s, 11.2 MB/s\n'; <rc> = 0 >Thread-887::DEBUG::2013-03-01 13:06:55,025::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-887::DEBUG::2013-03-01 13:06:55,026::task::568::TaskManager.Task::(_updateState) Task=`9d43868f-49ad-40ce-aba4-c9b985815f18`::moving from state init -> state preparing >Thread-887::INFO::2013-03-01 13:06:55,026::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-887::INFO::2013-03-01 13:06:55,027::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-887::DEBUG::2013-03-01 13:06:55,027::task::1151::TaskManager.Task::(prepare) Task=`9d43868f-49ad-40ce-aba4-c9b985815f18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-887::DEBUG::2013-03-01 13:06:55,028::task::568::TaskManager.Task::(_updateState) Task=`9d43868f-49ad-40ce-aba4-c9b985815f18`::moving from state preparing -> state finished >Thread-887::DEBUG::2013-03-01 13:06:55,028::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-887::DEBUG::2013-03-01 13:06:55,028::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-887::DEBUG::2013-03-01 13:06:55,028::task::957::TaskManager.Task::(_decref) Task=`9d43868f-49ad-40ce-aba4-c9b985815f18`::ref 0 aborting False >Thread-888::DEBUG::2013-03-01 13:06:55,053::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-888::DEBUG::2013-03-01 13:06:55,053::task::568::TaskManager.Task::(_updateState) Task=`89ed1d64-1e27-4457-80ee-ddbe4f4edb0b`::moving from state init -> state preparing >Thread-888::INFO::2013-03-01 13:06:55,054::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-888::DEBUG::2013-03-01 13:06:55,054::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`5794a51b-4fc8-4d96-a38c-e1cb62756426`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-888::DEBUG::2013-03-01 13:06:55,055::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-888::DEBUG::2013-03-01 13:06:55,055::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-888::DEBUG::2013-03-01 13:06:55,055::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`5794a51b-4fc8-4d96-a38c-e1cb62756426`::Granted request >Thread-888::DEBUG::2013-03-01 13:06:55,056::task::794::TaskManager.Task::(resourceAcquired) Task=`89ed1d64-1e27-4457-80ee-ddbe4f4edb0b`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-888::DEBUG::2013-03-01 13:06:55,056::task::957::TaskManager.Task::(_decref) Task=`89ed1d64-1e27-4457-80ee-ddbe4f4edb0b`::ref 1 aborting False >Thread-888::INFO::2013-03-01 13:06:55,058::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-888::DEBUG::2013-03-01 13:06:55,058::task::1151::TaskManager.Task::(prepare) Task=`89ed1d64-1e27-4457-80ee-ddbe4f4edb0b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '42681237504', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-888::DEBUG::2013-03-01 13:06:55,058::task::568::TaskManager.Task::(_updateState) Task=`89ed1d64-1e27-4457-80ee-ddbe4f4edb0b`::moving from state preparing -> state finished >Thread-888::DEBUG::2013-03-01 13:06:55,059::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-888::DEBUG::2013-03-01 13:06:55,059::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-888::DEBUG::2013-03-01 13:06:55,059::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-888::DEBUG::2013-03-01 13:06:55,060::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-888::DEBUG::2013-03-01 13:06:55,060::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-888::DEBUG::2013-03-01 13:06:55,060::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-888::DEBUG::2013-03-01 13:06:55,061::task::957::TaskManager.Task::(_decref) Task=`89ed1d64-1e27-4457-80ee-ddbe4f4edb0b`::ref 0 aborting False >Thread-889::DEBUG::2013-03-01 13:06:55,493::task::568::TaskManager.Task::(_updateState) Task=`c14e47ab-9c6e-4175-ba88-2560cef64170`::moving from state init -> state preparing >Thread-889::INFO::2013-03-01 13:06:55,493::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-889::INFO::2013-03-01 13:06:55,493::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103878974915', 'lastCheck': '6.5', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131301879883', 'lastCheck': '0.6', 'code': 0, 'valid': True}} >Thread-889::DEBUG::2013-03-01 13:06:55,494::task::1151::TaskManager.Task::(prepare) Task=`c14e47ab-9c6e-4175-ba88-2560cef64170`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0103878974915', 'lastCheck': '6.5', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131301879883', 'lastCheck': '0.6', 'code': 0, 'valid': True}} >Thread-889::DEBUG::2013-03-01 13:06:55,494::task::568::TaskManager.Task::(_updateState) Task=`c14e47ab-9c6e-4175-ba88-2560cef64170`::moving from state preparing -> state finished >Thread-889::DEBUG::2013-03-01 13:06:55,494::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-889::DEBUG::2013-03-01 13:06:55,494::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-889::DEBUG::2013-03-01 13:06:55,495::task::957::TaskManager.Task::(_decref) Task=`c14e47ab-9c6e-4175-ba88-2560cef64170`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:06:55,624::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:55,738::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496492 s, 20.6 MB/s\n'; <rc> = 0 >Thread-891::DEBUG::2013-03-01 13:06:57,536::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-891::DEBUG::2013-03-01 13:06:57,537::task::568::TaskManager.Task::(_updateState) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::moving from state init -> state preparing >Thread-891::INFO::2013-03-01 13:06:57,538::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='06123103-957e-4c2c-a0df-279b9a7e7361', postZero='false', force='false') >Thread-891::INFO::2013-03-01 13:06:57,538::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-891::DEBUG::2013-03-01 13:06:57,539::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-891::DEBUG::2013-03-01 13:06:57,740::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-891::DEBUG::2013-03-01 13:06:57,740::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,741::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,741::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,741::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,742::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,742::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:57,758::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:57,847::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042259 s, 24.2 MB/s\n'; <rc> = 0 >Thread-891::DEBUG::2013-03-01 13:06:57,933::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-891::DEBUG::2013-03-01 13:06:57,935::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,935::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-891::DEBUG::2013-03-01 13:06:57,937::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.06123103-957e-4c2c-a0df-279b9a7e7361`ReqID=`b7917748-9773-4f87-a784-0d0c23740b2b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-891::DEBUG::2013-03-01 13:06:57,937::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361' for lock type 'exclusive' >Thread-891::DEBUG::2013-03-01 13:06:57,937::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361' is free. Now locking as 'exclusive' (1 active user) >Thread-891::DEBUG::2013-03-01 13:06:57,938::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.06123103-957e-4c2c-a0df-279b9a7e7361`ReqID=`b7917748-9773-4f87-a784-0d0c23740b2b`::Granted request >Thread-891::DEBUG::2013-03-01 13:06:57,940::task::794::TaskManager.Task::(resourceAcquired) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_resourcesAcquired: Storage.06123103-957e-4c2c-a0df-279b9a7e7361 (exclusive) >Thread-891::DEBUG::2013-03-01 13:06:57,940::task::957::TaskManager.Task::(_decref) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::ref 1 aborting False >Thread-891::DEBUG::2013-03-01 13:06:57,940::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`c444641a-f8bf-4e8f-8b91-3848ba22bf24`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-891::DEBUG::2013-03-01 13:06:57,941::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-891::DEBUG::2013-03-01 13:06:57,941::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-891::DEBUG::2013-03-01 13:06:57,941::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`c444641a-f8bf-4e8f-8b91-3848ba22bf24`::Granted request >Thread-891::DEBUG::2013-03-01 13:06:57,942::task::794::TaskManager.Task::(resourceAcquired) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-891::DEBUG::2013-03-01 13:06:57,942::task::957::TaskManager.Task::(_decref) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::ref 1 aborting False >Thread-891::DEBUG::2013-03-01 13:06:57,942::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:57,943::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-891::DEBUG::2013-03-01 13:06:58,234::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-891::DEBUG::2013-03-01 13:06:58,249::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:58,250::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/2dad636f-9a5b-4caf-9a69-72ad3a8a9603' (cwd None) >Thread-891::DEBUG::2013-03-01 13:06:58,505::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-891::DEBUG::2013-03-01 13:06:58,506::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:58,506::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-891::DEBUG::2013-03-01 13:06:58,507::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361/2dad636f-9a5b-4caf-9a69-72ad3a8a9603'] >Thread-891::DEBUG::2013-03-01 13:06:58,507::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/06123103-957e-4c2c-a0df-279b9a7e7361 >Thread-891::DEBUG::2013-03-01 13:06:58,508::task::719::TaskManager.Task::(_save) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b.temp >Thread-891::DEBUG::2013-03-01 13:06:58,514::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_06123103-957e-4c2c-a0df-279b9a7e7361 for task 1c8c5fed-d2d3-4795-b127-447367c2cf9b >Thread-891::INFO::2013-03-01 13:06:58,514::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-891::DEBUG::2013-03-01 13:06:58,515::task::1146::TaskManager.Task::(prepare) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::Prepare: 1 jobs exist, move to acquiring >Thread-891::DEBUG::2013-03-01 13:06:58,515::task::568::TaskManager.Task::(_updateState) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::moving from state preparing -> state acquiring >Thread-891::DEBUG::2013-03-01 13:06:58,516::task::719::TaskManager.Task::(_save) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b.temp >Thread-891::DEBUG::2013-03-01 13:06:58,523::task::568::TaskManager.Task::(_updateState) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::moving from state acquiring -> state queued >Thread-891::DEBUG::2013-03-01 13:06:58,524::task::719::TaskManager.Task::(_save) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b.temp >Thread-891::DEBUG::2013-03-01 13:06:58,531::taskManager::50::TaskManager::(_queueTask) queuing task: 1c8c5fed-d2d3-4795-b127-447367c2cf9b >Thread-891::DEBUG::2013-03-01 13:06:58,532::taskManager::56::TaskManager::(_queueTask) task queued: 1c8c5fed-d2d3-4795-b127-447367c2cf9b >48229b0d-fd66-42c2-8de4-a18a3c6d685b::DEBUG::2013-03-01 13:06:58,532::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-891::DEBUG::2013-03-01 13:06:58,533::task::1148::TaskManager.Task::(prepare) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::returning >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,534::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 1c8c5fed-d2d3-4795-b127-447367c2cf9b running: <bound method Task.commit of <storage.task.Task instance at 0x7f15f803ff38>> with: None >Thread-891::DEBUG::2013-03-01 13:06:58,534::task::957::TaskManager.Task::(_decref) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::ref 0 aborting False >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,535::task::1159::TaskManager.Task::(commit) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::committing task: 1c8c5fed-d2d3-4795-b127-447367c2cf9b >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,537::task::568::TaskManager.Task::(_updateState) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::moving from state queued -> state running >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,540::task::719::TaskManager.Task::(_save) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b.temp >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,549::task::872::TaskManager.Task::(_runJobs) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::Task.run: running job 0: deleteImage_06123103-957e-4c2c-a0df-279b9a7e7361: <function <lambda> at 0x7f15f80ac9b0> (args: () kwargs: {}) >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,549::task::304::TaskManager.Task::(run) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::Job.run: running deleteImage_06123103-957e-4c2c-a0df-279b9a7e7361: <function <lambda> at 0x7f15f80ac9b0> (args: () kwargs: {}) callback None >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,549::task::568::TaskManager.Task::(_updateState) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::moving from state running -> state finished >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,550::task::719::TaskManager.Task::(_save) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/1c8c5fed-d2d3-4795-b127-447367c2cf9b.temp >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,558::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361': < ResourceRef 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361', isValid: 'True' obj: 'None'>} >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,558::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,559::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,559::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,559::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,560::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,560::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361' >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,561::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361' (0 active users) >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,561::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361' is free, finding out if anyone is waiting for it. >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,561::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.06123103-957e-4c2c-a0df-279b9a7e7361', Clearing records. >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,562::task::880::TaskManager.Task::(_runJobs) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::Task.run: exit - success: result True >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,562::task::957::TaskManager.Task::(_decref) Task=`1c8c5fed-d2d3-4795-b127-447367c2cf9b`::ref 0 aborting False >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:06:58,562::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-892::DEBUG::2013-03-01 13:06:58,568::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-892::DEBUG::2013-03-01 13:06:58,569::task::568::TaskManager.Task::(_updateState) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::moving from state init -> state preparing >Thread-892::INFO::2013-03-01 13:06:58,569::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', postZero='false', force='false') >Thread-892::INFO::2013-03-01 13:06:58,569::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-892::DEBUG::2013-03-01 13:06:58,570::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-892::DEBUG::2013-03-01 13:06:58,817::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-892::DEBUG::2013-03-01 13:06:58,818::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:58,818::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:58,819::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:58,819::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:58,819::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:58,820::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:59,021::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:06:59,031::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292456 s, 14.0 MB/s\n'; <rc> = 0 >Thread-892::DEBUG::2013-03-01 13:06:59,183::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-892::DEBUG::2013-03-01 13:06:59,185::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,185::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-892::DEBUG::2013-03-01 13:06:59,187::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`51e31289-3090-4c5f-beda-c3beaf71a53a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-892::DEBUG::2013-03-01 13:06:59,187::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' for lock type 'exclusive' >Thread-892::DEBUG::2013-03-01 13:06:59,187::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free. Now locking as 'exclusive' (1 active user) >Thread-892::DEBUG::2013-03-01 13:06:59,188::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9`ReqID=`51e31289-3090-4c5f-beda-c3beaf71a53a`::Granted request >Thread-892::DEBUG::2013-03-01 13:06:59,188::task::794::TaskManager.Task::(resourceAcquired) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_resourcesAcquired: Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 (exclusive) >Thread-892::DEBUG::2013-03-01 13:06:59,189::task::957::TaskManager.Task::(_decref) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::ref 1 aborting False >Thread-892::DEBUG::2013-03-01 13:06:59,189::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e08d719e-fab1-45e1-bf3d-f1c7fd389ed5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-892::DEBUG::2013-03-01 13:06:59,189::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-892::DEBUG::2013-03-01 13:06:59,190::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-892::DEBUG::2013-03-01 13:06:59,190::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e08d719e-fab1-45e1-bf3d-f1c7fd389ed5`::Granted request >Thread-892::DEBUG::2013-03-01 13:06:59,191::task::794::TaskManager.Task::(resourceAcquired) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-892::DEBUG::2013-03-01 13:06:59,191::task::957::TaskManager.Task::(_decref) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::ref 1 aborting False >Thread-892::DEBUG::2013-03-01 13:06:59,191::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,192::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-892::DEBUG::2013-03-01 13:06:59,436::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-892::DEBUG::2013-03-01 13:06:59,450::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,451::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/afd24d51-5438-4385-bd13-288c4e5c4d5e a558fc2a-a4a3-4118-9b81-d1d601eaa295/2802458b-c98e-4b45-9c22-291d956c393d' (cwd None) >Thread-892::DEBUG::2013-03-01 13:06:59,719::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-892::DEBUG::2013-03-01 13:06:59,720::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,720::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,720::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,721::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-892::DEBUG::2013-03-01 13:06:59,721::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9/2802458b-c98e-4b45-9c22-291d956c393d'] >Thread-892::DEBUG::2013-03-01 13:06:59,721::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 >Thread-892::DEBUG::2013-03-01 13:06:59,722::task::719::TaskManager.Task::(_save) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559.temp >Thread-892::DEBUG::2013-03-01 13:06:59,728::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_2a7ef410-9a24-4327-a3cc-3ab55d0a35e9 for task c87bcef9-8c00-46a7-9dbf-534cb3680559 >Thread-892::INFO::2013-03-01 13:06:59,728::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-892::DEBUG::2013-03-01 13:06:59,728::task::1146::TaskManager.Task::(prepare) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::Prepare: 1 jobs exist, move to acquiring >Thread-892::DEBUG::2013-03-01 13:06:59,728::task::568::TaskManager.Task::(_updateState) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::moving from state preparing -> state acquiring >Thread-892::DEBUG::2013-03-01 13:06:59,729::task::719::TaskManager.Task::(_save) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559.temp >Thread-892::DEBUG::2013-03-01 13:06:59,734::task::568::TaskManager.Task::(_updateState) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::moving from state acquiring -> state queued >Thread-892::DEBUG::2013-03-01 13:06:59,735::task::719::TaskManager.Task::(_save) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559.temp >Thread-892::DEBUG::2013-03-01 13:06:59,740::taskManager::50::TaskManager::(_queueTask) queuing task: c87bcef9-8c00-46a7-9dbf-534cb3680559 >Thread-892::DEBUG::2013-03-01 13:06:59,741::taskManager::56::TaskManager::(_queueTask) task queued: c87bcef9-8c00-46a7-9dbf-534cb3680559 >3116cf8e-5431-4be8-9a26-4e61691ab87c::DEBUG::2013-03-01 13:06:59,741::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-892::DEBUG::2013-03-01 13:06:59,741::task::1148::TaskManager.Task::(prepare) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::returning >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,742::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: c87bcef9-8c00-46a7-9dbf-534cb3680559 running: <bound method Task.commit of <storage.task.Task instance at 0x7f15ec1b4170>> with: None >Thread-892::DEBUG::2013-03-01 13:06:59,742::task::957::TaskManager.Task::(_decref) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::ref 0 aborting False >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,743::task::1159::TaskManager.Task::(commit) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::committing task: c87bcef9-8c00-46a7-9dbf-534cb3680559 >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,744::task::568::TaskManager.Task::(_updateState) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::moving from state queued -> state running >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,747::task::719::TaskManager.Task::(_save) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559.temp >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,753::task::872::TaskManager.Task::(_runJobs) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::Task.run: running job 0: deleteImage_2a7ef410-9a24-4327-a3cc-3ab55d0a35e9: <function <lambda> at 0x7f15f0048578> (args: () kwargs: {}) >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,753::task::304::TaskManager.Task::(run) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::Job.run: running deleteImage_2a7ef410-9a24-4327-a3cc-3ab55d0a35e9: <function <lambda> at 0x7f15f0048578> (args: () kwargs: {}) callback None >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,753::task::568::TaskManager.Task::(_updateState) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::moving from state running -> state finished >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,754::task::719::TaskManager.Task::(_save) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/c87bcef9-8c00-46a7-9dbf-534cb3680559.temp >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,761::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9': < ResourceRef 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', isValid: 'True' obj: 'None'>} >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,762::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,762::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,763::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,763::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,763::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,764::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,764::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' (0 active users) >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,764::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9' is free, finding out if anyone is waiting for it. >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,765::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.2a7ef410-9a24-4327-a3cc-3ab55d0a35e9', Clearing records. >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,765::task::880::TaskManager.Task::(_runJobs) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::Task.run: exit - success: result True >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,765::task::957::TaskManager.Task::(_decref) Task=`c87bcef9-8c00-46a7-9dbf-534cb3680559`::ref 0 aborting False >c87bcef9-8c00-46a7-9dbf-534cb3680559::DEBUG::2013-03-01 13:06:59,766::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:06:59,860::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:06:59,976::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492089 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:07:01,997::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:03,368::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.459754 s, 2.2 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:04,845::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:07:04,845::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-896::DEBUG::2013-03-01 13:07:05,103::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-896::DEBUG::2013-03-01 13:07:05,123::task::568::TaskManager.Task::(_updateState) Task=`16825852-f037-4ef5-bac7-65c5538cee79`::moving from state init -> state preparing >Thread-896::INFO::2013-03-01 13:07:05,123::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-896::INFO::2013-03-01 13:07:05,124::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-896::DEBUG::2013-03-01 13:07:05,124::task::1151::TaskManager.Task::(prepare) Task=`16825852-f037-4ef5-bac7-65c5538cee79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-896::DEBUG::2013-03-01 13:07:05,124::task::568::TaskManager.Task::(_updateState) Task=`16825852-f037-4ef5-bac7-65c5538cee79`::moving from state preparing -> state finished >Thread-896::DEBUG::2013-03-01 13:07:05,124::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-896::DEBUG::2013-03-01 13:07:05,124::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-896::DEBUG::2013-03-01 13:07:05,124::task::957::TaskManager.Task::(_decref) Task=`16825852-f037-4ef5-bac7-65c5538cee79`::ref 0 aborting False >Thread-897::DEBUG::2013-03-01 13:07:05,161::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-897::DEBUG::2013-03-01 13:07:05,196::task::568::TaskManager.Task::(_updateState) Task=`a6043b1f-133d-4f86-a688-4e209a846609`::moving from state init -> state preparing >Thread-897::INFO::2013-03-01 13:07:05,196::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-897::DEBUG::2013-03-01 13:07:05,196::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e0ac0446-e251-484f-8e5b-bb39193287b4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-897::DEBUG::2013-03-01 13:07:05,197::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-897::DEBUG::2013-03-01 13:07:05,197::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-897::DEBUG::2013-03-01 13:07:05,197::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`e0ac0446-e251-484f-8e5b-bb39193287b4`::Granted request >Thread-897::DEBUG::2013-03-01 13:07:05,198::task::794::TaskManager.Task::(resourceAcquired) Task=`a6043b1f-133d-4f86-a688-4e209a846609`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-897::DEBUG::2013-03-01 13:07:05,198::task::957::TaskManager.Task::(_decref) Task=`a6043b1f-133d-4f86-a688-4e209a846609`::ref 1 aborting False >Thread-897::DEBUG::2013-03-01 13:07:05,199::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-897::DEBUG::2013-03-01 13:07:05,200::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:05,216::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:05,218::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:05,230::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00032619 s, 12.6 MB/s\n'; <rc> = 0 >Thread-897::DEBUG::2013-03-01 13:07:05,419::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-897::DEBUG::2013-03-01 13:07:05,421::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-897::INFO::2013-03-01 13:07:05,422::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-897::DEBUG::2013-03-01 13:07:05,422::task::1151::TaskManager.Task::(prepare) Task=`a6043b1f-133d-4f86-a688-4e209a846609`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '45902462976', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-897::DEBUG::2013-03-01 13:07:05,423::task::568::TaskManager.Task::(_updateState) Task=`a6043b1f-133d-4f86-a688-4e209a846609`::moving from state preparing -> state finished >Thread-897::DEBUG::2013-03-01 13:07:05,423::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-897::DEBUG::2013-03-01 13:07:05,423::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-897::DEBUG::2013-03-01 13:07:05,423::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-897::DEBUG::2013-03-01 13:07:05,424::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-897::DEBUG::2013-03-01 13:07:05,424::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-897::DEBUG::2013-03-01 13:07:05,424::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-897::DEBUG::2013-03-01 13:07:05,425::task::957::TaskManager.Task::(_decref) Task=`a6043b1f-133d-4f86-a688-4e209a846609`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:05,466::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:05,550::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390108 s, 26.2 MB/s\n'; <rc> = 0 >Thread-898::DEBUG::2013-03-01 13:07:07,254::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-898::DEBUG::2013-03-01 13:07:07,255::task::568::TaskManager.Task::(_updateState) Task=`96e6a908-2cea-406c-a9b2-e9cddf8f4be8`::moving from state init -> state preparing >Thread-898::INFO::2013-03-01 13:07:07,255::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-898::DEBUG::2013-03-01 13:07:07,255::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-898::DEBUG::2013-03-01 13:07:07,256::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c87bcef9-8c00-46a7-9dbf-534cb3680559 >Thread-898::DEBUG::2013-03-01 13:07:07,256::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c87bcef9-8c00-46a7-9dbf-534cb3680559'} >Thread-898::DEBUG::2013-03-01 13:07:07,256::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1c8c5fed-d2d3-4795-b127-447367c2cf9b >Thread-898::DEBUG::2013-03-01 13:07:07,256::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1c8c5fed-d2d3-4795-b127-447367c2cf9b'} >Thread-898::DEBUG::2013-03-01 13:07:07,257::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'c87bcef9-8c00-46a7-9dbf-534cb3680559': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c87bcef9-8c00-46a7-9dbf-534cb3680559'}, '1c8c5fed-d2d3-4795-b127-447367c2cf9b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1c8c5fed-d2d3-4795-b127-447367c2cf9b'}} >Thread-898::INFO::2013-03-01 13:07:07,257::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'c87bcef9-8c00-46a7-9dbf-534cb3680559': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c87bcef9-8c00-46a7-9dbf-534cb3680559'}, '1c8c5fed-d2d3-4795-b127-447367c2cf9b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1c8c5fed-d2d3-4795-b127-447367c2cf9b'}}} >Thread-898::DEBUG::2013-03-01 13:07:07,257::task::1151::TaskManager.Task::(prepare) Task=`96e6a908-2cea-406c-a9b2-e9cddf8f4be8`::finished: {'allTasksStatus': {'c87bcef9-8c00-46a7-9dbf-534cb3680559': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c87bcef9-8c00-46a7-9dbf-534cb3680559'}, '1c8c5fed-d2d3-4795-b127-447367c2cf9b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1c8c5fed-d2d3-4795-b127-447367c2cf9b'}}} >Thread-898::DEBUG::2013-03-01 13:07:07,257::task::568::TaskManager.Task::(_updateState) Task=`96e6a908-2cea-406c-a9b2-e9cddf8f4be8`::moving from state preparing -> state finished >Thread-898::DEBUG::2013-03-01 13:07:07,258::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-898::DEBUG::2013-03-01 13:07:07,258::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-898::DEBUG::2013-03-01 13:07:07,258::task::957::TaskManager.Task::(_decref) Task=`96e6a908-2cea-406c-a9b2-e9cddf8f4be8`::ref 0 aborting False >Thread-899::DEBUG::2013-03-01 13:07:07,347::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-899::DEBUG::2013-03-01 13:07:07,348::task::568::TaskManager.Task::(_updateState) Task=`2b6725a5-8b5b-4cd4-9479-59523ca249cc`::moving from state init -> state preparing >Thread-899::INFO::2013-03-01 13:07:07,348::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1c8c5fed-d2d3-4795-b127-447367c2cf9b', spUUID=None, options=None) >Thread-899::DEBUG::2013-03-01 13:07:07,348::taskManager::161::TaskManager::(clearTask) Entry. taskID: 1c8c5fed-d2d3-4795-b127-447367c2cf9b >Thread-899::DEBUG::2013-03-01 13:07:07,349::taskManager::166::TaskManager::(clearTask) Return. >Thread-899::INFO::2013-03-01 13:07:07,350::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-899::DEBUG::2013-03-01 13:07:07,350::task::1151::TaskManager.Task::(prepare) Task=`2b6725a5-8b5b-4cd4-9479-59523ca249cc`::finished: None >Thread-899::DEBUG::2013-03-01 13:07:07,350::task::568::TaskManager.Task::(_updateState) Task=`2b6725a5-8b5b-4cd4-9479-59523ca249cc`::moving from state preparing -> state finished >Thread-899::DEBUG::2013-03-01 13:07:07,350::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-899::DEBUG::2013-03-01 13:07:07,351::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-899::DEBUG::2013-03-01 13:07:07,351::task::957::TaskManager.Task::(_decref) Task=`2b6725a5-8b5b-4cd4-9479-59523ca249cc`::ref 0 aborting False >Thread-900::DEBUG::2013-03-01 13:07:07,378::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-900::DEBUG::2013-03-01 13:07:07,378::task::568::TaskManager.Task::(_updateState) Task=`5f396645-2635-4df8-9692-cbb1aa98e4ef`::moving from state init -> state preparing >Thread-900::INFO::2013-03-01 13:07:07,379::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='c87bcef9-8c00-46a7-9dbf-534cb3680559', spUUID=None, options=None) >Thread-900::DEBUG::2013-03-01 13:07:07,379::taskManager::161::TaskManager::(clearTask) Entry. taskID: c87bcef9-8c00-46a7-9dbf-534cb3680559 >Thread-900::DEBUG::2013-03-01 13:07:07,380::taskManager::166::TaskManager::(clearTask) Return. >Thread-900::INFO::2013-03-01 13:07:07,380::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-900::DEBUG::2013-03-01 13:07:07,380::task::1151::TaskManager.Task::(prepare) Task=`5f396645-2635-4df8-9692-cbb1aa98e4ef`::finished: None >Thread-900::DEBUG::2013-03-01 13:07:07,381::task::568::TaskManager.Task::(_updateState) Task=`5f396645-2635-4df8-9692-cbb1aa98e4ef`::moving from state preparing -> state finished >Thread-900::DEBUG::2013-03-01 13:07:07,381::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-900::DEBUG::2013-03-01 13:07:07,381::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-900::DEBUG::2013-03-01 13:07:07,381::task::957::TaskManager.Task::(_decref) Task=`5f396645-2635-4df8-9692-cbb1aa98e4ef`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:07,564::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:07,649::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334325 s, 30.6 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:07:09,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:07:09,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000332442 s, 12.3 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:07:09,668::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:09,752::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390977 s, 26.2 MB/s\n'; <rc> = 0 >Thread-902::DEBUG::2013-03-01 13:07:10,880::task::568::TaskManager.Task::(_updateState) Task=`8f1f9caf-aff6-4dcb-89e4-7ab5655135cf`::moving from state init -> state preparing >Thread-902::INFO::2013-03-01 13:07:10,881::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-902::INFO::2013-03-01 13:07:10,881::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102310180664', 'lastCheck': '1.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129401683807', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-902::DEBUG::2013-03-01 13:07:10,881::task::1151::TaskManager.Task::(prepare) Task=`8f1f9caf-aff6-4dcb-89e4-7ab5655135cf`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0102310180664', 'lastCheck': '1.8', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0129401683807', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-902::DEBUG::2013-03-01 13:07:10,882::task::568::TaskManager.Task::(_updateState) Task=`8f1f9caf-aff6-4dcb-89e4-7ab5655135cf`::moving from state preparing -> state finished >Thread-902::DEBUG::2013-03-01 13:07:10,882::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-902::DEBUG::2013-03-01 13:07:10,882::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-902::DEBUG::2013-03-01 13:07:10,883::task::957::TaskManager.Task::(_decref) Task=`8f1f9caf-aff6-4dcb-89e4-7ab5655135cf`::ref 0 aborting False >Thread-904::DEBUG::2013-03-01 13:07:11,023::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-904::DEBUG::2013-03-01 13:07:11,023::task::568::TaskManager.Task::(_updateState) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::moving from state init -> state preparing >Thread-904::INFO::2013-03-01 13:07:11,024::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', postZero='false', force='false') >Thread-904::INFO::2013-03-01 13:07:11,024::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-904::DEBUG::2013-03-01 13:07:11,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-904::DEBUG::2013-03-01 13:07:11,224::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-904::DEBUG::2013-03-01 13:07:11,224::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,225::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,225::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,225::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,226::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,226::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-904::DEBUG::2013-03-01 13:07:11,438::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-904::DEBUG::2013-03-01 13:07:11,439::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-904::DEBUG::2013-03-01 13:07:11,441::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e`ReqID=`8360938d-156c-4ef8-91e5-00cde9bf78d0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-904::DEBUG::2013-03-01 13:07:11,441::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' for lock type 'exclusive' >Thread-904::DEBUG::2013-03-01 13:07:11,441::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' is free. Now locking as 'exclusive' (1 active user) >Thread-904::DEBUG::2013-03-01 13:07:11,442::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e`ReqID=`8360938d-156c-4ef8-91e5-00cde9bf78d0`::Granted request >Thread-904::DEBUG::2013-03-01 13:07:11,442::task::794::TaskManager.Task::(resourceAcquired) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_resourcesAcquired: Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e (exclusive) >Thread-904::DEBUG::2013-03-01 13:07:11,442::task::957::TaskManager.Task::(_decref) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::ref 1 aborting False >Thread-904::DEBUG::2013-03-01 13:07:11,443::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5100a798-d57e-4aba-9eef-2efab7bcb8fa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-904::DEBUG::2013-03-01 13:07:11,443::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-904::DEBUG::2013-03-01 13:07:11,443::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-904::DEBUG::2013-03-01 13:07:11,443::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`5100a798-d57e-4aba-9eef-2efab7bcb8fa`::Granted request >Thread-904::DEBUG::2013-03-01 13:07:11,444::task::794::TaskManager.Task::(resourceAcquired) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-904::DEBUG::2013-03-01 13:07:11,444::task::957::TaskManager.Task::(_decref) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::ref 1 aborting False >Thread-904::DEBUG::2013-03-01 13:07:11,444::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,445::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-904::DEBUG::2013-03-01 13:07:11,636::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-904::DEBUG::2013-03-01 13:07:11,644::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,645::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/bbf96708-e473-4fa7-aa32-4a6415528e14' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:11,765::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-904::DEBUG::2013-03-01 13:07:11,842::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-904::DEBUG::2013-03-01 13:07:11,843::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,845::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-904::DEBUG::2013-03-01 13:07:11,846::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e/bbf96708-e473-4fa7-aa32-4a6415528e14'] >Thread-904::DEBUG::2013-03-01 13:07:11,847::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e >Thread-904::DEBUG::2013-03-01 13:07:11,851::task::719::TaskManager.Task::(_save) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1.temp >Thread-904::DEBUG::2013-03-01 13:07:11,871::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e for task 40f6218e-4f7d-4790-a04c-295dca7b06b1 >Thread-904::INFO::2013-03-01 13:07:11,872::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-904::DEBUG::2013-03-01 13:07:11,874::task::1146::TaskManager.Task::(prepare) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::Prepare: 1 jobs exist, move to acquiring >Thread-904::DEBUG::2013-03-01 13:07:11,875::task::568::TaskManager.Task::(_updateState) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::moving from state preparing -> state acquiring >Thread-904::DEBUG::2013-03-01 13:07:11,879::task::719::TaskManager.Task::(_save) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1.temp >Dummy-173::DEBUG::2013-03-01 13:07:11,900::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314889 s, 32.5 MB/s\n'; <rc> = 0 >Thread-904::DEBUG::2013-03-01 13:07:11,902::task::568::TaskManager.Task::(_updateState) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::moving from state acquiring -> state queued >Thread-904::DEBUG::2013-03-01 13:07:11,905::task::719::TaskManager.Task::(_save) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1.temp >Thread-904::DEBUG::2013-03-01 13:07:11,925::taskManager::50::TaskManager::(_queueTask) queuing task: 40f6218e-4f7d-4790-a04c-295dca7b06b1 >Thread-904::DEBUG::2013-03-01 13:07:11,927::taskManager::56::TaskManager::(_queueTask) task queued: 40f6218e-4f7d-4790-a04c-295dca7b06b1 >3251b1dd-9391-47e8-bc11-7dd8c169e832::DEBUG::2013-03-01 13:07:11,927::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-904::DEBUG::2013-03-01 13:07:11,930::task::1148::TaskManager.Task::(prepare) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::returning >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,931::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 40f6218e-4f7d-4790-a04c-295dca7b06b1 running: <bound method Task.commit of <storage.task.Task instance at 0x16ebb00>> with: None >Thread-904::DEBUG::2013-03-01 13:07:11,932::task::957::TaskManager.Task::(_decref) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::ref 0 aborting False >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,935::task::1159::TaskManager.Task::(commit) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::committing task: 40f6218e-4f7d-4790-a04c-295dca7b06b1 >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,939::task::568::TaskManager.Task::(_updateState) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::moving from state queued -> state running >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,943::task::719::TaskManager.Task::(_save) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1.temp >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,962::task::872::TaskManager.Task::(_runJobs) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::Task.run: running job 0: deleteImage_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e: <function <lambda> at 0x17b1578> (args: () kwargs: {}) >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,962::task::304::TaskManager.Task::(run) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::Job.run: running deleteImage_7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e: <function <lambda> at 0x17b1578> (args: () kwargs: {}) callback None >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,963::task::568::TaskManager.Task::(_updateState) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::moving from state running -> state finished >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:11,966::task::719::TaskManager.Task::(_save) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/40f6218e-4f7d-4790-a04c-295dca7b06b1.temp >Thread-905::DEBUG::2013-03-01 13:07:11,973::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-905::DEBUG::2013-03-01 13:07:11,976::task::568::TaskManager.Task::(_updateState) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::moving from state init -> state preparing >Thread-905::INFO::2013-03-01 13:07:11,979::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', imgUUID='e7934077-6752-4445-a00a-1f2551119ade', postZero='false', force='false') >Thread-905::INFO::2013-03-01 13:07:11,981::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-905::DEBUG::2013-03-01 13:07:11,988::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,006::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e': < ResourceRef 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', isValid: 'True' obj: 'None'>} >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,007::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,009::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,010::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,011::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,012::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,014::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,015::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' (0 active users) >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,016::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e' is free, finding out if anyone is waiting for it. >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,017::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7bcd1e19-7db8-4846-b7aa-2d509a5d5f3e', Clearing records. >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,018::task::880::TaskManager.Task::(_runJobs) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::Task.run: exit - success: result True >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,019::task::957::TaskManager.Task::(_decref) Task=`40f6218e-4f7d-4790-a04c-295dca7b06b1`::ref 0 aborting False >40f6218e-4f7d-4790-a04c-295dca7b06b1::DEBUG::2013-03-01 13:07:12,020::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-905::DEBUG::2013-03-01 13:07:12,183::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-905::DEBUG::2013-03-01 13:07:12,183::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,184::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,184::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,184::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,185::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,186::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-905::DEBUG::2013-03-01 13:07:12,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-905::DEBUG::2013-03-01 13:07:12,533::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,533::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-905::DEBUG::2013-03-01 13:07:12,535::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`ae0e2156-39d2-448a-a2c5-7c97b431ae12`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-905::DEBUG::2013-03-01 13:07:12,535::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.e7934077-6752-4445-a00a-1f2551119ade' for lock type 'exclusive' >Thread-905::DEBUG::2013-03-01 13:07:12,536::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.e7934077-6752-4445-a00a-1f2551119ade' is free. Now locking as 'exclusive' (1 active user) >Thread-905::DEBUG::2013-03-01 13:07:12,536::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.e7934077-6752-4445-a00a-1f2551119ade`ReqID=`ae0e2156-39d2-448a-a2c5-7c97b431ae12`::Granted request >Thread-905::DEBUG::2013-03-01 13:07:12,537::task::794::TaskManager.Task::(resourceAcquired) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_resourcesAcquired: Storage.e7934077-6752-4445-a00a-1f2551119ade (exclusive) >Thread-905::DEBUG::2013-03-01 13:07:12,537::task::957::TaskManager.Task::(_decref) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::ref 1 aborting False >Thread-905::DEBUG::2013-03-01 13:07:12,537::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`c1e8d8b5-9349-4b2c-b70d-d0435180bd96`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-905::DEBUG::2013-03-01 13:07:12,538::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'shared' >Thread-905::DEBUG::2013-03-01 13:07:12,538::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'shared' (1 active user) >Thread-905::DEBUG::2013-03-01 13:07:12,538::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`c1e8d8b5-9349-4b2c-b70d-d0435180bd96`::Granted request >Thread-905::DEBUG::2013-03-01 13:07:12,539::task::794::TaskManager.Task::(resourceAcquired) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (shared) >Thread-905::DEBUG::2013-03-01 13:07:12,539::task::957::TaskManager.Task::(_decref) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::ref 1 aborting False >Thread-905::DEBUG::2013-03-01 13:07:12,540::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:12,541::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-905::DEBUG::2013-03-01 13:07:12,786::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-905::DEBUG::2013-03-01 13:07:12,796::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-905::WARNING::2013-03-01 13:07:12,798::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 >Thread-905::WARNING::2013-03-01 13:07:12,798::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97 >Thread-905::DEBUG::2013-03-01 13:07:12,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/641da936-3f96-4831-a341-cd57756ebef7 a558fc2a-a4a3-4118-9b81-d1d601eaa295/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97' (cwd None) >Thread-905::DEBUG::2013-03-01 13:07:13,100::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-905::DEBUG::2013-03-01 13:07:13,101::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:13,101::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:13,102::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:13,102::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-905::DEBUG::2013-03-01 13:07:13,102::blockSD::936::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade/07ba2dc6-c359-4ffe-92d0-dd6ea1ef2f97'] >Thread-905::DEBUG::2013-03-01 13:07:13,102::blockSD::947::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images/e7934077-6752-4445-a00a-1f2551119ade >Thread-905::DEBUG::2013-03-01 13:07:13,104::task::719::TaskManager.Task::(_save) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300.temp >Thread-905::DEBUG::2013-03-01 13:07:13,109::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_e7934077-6752-4445-a00a-1f2551119ade for task 0aebe01b-7949-4f4d-9c0e-b831b2641300 >Thread-905::INFO::2013-03-01 13:07:13,109::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-905::DEBUG::2013-03-01 13:07:13,109::task::1146::TaskManager.Task::(prepare) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::Prepare: 1 jobs exist, move to acquiring >Thread-905::DEBUG::2013-03-01 13:07:13,110::task::568::TaskManager.Task::(_updateState) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::moving from state preparing -> state acquiring >Thread-905::DEBUG::2013-03-01 13:07:13,110::task::719::TaskManager.Task::(_save) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300.temp >Thread-905::DEBUG::2013-03-01 13:07:13,115::task::568::TaskManager.Task::(_updateState) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::moving from state acquiring -> state queued >Thread-905::DEBUG::2013-03-01 13:07:13,116::task::719::TaskManager.Task::(_save) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300.temp >Thread-905::DEBUG::2013-03-01 13:07:13,123::taskManager::50::TaskManager::(_queueTask) queuing task: 0aebe01b-7949-4f4d-9c0e-b831b2641300 >1c8c5fed-d2d3-4795-b127-447367c2cf9b::DEBUG::2013-03-01 13:07:13,124::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-905::DEBUG::2013-03-01 13:07:13,124::taskManager::56::TaskManager::(_queueTask) task queued: 0aebe01b-7949-4f4d-9c0e-b831b2641300 >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,126::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 0aebe01b-7949-4f4d-9c0e-b831b2641300 running: <bound method Task.commit of <storage.task.Task instance at 0x16edcb0>> with: None >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,127::task::1159::TaskManager.Task::(commit) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::committing task: 0aebe01b-7949-4f4d-9c0e-b831b2641300 >Thread-905::DEBUG::2013-03-01 13:07:13,127::task::1148::TaskManager.Task::(prepare) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::returning >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,129::task::568::TaskManager.Task::(_updateState) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::moving from state queued -> state running >Thread-905::DEBUG::2013-03-01 13:07:13,130::task::957::TaskManager.Task::(_decref) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::ref 1 aborting False >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,134::task::719::TaskManager.Task::(_save) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300.temp >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,145::task::872::TaskManager.Task::(_runJobs) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::Task.run: running job 0: deleteImage_e7934077-6752-4445-a00a-1f2551119ade: <function <lambda> at 0x7f15c0276d70> (args: () kwargs: {}) >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,145::task::304::TaskManager.Task::(run) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::Job.run: running deleteImage_e7934077-6752-4445-a00a-1f2551119ade: <function <lambda> at 0x7f15c0276d70> (args: () kwargs: {}) callback None >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,145::task::568::TaskManager.Task::(_updateState) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::moving from state running -> state finished >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,146::task::719::TaskManager.Task::(_save) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::_save: orig /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300 temp /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/master/tasks/0aebe01b-7949-4f4d-9c0e-b831b2641300.temp >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,154::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.e7934077-6752-4445-a00a-1f2551119ade': < ResourceRef 'Storage.e7934077-6752-4445-a00a-1f2551119ade', isValid: 'True' obj: 'None'>} >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,154::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,155::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,155::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,155::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,155::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,156::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.e7934077-6752-4445-a00a-1f2551119ade' >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,156::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.e7934077-6752-4445-a00a-1f2551119ade' (0 active users) >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,157::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.e7934077-6752-4445-a00a-1f2551119ade' is free, finding out if anyone is waiting for it. >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,157::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e7934077-6752-4445-a00a-1f2551119ade', Clearing records. >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,157::task::880::TaskManager.Task::(_runJobs) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::Task.run: exit - success: result True >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,157::task::957::TaskManager.Task::(_decref) Task=`0aebe01b-7949-4f4d-9c0e-b831b2641300`::ref 0 aborting False >0aebe01b-7949-4f4d-9c0e-b831b2641300::DEBUG::2013-03-01 13:07:13,158::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-173::DEBUG::2013-03-01 13:07:14,026::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:14,139::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468545 s, 21.9 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:15,236::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:07:15,237::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-907::DEBUG::2013-03-01 13:07:15,522::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-907::DEBUG::2013-03-01 13:07:15,569::task::568::TaskManager.Task::(_updateState) Task=`c5f4883a-4252-4fcf-9ee2-f6640e161969`::moving from state init -> state preparing >Thread-907::INFO::2013-03-01 13:07:15,569::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-907::INFO::2013-03-01 13:07:15,570::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-907::DEBUG::2013-03-01 13:07:15,570::task::1151::TaskManager.Task::(prepare) Task=`c5f4883a-4252-4fcf-9ee2-f6640e161969`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-907::DEBUG::2013-03-01 13:07:15,570::task::568::TaskManager.Task::(_updateState) Task=`c5f4883a-4252-4fcf-9ee2-f6640e161969`::moving from state preparing -> state finished >Thread-907::DEBUG::2013-03-01 13:07:15,570::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-907::DEBUG::2013-03-01 13:07:15,571::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-907::DEBUG::2013-03-01 13:07:15,571::task::957::TaskManager.Task::(_decref) Task=`c5f4883a-4252-4fcf-9ee2-f6640e161969`::ref 0 aborting False >Thread-908::DEBUG::2013-03-01 13:07:15,595::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-908::DEBUG::2013-03-01 13:07:15,596::task::568::TaskManager.Task::(_updateState) Task=`c1f9228a-3f80-4978-a55f-40f349312cab`::moving from state init -> state preparing >Thread-908::INFO::2013-03-01 13:07:15,596::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-908::DEBUG::2013-03-01 13:07:15,597::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`987b480e-fe85-4f28-9374-2d0726c78d76`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-908::DEBUG::2013-03-01 13:07:15,597::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-908::DEBUG::2013-03-01 13:07:15,597::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-908::DEBUG::2013-03-01 13:07:15,598::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`987b480e-fe85-4f28-9374-2d0726c78d76`::Granted request >Thread-908::DEBUG::2013-03-01 13:07:15,598::task::794::TaskManager.Task::(resourceAcquired) Task=`c1f9228a-3f80-4978-a55f-40f349312cab`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-908::DEBUG::2013-03-01 13:07:15,598::task::957::TaskManager.Task::(_decref) Task=`c1f9228a-3f80-4978-a55f-40f349312cab`::ref 1 aborting False >Thread-908::DEBUG::2013-03-01 13:07:15,599::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-908::DEBUG::2013-03-01 13:07:15,600::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:15,613::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:15,616::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:15,628::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000347307 s, 11.8 MB/s\n'; <rc> = 0 >Thread-908::DEBUG::2013-03-01 13:07:15,843::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-908::DEBUG::2013-03-01 13:07:15,845::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-908::INFO::2013-03-01 13:07:15,846::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-908::DEBUG::2013-03-01 13:07:15,846::task::1151::TaskManager.Task::(prepare) Task=`c1f9228a-3f80-4978-a55f-40f349312cab`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Active,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-908::DEBUG::2013-03-01 13:07:15,847::task::568::TaskManager.Task::(_updateState) Task=`c1f9228a-3f80-4978-a55f-40f349312cab`::moving from state preparing -> state finished >Thread-908::DEBUG::2013-03-01 13:07:15,847::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-908::DEBUG::2013-03-01 13:07:15,847::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-908::DEBUG::2013-03-01 13:07:15,848::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-908::DEBUG::2013-03-01 13:07:15,848::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-908::DEBUG::2013-03-01 13:07:15,848::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-908::DEBUG::2013-03-01 13:07:15,848::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-908::DEBUG::2013-03-01 13:07:15,849::task::957::TaskManager.Task::(_decref) Task=`c1f9228a-3f80-4978-a55f-40f349312cab`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:16,158::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:16,269::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463424 s, 22.1 MB/s\n'; <rc> = 0 >Thread-910::DEBUG::2013-03-01 13:07:17,303::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-910::DEBUG::2013-03-01 13:07:17,304::task::568::TaskManager.Task::(_updateState) Task=`f990c7dc-c532-4b04-8bb6-74f3207eb0ad`::moving from state init -> state preparing >Thread-910::INFO::2013-03-01 13:07:17,304::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-910::DEBUG::2013-03-01 13:07:17,305::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-910::DEBUG::2013-03-01 13:07:17,305::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 0aebe01b-7949-4f4d-9c0e-b831b2641300 >Thread-910::DEBUG::2013-03-01 13:07:17,305::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0aebe01b-7949-4f4d-9c0e-b831b2641300'} >Thread-910::DEBUG::2013-03-01 13:07:17,305::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 40f6218e-4f7d-4790-a04c-295dca7b06b1 >Thread-910::DEBUG::2013-03-01 13:07:17,306::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '40f6218e-4f7d-4790-a04c-295dca7b06b1'} >Thread-910::DEBUG::2013-03-01 13:07:17,306::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'0aebe01b-7949-4f4d-9c0e-b831b2641300': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0aebe01b-7949-4f4d-9c0e-b831b2641300'}, '40f6218e-4f7d-4790-a04c-295dca7b06b1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '40f6218e-4f7d-4790-a04c-295dca7b06b1'}} >Thread-910::INFO::2013-03-01 13:07:17,306::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'0aebe01b-7949-4f4d-9c0e-b831b2641300': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0aebe01b-7949-4f4d-9c0e-b831b2641300'}, '40f6218e-4f7d-4790-a04c-295dca7b06b1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '40f6218e-4f7d-4790-a04c-295dca7b06b1'}}} >Thread-910::DEBUG::2013-03-01 13:07:17,307::task::1151::TaskManager.Task::(prepare) Task=`f990c7dc-c532-4b04-8bb6-74f3207eb0ad`::finished: {'allTasksStatus': {'0aebe01b-7949-4f4d-9c0e-b831b2641300': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0aebe01b-7949-4f4d-9c0e-b831b2641300'}, '40f6218e-4f7d-4790-a04c-295dca7b06b1': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '40f6218e-4f7d-4790-a04c-295dca7b06b1'}}} >Thread-910::DEBUG::2013-03-01 13:07:17,307::task::568::TaskManager.Task::(_updateState) Task=`f990c7dc-c532-4b04-8bb6-74f3207eb0ad`::moving from state preparing -> state finished >Thread-910::DEBUG::2013-03-01 13:07:17,307::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-910::DEBUG::2013-03-01 13:07:17,307::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-910::DEBUG::2013-03-01 13:07:17,308::task::957::TaskManager.Task::(_decref) Task=`f990c7dc-c532-4b04-8bb6-74f3207eb0ad`::ref 0 aborting False >Thread-911::DEBUG::2013-03-01 13:07:17,400::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-911::DEBUG::2013-03-01 13:07:17,401::task::568::TaskManager.Task::(_updateState) Task=`833b7ae6-929b-43e3-8cfc-be6f13e0cba3`::moving from state init -> state preparing >Thread-911::INFO::2013-03-01 13:07:17,401::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='40f6218e-4f7d-4790-a04c-295dca7b06b1', spUUID=None, options=None) >Thread-911::DEBUG::2013-03-01 13:07:17,401::taskManager::161::TaskManager::(clearTask) Entry. taskID: 40f6218e-4f7d-4790-a04c-295dca7b06b1 >Thread-911::DEBUG::2013-03-01 13:07:17,403::taskManager::166::TaskManager::(clearTask) Return. >Thread-911::INFO::2013-03-01 13:07:17,403::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-911::DEBUG::2013-03-01 13:07:17,403::task::1151::TaskManager.Task::(prepare) Task=`833b7ae6-929b-43e3-8cfc-be6f13e0cba3`::finished: None >Thread-911::DEBUG::2013-03-01 13:07:17,404::task::568::TaskManager.Task::(_updateState) Task=`833b7ae6-929b-43e3-8cfc-be6f13e0cba3`::moving from state preparing -> state finished >Thread-911::DEBUG::2013-03-01 13:07:17,404::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-911::DEBUG::2013-03-01 13:07:17,404::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-911::DEBUG::2013-03-01 13:07:17,404::task::957::TaskManager.Task::(_decref) Task=`833b7ae6-929b-43e3-8cfc-be6f13e0cba3`::ref 0 aborting False >Thread-912::DEBUG::2013-03-01 13:07:17,432::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-912::DEBUG::2013-03-01 13:07:17,433::task::568::TaskManager.Task::(_updateState) Task=`4292e299-264f-4f1d-b96b-2c8f429ffaf6`::moving from state init -> state preparing >Thread-912::INFO::2013-03-01 13:07:17,433::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='0aebe01b-7949-4f4d-9c0e-b831b2641300', spUUID=None, options=None) >Thread-912::DEBUG::2013-03-01 13:07:17,433::taskManager::161::TaskManager::(clearTask) Entry. taskID: 0aebe01b-7949-4f4d-9c0e-b831b2641300 >Thread-912::DEBUG::2013-03-01 13:07:17,434::taskManager::166::TaskManager::(clearTask) Return. >Thread-912::INFO::2013-03-01 13:07:17,434::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-912::DEBUG::2013-03-01 13:07:17,435::task::1151::TaskManager.Task::(prepare) Task=`4292e299-264f-4f1d-b96b-2c8f429ffaf6`::finished: None >Thread-912::DEBUG::2013-03-01 13:07:17,435::task::568::TaskManager.Task::(_updateState) Task=`4292e299-264f-4f1d-b96b-2c8f429ffaf6`::moving from state preparing -> state finished >Thread-912::DEBUG::2013-03-01 13:07:17,435::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-912::DEBUG::2013-03-01 13:07:17,435::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-912::DEBUG::2013-03-01 13:07:17,436::task::957::TaskManager.Task::(_decref) Task=`4292e299-264f-4f1d-b96b-2c8f429ffaf6`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:18,289::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:18,378::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442263 s, 23.2 MB/s\n'; <rc> = 0 >Thread-255::DEBUG::2013-03-01 13:07:19,045::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata bs=4096 count=1' (cwd None) >Thread-255::DEBUG::2013-03-01 13:07:19,058::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00457713 s, 895 kB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:07:20,392::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:20,494::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448292 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:07:22,508::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:22,612::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399974 s, 25.6 MB/s\n'; <rc> = 0 >Thread-915::DEBUG::2013-03-01 13:07:24,131::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-915::DEBUG::2013-03-01 13:07:24,132::task::568::TaskManager.Task::(_updateState) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::moving from state init -> state preparing >Thread-915::INFO::2013-03-01 13:07:24,133::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-915::DEBUG::2013-03-01 13:07:24,134::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`55367148-c680-40a1-ac07-1d09729a3fc4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-915::DEBUG::2013-03-01 13:07:24,134::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-915::DEBUG::2013-03-01 13:07:24,134::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-915::DEBUG::2013-03-01 13:07:24,135::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`55367148-c680-40a1-ac07-1d09729a3fc4`::Granted request >Thread-915::DEBUG::2013-03-01 13:07:24,135::task::794::TaskManager.Task::(resourceAcquired) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-915::DEBUG::2013-03-01 13:07:24,135::task::957::TaskManager.Task::(_decref) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::ref 1 aborting False >Thread-915::DEBUG::2013-03-01 13:07:24,136::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`635577f9-799e-4f7d-9856-deb0ae459ae1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-915::DEBUG::2013-03-01 13:07:24,136::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' for lock type 'exclusive' >Thread-915::DEBUG::2013-03-01 13:07:24,137::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free. Now locking as 'exclusive' (1 active user) >Thread-915::DEBUG::2013-03-01 13:07:24,137::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`635577f9-799e-4f7d-9856-deb0ae459ae1`::Granted request >Thread-915::DEBUG::2013-03-01 13:07:24,138::task::794::TaskManager.Task::(resourceAcquired) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::_resourcesAcquired: Storage.4b95f32d-26ca-467b-96e6-692c57bcface (exclusive) >Thread-915::DEBUG::2013-03-01 13:07:24,138::task::957::TaskManager.Task::(_decref) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::ref 1 aborting False >Thread-915::INFO::2013-03-01 13:07:24,138::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=4b95f32d-26ca-467b-96e6-692c57bcface spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-915::DEBUG::2013-03-01 13:07:24,142::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-915::DEBUG::2013-03-01 13:07:24,142::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-915::DEBUG::2013-03-01 13:07:24,143::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972'] >Thread-915::DEBUG::2013-03-01 13:07:24,143::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,144::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,144::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,144::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,145::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,146::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-915::DEBUG::2013-03-01 13:07:24,389::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-915::DEBUG::2013-03-01 13:07:24,390::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,391::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 removing=MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b >Thread-915::DEBUG::2013-03-01 13:07:24,392::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=8e66cda5e47bfcb6c24c7fe631d6514460f8653b --deltag MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Active&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active --addtag MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 --addtag MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:24,632::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:24,727::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370161 s, 27.7 MB/s\n'; <rc> = 0 >Thread-915::DEBUG::2013-03-01 13:07:24,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-915::DEBUG::2013-03-01 13:07:24,763::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,763::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-915::DEBUG::2013-03-01 13:07:24,764::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-915::DEBUG::2013-03-01 13:07:24,764::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-915::DEBUG::2013-03-01 13:07:24,764::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-255::DEBUG::2013-03-01 13:07:24,765::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 4b95f32d-26ca-467b-96e6-692c57bcface >Thread-255::INFO::2013-03-01 13:07:24,765::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface (id: 1) >Thread-105::DEBUG::2013-03-01 13:07:25,634::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:07:25,635::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:25,878::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:25,880::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:07:25,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:25,893::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319122 s, 12.8 MB/s\n'; <rc> = 0 >Thread-916::DEBUG::2013-03-01 13:07:26,162::task::568::TaskManager.Task::(_updateState) Task=`04498466-676e-4a99-868a-23f28b9e6993`::moving from state init -> state preparing >Thread-916::INFO::2013-03-01 13:07:26,162::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-916::INFO::2013-03-01 13:07:26,163::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0147271156311', 'lastCheck': '7.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0130710601807', 'lastCheck': '0.3', 'code': 0, 'valid': True}} >Thread-916::DEBUG::2013-03-01 13:07:26,163::task::1151::TaskManager.Task::(prepare) Task=`04498466-676e-4a99-868a-23f28b9e6993`::finished: {'4b95f32d-26ca-467b-96e6-692c57bcface': {'delay': '0.0147271156311', 'lastCheck': '7.1', 'code': 0, 'valid': True}, 'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0130710601807', 'lastCheck': '0.3', 'code': 0, 'valid': True}} >Thread-916::DEBUG::2013-03-01 13:07:26,163::task::568::TaskManager.Task::(_updateState) Task=`04498466-676e-4a99-868a-23f28b9e6993`::moving from state preparing -> state finished >Thread-916::DEBUG::2013-03-01 13:07:26,163::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-916::DEBUG::2013-03-01 13:07:26,164::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-916::DEBUG::2013-03-01 13:07:26,164::task::957::TaskManager.Task::(_decref) Task=`04498466-676e-4a99-868a-23f28b9e6993`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:26,743::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-255::DEBUG::2013-03-01 13:07:26,767::clusterlock::206::SANLock::(releaseHostId) Host id for domain 4b95f32d-26ca-467b-96e6-692c57bcface released successfully (id: 1) >Thread-915::DEBUG::2013-03-01 13:07:26,769::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `41b11cc6-b020-47d9-b70e-c4fadcc621be` stopped monitoring domain `4b95f32d-26ca-467b-96e6-692c57bcface` >Thread-915::DEBUG::2013-03-01 13:07:26,770::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-915::INFO::2013-03-01 13:07:26,771::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-915::DEBUG::2013-03-01 13:07:26,773::task::1151::TaskManager.Task::(prepare) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::finished: None >Thread-915::DEBUG::2013-03-01 13:07:26,775::task::568::TaskManager.Task::(_updateState) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::moving from state preparing -> state finished >Thread-915::DEBUG::2013-03-01 13:07:26,777::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4b95f32d-26ca-467b-96e6-692c57bcface': < ResourceRef 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-915::DEBUG::2013-03-01 13:07:26,778::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-915::DEBUG::2013-03-01 13:07:26,781::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' >Thread-915::DEBUG::2013-03-01 13:07:26,783::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' (0 active users) >Thread-915::DEBUG::2013-03-01 13:07:26,784::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free, finding out if anyone is waiting for it. >Thread-915::DEBUG::2013-03-01 13:07:26,785::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', Clearing records. >Thread-915::DEBUG::2013-03-01 13:07:26,788::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-915::DEBUG::2013-03-01 13:07:26,790::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-915::DEBUG::2013-03-01 13:07:26,791::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-915::DEBUG::2013-03-01 13:07:26,792::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-915::DEBUG::2013-03-01 13:07:26,795::task::957::TaskManager.Task::(_decref) Task=`5eceb978-6920-46e8-b32b-e63fa9343daf`::ref 0 aborting False >Thread-918::DEBUG::2013-03-01 13:07:26,828::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-918::DEBUG::2013-03-01 13:07:26,832::task::568::TaskManager.Task::(_updateState) Task=`26775fbd-1687-455f-a879-f154b4ffe0ba`::moving from state init -> state preparing >Thread-918::INFO::2013-03-01 13:07:26,835::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-918::INFO::2013-03-01 13:07:26,838::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-918::DEBUG::2013-03-01 13:07:26,841::task::1151::TaskManager.Task::(prepare) Task=`26775fbd-1687-455f-a879-f154b4ffe0ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-918::DEBUG::2013-03-01 13:07:26,843::task::568::TaskManager.Task::(_updateState) Task=`26775fbd-1687-455f-a879-f154b4ffe0ba`::moving from state preparing -> state finished >Thread-918::DEBUG::2013-03-01 13:07:26,846::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-918::DEBUG::2013-03-01 13:07:26,849::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-919::DEBUG::2013-03-01 13:07:26,849::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-919::DEBUG::2013-03-01 13:07:26,854::task::568::TaskManager.Task::(_updateState) Task=`e2aded37-aa10-4d28-9ead-405013b2e63a`::moving from state init -> state preparing >Thread-918::DEBUG::2013-03-01 13:07:26,854::task::957::TaskManager.Task::(_decref) Task=`26775fbd-1687-455f-a879-f154b4ffe0ba`::ref 0 aborting False >Thread-919::INFO::2013-03-01 13:07:26,858::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', masterVersion=1, options=None) >Thread-919::DEBUG::2013-03-01 13:07:26,864::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f6530526-e39c-4c73-8804-e82479d46031`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-919::DEBUG::2013-03-01 13:07:26,867::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-919::DEBUG::2013-03-01 13:07:26,871::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-919::DEBUG::2013-03-01 13:07:26,873::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`f6530526-e39c-4c73-8804-e82479d46031`::Granted request >Thread-919::DEBUG::2013-03-01 13:07:26,878::task::794::TaskManager.Task::(resourceAcquired) Task=`e2aded37-aa10-4d28-9ead-405013b2e63a`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-919::DEBUG::2013-03-01 13:07:26,881::task::957::TaskManager.Task::(_decref) Task=`e2aded37-aa10-4d28-9ead-405013b2e63a`::ref 1 aborting False >Thread-919::INFO::2013-03-01 13:07:26,883::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-919::DEBUG::2013-03-01 13:07:26,892::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-920::DEBUG::2013-03-01 13:07:26,906::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-920::DEBUG::2013-03-01 13:07:26,909::task::568::TaskManager.Task::(_updateState) Task=`230d7f4e-c85d-45db-9ba0-6a8c98395597`::moving from state init -> state preparing >Thread-920::INFO::2013-03-01 13:07:26,911::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-920::DEBUG::2013-03-01 13:07:26,914::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2a8f58d4-9040-405d-8030-b8c417177ca4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-920::DEBUG::2013-03-01 13:07:26,916::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-920::DEBUG::2013-03-01 13:07:26,919::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-920::DEBUG::2013-03-01 13:07:26,920::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2a8f58d4-9040-405d-8030-b8c417177ca4`::Granted request >Thread-920::DEBUG::2013-03-01 13:07:26,923::task::794::TaskManager.Task::(resourceAcquired) Task=`230d7f4e-c85d-45db-9ba0-6a8c98395597`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-920::DEBUG::2013-03-01 13:07:26,925::task::957::TaskManager.Task::(_decref) Task=`230d7f4e-c85d-45db-9ba0-6a8c98395597`::ref 1 aborting False >Thread-920::INFO::2013-03-01 13:07:26,932::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Attached'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-920::DEBUG::2013-03-01 13:07:26,933::task::1151::TaskManager.Task::(prepare) Task=`230d7f4e-c85d-45db-9ba0-6a8c98395597`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Attached'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-920::DEBUG::2013-03-01 13:07:26,935::task::568::TaskManager.Task::(_updateState) Task=`230d7f4e-c85d-45db-9ba0-6a8c98395597`::moving from state preparing -> state finished >Thread-920::DEBUG::2013-03-01 13:07:26,936::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-920::DEBUG::2013-03-01 13:07:26,937::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-920::DEBUG::2013-03-01 13:07:26,939::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-920::DEBUG::2013-03-01 13:07:26,941::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (1 active users) >Thread-920::DEBUG::2013-03-01 13:07:26,942::task::957::TaskManager.Task::(_decref) Task=`230d7f4e-c85d-45db-9ba0-6a8c98395597`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:26,980::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.157875 s, 6.5 MB/s\n'; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:27,083::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:27,084::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:27,084::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:27,085::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:27,085::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:27,085::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:27,086::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-919::DEBUG::2013-03-01 13:07:28,437::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:28,466::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,473::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-919::DEBUG::2013-03-01 13:07:28,488::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,492::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,496::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,500::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,504::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,508::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:28,514::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-919::DEBUG::2013-03-01 13:07:28,517::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-919::DEBUG::2013-03-01 13:07:28,520::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-919::DEBUG::2013-03-01 13:07:28,523::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-919::DEBUG::2013-03-01 13:07:28,528::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-919::DEBUG::2013-03-01 13:07:28,865::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:28,878::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:28,933::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:28,997::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:29,744::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.548795 s, 1.9 MB/s\n'; <rc> = 0 >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:29,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:29,987::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:29,990::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:29,993::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:30,997::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:31,000::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-919::DEBUG::2013-03-01 13:07:31,003::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:07:31,757::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:31,854::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410811 s, 24.9 MB/s\n'; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:33,007::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:33,873::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:33,957::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364479 s, 28.1 MB/s\n'; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:35,669::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:35,670::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,670::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,670::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,671::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,671::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,671::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,672::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-919::DEBUG::2013-03-01 13:07:35,672::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,676::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-919::DEBUG::2013-03-01 13:07:35,921::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:35,923::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,923::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-919::DEBUG::2013-03-01 13:07:35,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-919::DEBUG::2013-03-01 13:07:35,934::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000348564 s, 5.9 MB/s\n'; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:35,934::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000348564 s, 5.9 MB/s'], size: 2048 >Thread-919::DEBUG::2013-03-01 13:07:35,935::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-919::WARNING::2013-03-01 13:07:35,935::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-919::DEBUG::2013-03-01 13:07:35,935::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-919::DEBUG::2013-03-01 13:07:35,936::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,936::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,937::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,937::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,937::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:35,938::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:35,971::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:36,063::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387298 s, 26.4 MB/s\n'; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:36,141::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:36,143::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:36,143::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972', u'POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-919::DEBUG::2013-03-01 13:07:36,144::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:36,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-919::DEBUG::2013-03-01 13:07:36,388::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:36,389::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-919::WARNING::2013-03-01 13:07:36,389::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-919::WARNING::2013-03-01 13:07:36,389::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-919::WARNING::2013-03-01 13:07:36,390::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-919::DEBUG::2013-03-01 13:07:36,392::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-919::DEBUG::2013-03-01 13:07:36,393::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-919::DEBUG::2013-03-01 13:07:36,394::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-105::DEBUG::2013-03-01 13:07:36,395::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-919::DEBUG::2013-03-01 13:07:36,396::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-919::WARNING::2013-03-01 13:07:36,406::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be already exists >Thread-919::DEBUG::2013-03-01 13:07:36,407::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-919::DEBUG::2013-03-01 13:07:36,408::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:36,640::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:36,641::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:36,653::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000239804 s, 17.1 MB/s\n'; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:36,661::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-919::DEBUG::2013-03-01 13:07:36,663::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-919::WARNING::2013-03-01 13:07:36,718::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-919::WARNING::2013-03-01 13:07:36,718::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-919::INFO::2013-03-01 13:07:36,719::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-919::INFO::2013-03-01 13:07:36,719::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd >Thread-919::INFO::2013-03-01 13:07:36,720::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-919::DEBUG::2013-03-01 13:07:36,720::task::1151::TaskManager.Task::(prepare) Task=`e2aded37-aa10-4d28-9ead-405013b2e63a`::finished: None >Thread-919::DEBUG::2013-03-01 13:07:36,721::task::568::TaskManager.Task::(_updateState) Task=`e2aded37-aa10-4d28-9ead-405013b2e63a`::moving from state preparing -> state finished >Thread-919::DEBUG::2013-03-01 13:07:36,721::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-919::DEBUG::2013-03-01 13:07:36,721::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-919::DEBUG::2013-03-01 13:07:36,722::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-919::DEBUG::2013-03-01 13:07:36,722::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-919::DEBUG::2013-03-01 13:07:36,722::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-919::DEBUG::2013-03-01 13:07:36,723::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-919::DEBUG::2013-03-01 13:07:36,723::task::957::TaskManager.Task::(_decref) Task=`e2aded37-aa10-4d28-9ead-405013b2e63a`::ref 0 aborting False >Thread-947::DEBUG::2013-03-01 13:07:36,791::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-947::DEBUG::2013-03-01 13:07:36,792::task::568::TaskManager.Task::(_updateState) Task=`293d693d-0b62-4454-bd99-2b363b364e2f`::moving from state init -> state preparing >Thread-947::INFO::2013-03-01 13:07:36,792::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[], options=None) >Thread-947::DEBUG::2013-03-01 13:07:36,793::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-947::DEBUG::2013-03-01 13:07:36,793::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-947::DEBUG::2013-03-01 13:07:36,793::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-947::DEBUG::2013-03-01 13:07:36,793::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-947::DEBUG::2013-03-01 13:07:36,794::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-947::DEBUG::2013-03-01 13:07:36,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-947::DEBUG::2013-03-01 13:07:36,820::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:36,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-948::DEBUG::2013-03-01 13:07:36,985::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-948::DEBUG::2013-03-01 13:07:36,985::task::568::TaskManager.Task::(_updateState) Task=`c137d64d-6dd6-4992-8368-e2b15eac61aa`::moving from state init -> state preparing >Thread-948::INFO::2013-03-01 13:07:36,986::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-948::INFO::2013-03-01 13:07:36,986::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-948::DEBUG::2013-03-01 13:07:36,987::task::1151::TaskManager.Task::(prepare) Task=`c137d64d-6dd6-4992-8368-e2b15eac61aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-948::DEBUG::2013-03-01 13:07:36,987::task::568::TaskManager.Task::(_updateState) Task=`c137d64d-6dd6-4992-8368-e2b15eac61aa`::moving from state preparing -> state finished >Thread-948::DEBUG::2013-03-01 13:07:36,987::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-948::DEBUG::2013-03-01 13:07:36,988::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-948::DEBUG::2013-03-01 13:07:36,988::task::957::TaskManager.Task::(_decref) Task=`c137d64d-6dd6-4992-8368-e2b15eac61aa`::ref 0 aborting False >Thread-949::DEBUG::2013-03-01 13:07:37,014::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-949::DEBUG::2013-03-01 13:07:37,014::task::568::TaskManager.Task::(_updateState) Task=`e4bfbab5-f232-4463-9224-a045dcb7df1f`::moving from state init -> state preparing >Thread-949::INFO::2013-03-01 13:07:37,015::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-949::DEBUG::2013-03-01 13:07:37,015::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`229d6f41-a537-4dd6-a547-f6ebb6b7ac72`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-949::DEBUG::2013-03-01 13:07:37,016::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-949::DEBUG::2013-03-01 13:07:37,016::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-949::DEBUG::2013-03-01 13:07:37,016::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`229d6f41-a537-4dd6-a547-f6ebb6b7ac72`::Granted request >Thread-949::DEBUG::2013-03-01 13:07:37,017::task::794::TaskManager.Task::(resourceAcquired) Task=`e4bfbab5-f232-4463-9224-a045dcb7df1f`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-949::DEBUG::2013-03-01 13:07:37,017::task::957::TaskManager.Task::(_decref) Task=`e4bfbab5-f232-4463-9224-a045dcb7df1f`::ref 1 aborting False >Thread-949::INFO::2013-03-01 13:07:37,019::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Attached'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-949::DEBUG::2013-03-01 13:07:37,019::task::1151::TaskManager.Task::(prepare) Task=`e4bfbab5-f232-4463-9224-a045dcb7df1f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': u'4b95f32d-26ca-467b-96e6-692c57bcface:Attached,a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'4b95f32d-26ca-467b-96e6-692c57bcface': {'status': u'Attached'}, u'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-949::DEBUG::2013-03-01 13:07:37,020::task::568::TaskManager.Task::(_updateState) Task=`e4bfbab5-f232-4463-9224-a045dcb7df1f`::moving from state preparing -> state finished >Thread-949::DEBUG::2013-03-01 13:07:37,020::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-949::DEBUG::2013-03-01 13:07:37,020::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-949::DEBUG::2013-03-01 13:07:37,021::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-949::DEBUG::2013-03-01 13:07:37,021::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-949::DEBUG::2013-03-01 13:07:37,021::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-949::DEBUG::2013-03-01 13:07:37,021::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-949::DEBUG::2013-03-01 13:07:37,022::task::957::TaskManager.Task::(_decref) Task=`e4bfbab5-f232-4463-9224-a045dcb7df1f`::ref 0 aborting False >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:37,827::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:38,077::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:38,271::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497077 s, 20.6 MB/s\n'; <rc> = 0 >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:38,838::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:38,897::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:38,927::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:38,955::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:38,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-947::DEBUG::2013-03-01 13:07:39,016::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:07:40,324::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:40,857::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.319939 s, 3.2 MB/s\n'; <rc> = 0 >Thread-947::DEBUG::2013-03-01 13:07:41,023::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-951::DEBUG::2013-03-01 13:07:41,671::task::568::TaskManager.Task::(_updateState) Task=`247b1a2e-cec4-4be6-ac17-977357e52978`::moving from state init -> state preparing >Thread-951::INFO::2013-03-01 13:07:41,672::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-951::INFO::2013-03-01 13:07:41,672::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0121259689331', 'lastCheck': '5.0', 'code': 0, 'valid': True}} >Thread-951::DEBUG::2013-03-01 13:07:41,672::task::1151::TaskManager.Task::(prepare) Task=`247b1a2e-cec4-4be6-ac17-977357e52978`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0121259689331', 'lastCheck': '5.0', 'code': 0, 'valid': True}} >Thread-951::DEBUG::2013-03-01 13:07:41,673::task::568::TaskManager.Task::(_updateState) Task=`247b1a2e-cec4-4be6-ac17-977357e52978`::moving from state preparing -> state finished >Thread-951::DEBUG::2013-03-01 13:07:41,673::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-951::DEBUG::2013-03-01 13:07:41,673::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-951::DEBUG::2013-03-01 13:07:41,674::task::957::TaskManager.Task::(_decref) Task=`247b1a2e-cec4-4be6-ac17-977357e52978`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:07:42,870::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:42,955::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379745 s, 27.0 MB/s\n'; <rc> = 0 >Thread-947::DEBUG::2013-03-01 13:07:43,613::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-947::DEBUG::2013-03-01 13:07:43,614::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-947::DEBUG::2013-03-01 13:07:43,614::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-947::DEBUG::2013-03-01 13:07:43,614::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-947::DEBUG::2013-03-01 13:07:43,615::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-947::DEBUG::2013-03-01 13:07:43,615::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-947::DEBUG::2013-03-01 13:07:43,616::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-947::DEBUG::2013-03-01 13:07:43,616::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-947::INFO::2013-03-01 13:07:43,616::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': []} >Thread-947::DEBUG::2013-03-01 13:07:43,617::task::1151::TaskManager.Task::(prepare) Task=`293d693d-0b62-4454-bd99-2b363b364e2f`::finished: {'statuslist': []} >Thread-947::DEBUG::2013-03-01 13:07:43,617::task::568::TaskManager.Task::(_updateState) Task=`293d693d-0b62-4454-bd99-2b363b364e2f`::moving from state preparing -> state finished >Thread-947::DEBUG::2013-03-01 13:07:43,617::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-947::DEBUG::2013-03-01 13:07:43,617::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-947::DEBUG::2013-03-01 13:07:43,618::task::957::TaskManager.Task::(_decref) Task=`293d693d-0b62-4454-bd99-2b363b364e2f`::ref 0 aborting False >Thread-953::DEBUG::2013-03-01 13:07:44,529::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-953::DEBUG::2013-03-01 13:07:44,530::task::568::TaskManager.Task::(_updateState) Task=`56f16fb0-68f5-4b9f-bce5-4368a58c1b6a`::moving from state init -> state preparing >Thread-953::INFO::2013-03-01 13:07:44,530::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-953::DEBUG::2013-03-01 13:07:44,531::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-953::DEBUG::2013-03-01 13:07:44,553::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-953::DEBUG::2013-03-01 13:07:44,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-953::DEBUG::2013-03-01 13:07:44,575::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-953::DEBUG::2013-03-01 13:07:44,576::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-953::DEBUG::2013-03-01 13:07:44,594::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-953::INFO::2013-03-01 13:07:44,595::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-953::DEBUG::2013-03-01 13:07:44,595::task::1151::TaskManager.Task::(prepare) Task=`56f16fb0-68f5-4b9f-bce5-4368a58c1b6a`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-953::DEBUG::2013-03-01 13:07:44,596::task::568::TaskManager.Task::(_updateState) Task=`56f16fb0-68f5-4b9f-bce5-4368a58c1b6a`::moving from state preparing -> state finished >Thread-953::DEBUG::2013-03-01 13:07:44,596::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-953::DEBUG::2013-03-01 13:07:44,596::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-953::DEBUG::2013-03-01 13:07:44,596::task::957::TaskManager.Task::(_decref) Task=`56f16fb0-68f5-4b9f-bce5-4368a58c1b6a`::ref 0 aborting False >Thread-954::DEBUG::2013-03-01 13:07:44,624::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-954::DEBUG::2013-03-01 13:07:44,625::task::568::TaskManager.Task::(_updateState) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::moving from state init -> state preparing >Thread-954::INFO::2013-03-01 13:07:44,625::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-954::DEBUG::2013-03-01 13:07:44,626::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1aa621a1-9c74-44c7-af8c-3e15b1b43f01`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-954::DEBUG::2013-03-01 13:07:44,626::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-954::DEBUG::2013-03-01 13:07:44,627::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-954::DEBUG::2013-03-01 13:07:44,627::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`1aa621a1-9c74-44c7-af8c-3e15b1b43f01`::Granted request >Thread-954::DEBUG::2013-03-01 13:07:44,628::task::794::TaskManager.Task::(resourceAcquired) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-954::DEBUG::2013-03-01 13:07:44,628::task::957::TaskManager.Task::(_decref) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::ref 1 aborting False >Thread-954::DEBUG::2013-03-01 13:07:44,629::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`a879f37c-a789-439a-8cd7-d4bfa89f8584`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-954::DEBUG::2013-03-01 13:07:44,629::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' for lock type 'exclusive' >Thread-954::DEBUG::2013-03-01 13:07:44,629::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free. Now locking as 'exclusive' (1 active user) >Thread-954::DEBUG::2013-03-01 13:07:44,630::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`a879f37c-a789-439a-8cd7-d4bfa89f8584`::Granted request >Thread-954::DEBUG::2013-03-01 13:07:44,630::task::794::TaskManager.Task::(resourceAcquired) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::_resourcesAcquired: Storage.4b95f32d-26ca-467b-96e6-692c57bcface (exclusive) >Thread-954::DEBUG::2013-03-01 13:07:44,631::task::957::TaskManager.Task::(_decref) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::ref 1 aborting False >Thread-954::INFO::2013-03-01 13:07:44,631::sp::984::Storage.StoragePool::(detachSD) sdUUID=4b95f32d-26ca-467b-96e6-692c57bcface spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-954::DEBUG::2013-03-01 13:07:44,631::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-954::DEBUG::2013-03-01 13:07:44,631::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-954::DEBUG::2013-03-01 13:07:44,632::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-954::DEBUG::2013-03-01 13:07:44,632::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-954::DEBUG::2013-03-01 13:07:44,632::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:44,658::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:44,659::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:44,661::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:44,968::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:45,081::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464073 s, 22.1 MB/s\n'; <rc> = 0 >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:45,666::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:46,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:46,660::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 13:07:46,663::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:46,907::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:07:46,908::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:07:46,909::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:07:46,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319895 s, 12.8 MB/s\n'; <rc> = 0 >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:47,053::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:47,100::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:47,201::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454424 s, 22.5 MB/s\n'; <rc> = 0 >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:48,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:48,062::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:48,064::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-954::DEBUG::2013-03-01 13:07:48,067::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:07:49,215::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:49,311::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379126 s, 27.0 MB/s\n'; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:50,071::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:51,325::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:51,432::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469539 s, 21.8 MB/s\n'; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:52,716::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:52,716::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,717::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,717::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,718::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,718::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,718::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,719::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-954::DEBUG::2013-03-01 13:07:52,719::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:52,971::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:52,973::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,973::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-954::DEBUG::2013-03-01 13:07:52,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:52,982::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000287251 s, 7.1 MB/s\n'; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:52,982::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000287251 s, 7.1 MB/s'], size: 2048 >Thread-954::DEBUG::2013-03-01 13:07:52,983::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-954::WARNING::2013-03-01 13:07:52,983::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-954::DEBUG::2013-03-01 13:07:52,983::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-954::DEBUG::2013-03-01 13:07:52,984::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,984::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,984::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,984::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,985::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:52,985::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:53,186::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:53,187::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,188::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-954::DEBUG::2013-03-01 13:07:53,188::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,189::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:53,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:53,386::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-954::WARNING::2013-03-01 13:07:53,386::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-954::WARNING::2013-03-01 13:07:53,387::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-954::WARNING::2013-03-01 13:07:53,387::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-954::DEBUG::2013-03-01 13:07:53,388::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,388::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,388::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,388::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,389::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:53,451::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:53,530::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351053 s, 29.2 MB/s\n'; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:53,582::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:53,583::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,584::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=0', '_SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c'] >Thread-954::DEBUG::2013-03-01 13:07:53,584::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-954::DEBUG::2013-03-01 13:07:53,585::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-954::DEBUG::2013-03-01 13:07:53,585::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-954::DEBUG::2013-03-01 13:07:53,585::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-954::DEBUG::2013-03-01 13:07:53,586::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=0', 'PHYBLKSIZE=4096', 'POOL_UUID=', u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', '_SHA_CKSUM=0d75fdf7c3316ad004450bf85e433ebbed1a7df3'] >Thread-954::DEBUG::2013-03-01 13:07:53,586::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,587::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,587::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,587::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,588::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,589::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:53,779::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:53,780::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:53,781::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=0d75fdf7c3316ad004450bf85e433ebbed1a7df3, MDT_POOL_UUID= removing=MDT__SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c, MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-954::DEBUG::2013-03-01 13:07:53,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be --deltag MDT__SHA_CKSUM=a5ed2132ff18b23f250ab40be726a8b88146ea7c --addtag MDT__SHA_CKSUM=0d75fdf7c3316ad004450bf85e433ebbed1a7df3 --addtag MDT_POOL_UUID= 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:54,106::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:54,106::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,107::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,107::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-954::WARNING::2013-03-01 13:07:54,107::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `4b95f32d-26ca-467b-96e6-692c57bcface` >Thread-954::DEBUG::2013-03-01 13:07:54,108::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-954::DEBUG::2013-03-01 13:07:54,108::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-954::DEBUG::2013-03-01 13:07:54,109::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', u'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9'] >Thread-954::DEBUG::2013-03-01 13:07:54,109::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,109::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,110::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,110::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,111::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,112::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:54,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:54,303::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,304::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9 removing=MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active, MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 >Thread-954::DEBUG::2013-03-01 13:07:54,305::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=e59a90b556deebd8a7add6c7f45d99c6acef6972 --deltag MDT_POOL_DOMAINS=4b95f32d-26ca-467b-96e6-692c57bcface:Attached&44&a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active --addtag MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9 --addtag MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-954::DEBUG::2013-03-01 13:07:54,580::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2013-03-01 13:07:54,581::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,581::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-954::DEBUG::2013-03-01 13:07:54,582::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-954::DEBUG::2013-03-01 13:07:54,582::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-954::DEBUG::2013-03-01 13:07:54,582::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-954::DEBUG::2013-03-01 13:07:54,583::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-954::DEBUG::2013-03-01 13:07:54,583::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `4b95f32d-26ca-467b-96e6-692c57bcface` is done >Thread-954::INFO::2013-03-01 13:07:54,583::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-954::DEBUG::2013-03-01 13:07:54,583::task::1151::TaskManager.Task::(prepare) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::finished: None >Thread-954::DEBUG::2013-03-01 13:07:54,584::task::568::TaskManager.Task::(_updateState) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::moving from state preparing -> state finished >Thread-954::DEBUG::2013-03-01 13:07:54,584::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4b95f32d-26ca-467b-96e6-692c57bcface': < ResourceRef 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-954::DEBUG::2013-03-01 13:07:54,584::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-954::DEBUG::2013-03-01 13:07:54,585::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' >Thread-954::DEBUG::2013-03-01 13:07:54,585::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' (0 active users) >Thread-954::DEBUG::2013-03-01 13:07:54,585::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free, finding out if anyone is waiting for it. >Thread-954::DEBUG::2013-03-01 13:07:54,586::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', Clearing records. >Thread-954::DEBUG::2013-03-01 13:07:54,586::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-954::DEBUG::2013-03-01 13:07:54,586::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-954::DEBUG::2013-03-01 13:07:54,586::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-954::DEBUG::2013-03-01 13:07:54,587::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-954::DEBUG::2013-03-01 13:07:54,587::task::957::TaskManager.Task::(_decref) Task=`d0c9d717-db0e-41e5-82c6-260472926327`::ref 0 aborting False >Thread-959::DEBUG::2013-03-01 13:07:54,616::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-959::DEBUG::2013-03-01 13:07:54,617::task::568::TaskManager.Task::(_updateState) Task=`d62695d8-87c0-4932-a4ac-9a396146e813`::moving from state init -> state preparing >Thread-959::INFO::2013-03-01 13:07:54,617::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-959::INFO::2013-03-01 13:07:54,618::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-959::DEBUG::2013-03-01 13:07:54,618::task::1151::TaskManager.Task::(prepare) Task=`d62695d8-87c0-4932-a4ac-9a396146e813`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-959::DEBUG::2013-03-01 13:07:54,619::task::568::TaskManager.Task::(_updateState) Task=`d62695d8-87c0-4932-a4ac-9a396146e813`::moving from state preparing -> state finished >Thread-959::DEBUG::2013-03-01 13:07:54,619::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-959::DEBUG::2013-03-01 13:07:54,619::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-959::DEBUG::2013-03-01 13:07:54,620::task::957::TaskManager.Task::(_decref) Task=`d62695d8-87c0-4932-a4ac-9a396146e813`::ref 0 aborting False >Thread-960::DEBUG::2013-03-01 13:07:54,633::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-960::DEBUG::2013-03-01 13:07:54,634::task::568::TaskManager.Task::(_updateState) Task=`7271fb2e-88ab-40fc-a93a-1d27dc0c4de5`::moving from state init -> state preparing >Thread-960::INFO::2013-03-01 13:07:54,635::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', masterVersion=1, options=None) >Thread-960::DEBUG::2013-03-01 13:07:54,635::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`40dd369e-4add-4379-9c59-4730b2952946`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-960::DEBUG::2013-03-01 13:07:54,636::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-960::DEBUG::2013-03-01 13:07:54,636::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-960::DEBUG::2013-03-01 13:07:54,636::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`40dd369e-4add-4379-9c59-4730b2952946`::Granted request >Thread-960::DEBUG::2013-03-01 13:07:54,637::task::794::TaskManager.Task::(resourceAcquired) Task=`7271fb2e-88ab-40fc-a93a-1d27dc0c4de5`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-960::DEBUG::2013-03-01 13:07:54,637::task::957::TaskManager.Task::(_decref) Task=`7271fb2e-88ab-40fc-a93a-1d27dc0c4de5`::ref 1 aborting False >Thread-960::INFO::2013-03-01 13:07:54,637::blockSD::818::Storage.StorageDomain::(validate) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-960::DEBUG::2013-03-01 13:07:54,638::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-961::DEBUG::2013-03-01 13:07:54,649::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-961::DEBUG::2013-03-01 13:07:54,650::task::568::TaskManager.Task::(_updateState) Task=`754629b0-3926-4333-985b-a621bb03a4e7`::moving from state init -> state preparing >Thread-961::INFO::2013-03-01 13:07:54,650::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-961::DEBUG::2013-03-01 13:07:54,651::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`c713488b-e1bb-429c-bbd5-0b71e1c3176a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-961::DEBUG::2013-03-01 13:07:54,651::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-961::DEBUG::2013-03-01 13:07:54,652::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-961::DEBUG::2013-03-01 13:07:54,652::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`c713488b-e1bb-429c-bbd5-0b71e1c3176a`::Granted request >Thread-961::DEBUG::2013-03-01 13:07:54,653::task::794::TaskManager.Task::(resourceAcquired) Task=`754629b0-3926-4333-985b-a621bb03a4e7`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-961::DEBUG::2013-03-01 13:07:54,653::task::957::TaskManager.Task::(_decref) Task=`754629b0-3926-4333-985b-a621bb03a4e7`::ref 1 aborting False >Thread-961::DEBUG::2013-03-01 13:07:54,654::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:07:54,655::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-960::DEBUG::2013-03-01 13:07:54,827::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-960::DEBUG::2013-03-01 13:07:54,828::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-961::DEBUG::2013-03-01 13:07:54,839::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:07:54,840::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:54,841::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:54,841::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:54,842::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:54,842::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:54,842::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:54,843::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-960::DEBUG::2013-03-01 13:07:55,034::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-960::DEBUG::2013-03-01 13:07:55,036::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:55,036::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-960::DEBUG::2013-03-01 13:07:55,040::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:55,040::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:55,041::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:55,041::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:55,041::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-960::DEBUG::2013-03-01 13:07:55,042::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:07:55,042::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-961::DEBUG::2013-03-01 13:07:55,042::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-961::DEBUG::2013-03-01 13:07:55,043::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-961::DEBUG::2013-03-01 13:07:55,043::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-961::DEBUG::2013-03-01 13:07:55,043::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-961::DEBUG::2013-03-01 13:07:55,068::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:07:55,069::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-961::DEBUG::2013-03-01 13:07:55,071::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:55,544::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:55,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584872 s, 17.5 MB/s\n'; <rc> = 0 >MainProcess|Thread-961::DEBUG::2013-03-01 13:07:56,076::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-962::DEBUG::2013-03-01 13:07:57,031::task::568::TaskManager.Task::(_updateState) Task=`c2ed0dc8-b923-4bd8-af7f-12d470f311fa`::moving from state init -> state preparing >Thread-962::INFO::2013-03-01 13:07:57,031::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-962::INFO::2013-03-01 13:07:57,032::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0143811702728', 'lastCheck': '10.1', 'code': 0, 'valid': True}} >Thread-962::DEBUG::2013-03-01 13:07:57,032::task::1151::TaskManager.Task::(prepare) Task=`c2ed0dc8-b923-4bd8-af7f-12d470f311fa`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0143811702728', 'lastCheck': '10.1', 'code': 0, 'valid': True}} >Thread-962::DEBUG::2013-03-01 13:07:57,032::task::568::TaskManager.Task::(_updateState) Task=`c2ed0dc8-b923-4bd8-af7f-12d470f311fa`::moving from state preparing -> state finished >Thread-962::DEBUG::2013-03-01 13:07:57,033::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-962::DEBUG::2013-03-01 13:07:57,033::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-962::DEBUG::2013-03-01 13:07:57,033::task::957::TaskManager.Task::(_decref) Task=`c2ed0dc8-b923-4bd8-af7f-12d470f311fa`::ref 0 aborting False >MainProcess|Thread-961::DEBUG::2013-03-01 13:07:57,081::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:57,684::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:57,786::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386981 s, 26.5 MB/s\n'; <rc> = 0 >MainProcess|Thread-961::DEBUG::2013-03-01 13:07:58,085::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-961::DEBUG::2013-03-01 13:07:58,089::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-961::DEBUG::2013-03-01 13:07:59,093::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:59,806::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:07:59,906::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492669 s, 20.8 MB/s\n'; <rc> = 0 >MainProcess|Thread-961::DEBUG::2013-03-01 13:08:00,098::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-961::DEBUG::2013-03-01 13:08:01,103::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:08:01,925::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:02,028::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411696 s, 24.9 MB/s\n'; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:03,135::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:04,052::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:05,407::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.465709 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:08:07,603::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:07,704::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400045 s, 25.6 MB/s\n'; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:08,055::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:08,056::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,062::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,062::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,063::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,063::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,064::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,084::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-961::DEBUG::2013-03-01 13:08:08,085::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,193::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-961::DEBUG::2013-03-01 13:08:08,482::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:08,484::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,484::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-961::DEBUG::2013-03-01 13:08:08,485::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-961::DEBUG::2013-03-01 13:08:08,495::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000336502 s, 6.1 MB/s\n'; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:08,496::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000336502 s, 6.1 MB/s'], size: 2048 >Thread-961::DEBUG::2013-03-01 13:08:08,496::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-961::WARNING::2013-03-01 13:08:08,496::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-961::DEBUG::2013-03-01 13:08:08,498::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-961::DEBUG::2013-03-01 13:08:08,498::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,499::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,499::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,500::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,500::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-961::DEBUG::2013-03-01 13:08:08,748::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:08,750::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,750::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active'] >Thread-961::DEBUG::2013-03-01 13:08:08,751::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:08,752::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-961::DEBUG::2013-03-01 13:08:09,001::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-961::DEBUG::2013-03-01 13:08:09,002::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-961::WARNING::2013-03-01 13:08:09,002::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-961::WARNING::2013-03-01 13:08:09,002::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-961::WARNING::2013-03-01 13:08:09,003::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-960::DEBUG::2013-03-01 13:08:09,006::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-961::INFO::2013-03-01 13:08:09,008::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-960::DEBUG::2013-03-01 13:08:09,009::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-961::DEBUG::2013-03-01 13:08:09,011::task::1151::TaskManager.Task::(prepare) Task=`754629b0-3926-4333-985b-a621bb03a4e7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-960::DEBUG::2013-03-01 13:08:09,012::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-961::DEBUG::2013-03-01 13:08:09,015::task::568::TaskManager.Task::(_updateState) Task=`754629b0-3926-4333-985b-a621bb03a4e7`::moving from state preparing -> state finished >Thread-105::DEBUG::2013-03-01 13:08:09,015::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-960::DEBUG::2013-03-01 13:08:09,017::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-961::DEBUG::2013-03-01 13:08:09,026::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-960::WARNING::2013-03-01 13:08:09,029::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be already exists >Thread-961::DEBUG::2013-03-01 13:08:09,032::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-960::DEBUG::2013-03-01 13:08:09,035::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-961::DEBUG::2013-03-01 13:08:09,037::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-961::DEBUG::2013-03-01 13:08:09,041::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (1 active users) >Thread-960::DEBUG::2013-03-01 13:08:09,043::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-961::DEBUG::2013-03-01 13:08:09,044::task::957::TaskManager.Task::(_decref) Task=`754629b0-3926-4333-985b-a621bb03a4e7`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:08:09,261::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:08:09,262::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:08:09,272::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000426332 s, 9.6 MB/s\n'; <rc> = 0 >Thread-960::DEBUG::2013-03-01 13:08:09,295::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-960::DEBUG::2013-03-01 13:08:09,298::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-960::WARNING::2013-03-01 13:08:09,355::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-960::WARNING::2013-03-01 13:08:09,355::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-960::INFO::2013-03-01 13:08:09,356::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-960::INFO::2013-03-01 13:08:09,356::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd >Thread-960::INFO::2013-03-01 13:08:09,357::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-960::DEBUG::2013-03-01 13:08:09,357::task::1151::TaskManager.Task::(prepare) Task=`7271fb2e-88ab-40fc-a93a-1d27dc0c4de5`::finished: None >Thread-960::DEBUG::2013-03-01 13:08:09,358::task::568::TaskManager.Task::(_updateState) Task=`7271fb2e-88ab-40fc-a93a-1d27dc0c4de5`::moving from state preparing -> state finished >Thread-960::DEBUG::2013-03-01 13:08:09,358::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-960::DEBUG::2013-03-01 13:08:09,358::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-960::DEBUG::2013-03-01 13:08:09,359::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-960::DEBUG::2013-03-01 13:08:09,359::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-960::DEBUG::2013-03-01 13:08:09,359::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-960::DEBUG::2013-03-01 13:08:09,359::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-960::DEBUG::2013-03-01 13:08:09,360::task::957::TaskManager.Task::(_decref) Task=`7271fb2e-88ab-40fc-a93a-1d27dc0c4de5`::ref 0 aborting False >Thread-990::DEBUG::2013-03-01 13:08:09,395::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-990::DEBUG::2013-03-01 13:08:09,396::task::568::TaskManager.Task::(_updateState) Task=`c062a952-a1b5-4720-97e5-5741cfc7da1d`::moving from state init -> state preparing >Thread-990::INFO::2013-03-01 13:08:09,396::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[], options=None) >Thread-990::DEBUG::2013-03-01 13:08:09,397::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-990::DEBUG::2013-03-01 13:08:09,397::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-990::DEBUG::2013-03-01 13:08:09,397::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-990::DEBUG::2013-03-01 13:08:09,397::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-990::DEBUG::2013-03-01 13:08:09,398::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-990::DEBUG::2013-03-01 13:08:09,424::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-990::DEBUG::2013-03-01 13:08:09,425::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:09,429::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:09,432::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:09,435::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:09,717::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:09,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459253 s, 22.3 MB/s\n'; <rc> = 0 >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:10,439::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:10,443::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:10,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:10,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-990::DEBUG::2013-03-01 13:08:10,451::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:08:11,836::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:11,952::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490252 s, 20.9 MB/s\n'; <rc> = 0 >Thread-990::DEBUG::2013-03-01 13:08:12,455::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-992::DEBUG::2013-03-01 13:08:12,575::task::568::TaskManager.Task::(_updateState) Task=`f195cbf0-d077-427d-9cc2-51f7c9badaab`::moving from state init -> state preparing >Thread-992::INFO::2013-03-01 13:08:12,575::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-992::INFO::2013-03-01 13:08:12,576::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0104179382324', 'lastCheck': '3.3', 'code': 0, 'valid': True}} >Thread-992::DEBUG::2013-03-01 13:08:12,576::task::1151::TaskManager.Task::(prepare) Task=`f195cbf0-d077-427d-9cc2-51f7c9badaab`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0104179382324', 'lastCheck': '3.3', 'code': 0, 'valid': True}} >Thread-992::DEBUG::2013-03-01 13:08:12,576::task::568::TaskManager.Task::(_updateState) Task=`f195cbf0-d077-427d-9cc2-51f7c9badaab`::moving from state preparing -> state finished >Thread-992::DEBUG::2013-03-01 13:08:12,576::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-992::DEBUG::2013-03-01 13:08:12,577::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-992::DEBUG::2013-03-01 13:08:12,577::task::957::TaskManager.Task::(_decref) Task=`f195cbf0-d077-427d-9cc2-51f7c9badaab`::ref 0 aborting False >Dummy-173::DEBUG::2013-03-01 13:08:13,971::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:14,060::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308299 s, 33.2 MB/s\n'; <rc> = 0 >Thread-990::DEBUG::2013-03-01 13:08:15,094::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-990::DEBUG::2013-03-01 13:08:15,094::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-990::DEBUG::2013-03-01 13:08:15,095::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-990::DEBUG::2013-03-01 13:08:15,095::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-990::DEBUG::2013-03-01 13:08:15,095::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-990::DEBUG::2013-03-01 13:08:15,096::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-990::DEBUG::2013-03-01 13:08:15,096::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-990::DEBUG::2013-03-01 13:08:15,096::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-990::INFO::2013-03-01 13:08:15,097::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': []} >Thread-990::DEBUG::2013-03-01 13:08:15,097::task::1151::TaskManager.Task::(prepare) Task=`c062a952-a1b5-4720-97e5-5741cfc7da1d`::finished: {'statuslist': []} >Thread-990::DEBUG::2013-03-01 13:08:15,097::task::568::TaskManager.Task::(_updateState) Task=`c062a952-a1b5-4720-97e5-5741cfc7da1d`::moving from state preparing -> state finished >Thread-990::DEBUG::2013-03-01 13:08:15,098::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-990::DEBUG::2013-03-01 13:08:15,098::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-990::DEBUG::2013-03-01 13:08:15,098::task::957::TaskManager.Task::(_decref) Task=`c062a952-a1b5-4720-97e5-5741cfc7da1d`::ref 0 aborting False >Thread-995::DEBUG::2013-03-01 13:08:15,844::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-995::DEBUG::2013-03-01 13:08:15,845::task::568::TaskManager.Task::(_updateState) Task=`8976c239-b7fe-4baa-aa64-13fd8b5fb393`::moving from state init -> state preparing >Thread-995::INFO::2013-03-01 13:08:15,876::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-995::DEBUG::2013-03-01 13:08:15,877::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-995::DEBUG::2013-03-01 13:08:15,899::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-995::DEBUG::2013-03-01 13:08:15,900::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-995::DEBUG::2013-03-01 13:08:15,921::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-995::DEBUG::2013-03-01 13:08:15,922::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-995::DEBUG::2013-03-01 13:08:15,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-995::INFO::2013-03-01 13:08:15,941::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-995::DEBUG::2013-03-01 13:08:15,941::task::1151::TaskManager.Task::(prepare) Task=`8976c239-b7fe-4baa-aa64-13fd8b5fb393`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-995::DEBUG::2013-03-01 13:08:15,942::task::568::TaskManager.Task::(_updateState) Task=`8976c239-b7fe-4baa-aa64-13fd8b5fb393`::moving from state preparing -> state finished >Thread-995::DEBUG::2013-03-01 13:08:15,942::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-995::DEBUG::2013-03-01 13:08:15,942::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-995::DEBUG::2013-03-01 13:08:15,943::task::957::TaskManager.Task::(_decref) Task=`8976c239-b7fe-4baa-aa64-13fd8b5fb393`::ref 0 aborting False >Thread-996::DEBUG::2013-03-01 13:08:15,972::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-996::DEBUG::2013-03-01 13:08:15,973::task::568::TaskManager.Task::(_updateState) Task=`1e4f5b12-445b-46c4-88e6-04f259789f12`::moving from state init -> state preparing >Thread-996::INFO::2013-03-01 13:08:15,973::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='4b95f32d-26ca-467b-96e6-692c57bcface', autoDetach=False, options=None) >Thread-996::DEBUG::2013-03-01 13:08:15,973::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-996::DEBUG::2013-03-01 13:08:15,974::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-996::DEBUG::2013-03-01 13:08:15,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:16,001::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:16,002::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:16,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:16,079::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:16,192::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472349 s, 21.7 MB/s\n'; <rc> = 0 >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:17,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:17,012::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:17,015::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:17,018::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:17,021::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:18,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:18,029::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:08:18,212::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:18,322::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044848 s, 22.8 MB/s\n'; <rc> = 0 >Thread-998::DEBUG::2013-03-01 13:08:19,091::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-998::DEBUG::2013-03-01 13:08:19,091::task::568::TaskManager.Task::(_updateState) Task=`759fb8fa-8216-4c0e-9104-7edc4f05406f`::moving from state init -> state preparing >Thread-998::INFO::2013-03-01 13:08:19,092::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-998::INFO::2013-03-01 13:08:19,092::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-998::DEBUG::2013-03-01 13:08:19,092::task::1151::TaskManager.Task::(prepare) Task=`759fb8fa-8216-4c0e-9104-7edc4f05406f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-998::DEBUG::2013-03-01 13:08:19,093::task::568::TaskManager.Task::(_updateState) Task=`759fb8fa-8216-4c0e-9104-7edc4f05406f`::moving from state preparing -> state finished >Thread-998::DEBUG::2013-03-01 13:08:19,093::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-998::DEBUG::2013-03-01 13:08:19,093::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-998::DEBUG::2013-03-01 13:08:19,093::task::957::TaskManager.Task::(_decref) Task=`759fb8fa-8216-4c0e-9104-7edc4f05406f`::ref 0 aborting False >Thread-999::DEBUG::2013-03-01 13:08:19,118::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-999::DEBUG::2013-03-01 13:08:19,119::task::568::TaskManager.Task::(_updateState) Task=`e6705b8b-8b88-4d0e-93e2-f2af429b5f1f`::moving from state init -> state preparing >Thread-999::INFO::2013-03-01 13:08:19,119::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-999::DEBUG::2013-03-01 13:08:19,120::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`6afb4197-a55b-479f-8091-f6f1963c7cb4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-999::DEBUG::2013-03-01 13:08:19,120::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-999::DEBUG::2013-03-01 13:08:19,120::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-999::DEBUG::2013-03-01 13:08:19,120::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`6afb4197-a55b-479f-8091-f6f1963c7cb4`::Granted request >Thread-999::DEBUG::2013-03-01 13:08:19,121::task::794::TaskManager.Task::(resourceAcquired) Task=`e6705b8b-8b88-4d0e-93e2-f2af429b5f1f`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-999::DEBUG::2013-03-01 13:08:19,121::task::957::TaskManager.Task::(_decref) Task=`e6705b8b-8b88-4d0e-93e2-f2af429b5f1f`::ref 1 aborting False >Thread-999::DEBUG::2013-03-01 13:08:19,122::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-999::DEBUG::2013-03-01 13:08:19,125::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:08:19,280::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:08:19,281::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-999::DEBUG::2013-03-01 13:08:19,380::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-999::INFO::2013-03-01 13:08:19,383::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-999::DEBUG::2013-03-01 13:08:19,384::task::1151::TaskManager.Task::(prepare) Task=`e6705b8b-8b88-4d0e-93e2-f2af429b5f1f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-999::DEBUG::2013-03-01 13:08:19,384::task::568::TaskManager.Task::(_updateState) Task=`e6705b8b-8b88-4d0e-93e2-f2af429b5f1f`::moving from state preparing -> state finished >Thread-999::DEBUG::2013-03-01 13:08:19,385::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-999::DEBUG::2013-03-01 13:08:19,385::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-999::DEBUG::2013-03-01 13:08:19,386::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-999::DEBUG::2013-03-01 13:08:19,386::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-999::DEBUG::2013-03-01 13:08:19,387::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-999::DEBUG::2013-03-01 13:08:19,387::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-999::DEBUG::2013-03-01 13:08:19,388::task::957::TaskManager.Task::(_decref) Task=`e6705b8b-8b88-4d0e-93e2-f2af429b5f1f`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:08:19,520::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:08:19,522::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:08:19,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 13:08:19,535::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000381731 s, 10.7 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:20,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:20,341::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:20,441::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431195 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-173::DEBUG::2013-03-01 13:08:22,454::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:22,549::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381179 s, 26.9 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:22,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:22,675::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`9c857c5c-3ff5-4d94-abb6-41e001a05abd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-996::DEBUG::2013-03-01 13:08:22,675::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' for lock type 'exclusive' >Thread-996::DEBUG::2013-03-01 13:08:22,676::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free. Now locking as 'exclusive' (1 active user) >Thread-996::DEBUG::2013-03-01 13:08:22,676::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4b95f32d-26ca-467b-96e6-692c57bcface`ReqID=`9c857c5c-3ff5-4d94-abb6-41e001a05abd`::Granted request >Thread-996::DEBUG::2013-03-01 13:08:22,677::task::794::TaskManager.Task::(resourceAcquired) Task=`1e4f5b12-445b-46c4-88e6-04f259789f12`::_resourcesAcquired: Storage.4b95f32d-26ca-467b-96e6-692c57bcface (exclusive) >Thread-996::DEBUG::2013-03-01 13:08:22,677::task::957::TaskManager.Task::(_decref) Task=`1e4f5b12-445b-46c4-88e6-04f259789f12`::ref 1 aborting False >Thread-996::DEBUG::2013-03-01 13:08:22,677::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-996::DEBUG::2013-03-01 13:08:22,678::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-996::DEBUG::2013-03-01 13:08:22,678::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-996::DEBUG::2013-03-01 13:08:22,678::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-996::DEBUG::2013-03-01 13:08:22,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:22,705::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:22,706::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,707::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,710::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,713::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,716::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,719::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-996::DEBUG::2013-03-01 13:08:22,727::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:08:24,568::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:24,665::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370522 s, 27.6 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:24,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:26,679::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:26,774::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439406 s, 23.3 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:27,308::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:27,308::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,309::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,309::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,309::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,310::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,310::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,311::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-996::DEBUG::2013-03-01 13:08:27,311::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,315::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:27,559::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:27,561::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,561::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-996::DEBUG::2013-03-01 13:08:27,561::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:27,570::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000290853 s, 7.0 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:27,570::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000290853 s, 7.0 MB/s'], size: 2048 >Thread-996::DEBUG::2013-03-01 13:08:27,570::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-996::WARNING::2013-03-01 13:08:27,571::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-996::DEBUG::2013-03-01 13:08:27,571::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-996::DEBUG::2013-03-01 13:08:27,571::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,572::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,572::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,572::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,572::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,573::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:27,765::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:27,766::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,767::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'MASTER_VERSION=0', '_SHA_CKSUM=0d75fdf7c3316ad004450bf85e433ebbed1a7df3', 'POOL_UUID='] >Thread-996::DEBUG::2013-03-01 13:08:27,768::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,768::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-1002::DEBUG::2013-03-01 13:08:27,817::task::568::TaskManager.Task::(_updateState) Task=`aac4a380-d2c4-4a7d-93d3-d294d1f8b0f1`::moving from state init -> state preparing >Thread-1002::INFO::2013-03-01 13:08:27,818::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1002::INFO::2013-03-01 13:08:27,818::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131039619446', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-1002::DEBUG::2013-03-01 13:08:27,818::task::1151::TaskManager.Task::(prepare) Task=`aac4a380-d2c4-4a7d-93d3-d294d1f8b0f1`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0131039619446', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-1002::DEBUG::2013-03-01 13:08:27,819::task::568::TaskManager.Task::(_updateState) Task=`aac4a380-d2c4-4a7d-93d3-d294d1f8b0f1`::moving from state preparing -> state finished >Thread-1002::DEBUG::2013-03-01 13:08:27,819::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1002::DEBUG::2013-03-01 13:08:27,819::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1002::DEBUG::2013-03-01 13:08:27,819::task::957::TaskManager.Task::(_decref) Task=`aac4a380-d2c4-4a7d-93d3-d294d1f8b0f1`::ref 0 aborting False >Thread-996::DEBUG::2013-03-01 13:08:27,966::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:27,967::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:27,967::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-996::WARNING::2013-03-01 13:08:27,967::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-996::WARNING::2013-03-01 13:08:27,968::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-996::DEBUG::2013-03-01 13:08:27,968::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,968::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,969::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,969::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,969::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:27,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:28,161::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:28,162::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,163::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'MASTER_VERSION=0', '_SHA_CKSUM=0d75fdf7c3316ad004450bf85e433ebbed1a7df3', 'POOL_UUID='] >Thread-996::DEBUG::2013-03-01 13:08:28,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-996::DEBUG::2013-03-01 13:08:28,164::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/4b95f32d-26ca-467b-96e6-692c57bcface/metadata count=1' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:28,174::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000265016 s, 7.7 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:28,174::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000265016 s, 7.7 MB/s'], size: 2048 >Thread-996::DEBUG::2013-03-01 13:08:28,174::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-996::WARNING::2013-03-01 13:08:28,175::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-996::DEBUG::2013-03-01 13:08:28,175::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-996::DEBUG::2013-03-01 13:08:28,176::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,176::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,176::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,177::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,177::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:28,390::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:28,392::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,392::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:3514f0c542a0004b9,uuid:jamnnl-2ycA-1LZ3-ih7z-cPp6-q1IR-7MtoYG,pestart:0,pecount:397,mapoffset:0', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'SDUUID=4b95f32d-26ca-467b-96e6-692c57bcface', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=QES9Ps-BtUG-F2pA-vSIj-Yv5k-sxBC-iCW6S2', 'LOGBLKSIZE=512', 'DESCRIPTION=data_sd2', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', 'LOCKPOLICY=', 'MASTER_VERSION=0', '_SHA_CKSUM=0d75fdf7c3316ad004450bf85e433ebbed1a7df3', 'POOL_UUID='] >Thread-996::WARNING::2013-03-01 13:08:28,393::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_imageNS already registered >Thread-996::WARNING::2013-03-01 13:08:28,394::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_volumeNS already registered >Thread-996::WARNING::2013-03-01 13:08:28,394::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4b95f32d-26ca-467b-96e6-692c57bcface_lvmActivationNS already registered >Thread-996::DEBUG::2013-03-01 13:08:28,395::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,395::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:28,641::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:28,648::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:28,649::lvm::1043::Storage.LVM::(removeLVs) Removing active volume 4b95f32d-26ca-467b-96e6-692c57bcface/leases >Thread-996::DEBUG::2013-03-01 13:08:28,650::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 4b95f32d-26ca-467b-96e6-692c57bcface/leases' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:28,788::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:28,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480204 s, 21.3 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:28,931::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:28,931::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:28,931::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:28,932::lvm::1043::Storage.LVM::(removeLVs) Removing active volume 4b95f32d-26ca-467b-96e6-692c57bcface/inbox >Thread-996::DEBUG::2013-03-01 13:08:28,932::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 4b95f32d-26ca-467b-96e6-692c57bcface/inbox' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:29,145::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:29,146::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:29,146::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:29,147::lvm::1043::Storage.LVM::(removeLVs) Removing active volume 4b95f32d-26ca-467b-96e6-692c57bcface/master >Thread-996::DEBUG::2013-03-01 13:08:29,147::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 4b95f32d-26ca-467b-96e6-692c57bcface/master' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:29,361::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:29,361::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:29,362::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:29,362::lvm::1043::Storage.LVM::(removeLVs) Removing active volume 4b95f32d-26ca-467b-96e6-692c57bcface/metadata >Thread-996::DEBUG::2013-03-01 13:08:29,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 4b95f32d-26ca-467b-96e6-692c57bcface/metadata' (cwd None) >Thread-1004::DEBUG::2013-03-01 13:08:29,459::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1004::DEBUG::2013-03-01 13:08:29,460::task::568::TaskManager.Task::(_updateState) Task=`a1abbc43-6039-4605-a589-c36ec179ecd0`::moving from state init -> state preparing >Thread-1004::INFO::2013-03-01 13:08:29,460::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-1004::INFO::2013-03-01 13:08:29,461::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1004::DEBUG::2013-03-01 13:08:29,461::task::1151::TaskManager.Task::(prepare) Task=`a1abbc43-6039-4605-a589-c36ec179ecd0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1004::DEBUG::2013-03-01 13:08:29,461::task::568::TaskManager.Task::(_updateState) Task=`a1abbc43-6039-4605-a589-c36ec179ecd0`::moving from state preparing -> state finished >Thread-1004::DEBUG::2013-03-01 13:08:29,462::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1004::DEBUG::2013-03-01 13:08:29,462::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1004::DEBUG::2013-03-01 13:08:29,462::task::957::TaskManager.Task::(_decref) Task=`a1abbc43-6039-4605-a589-c36ec179ecd0`::ref 0 aborting False >Thread-1005::DEBUG::2013-03-01 13:08:29,487::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1005::DEBUG::2013-03-01 13:08:29,487::task::568::TaskManager.Task::(_updateState) Task=`ec625ce0-76a0-4071-8a61-609972549437`::moving from state init -> state preparing >Thread-1005::INFO::2013-03-01 13:08:29,488::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-1005::DEBUG::2013-03-01 13:08:29,490::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`0598bb6d-036c-41e9-ba15-a6ba1d64cac8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1005::DEBUG::2013-03-01 13:08:29,490::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'shared' >Thread-1005::DEBUG::2013-03-01 13:08:29,491::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'shared' (1 active user) >Thread-1005::DEBUG::2013-03-01 13:08:29,491::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`0598bb6d-036c-41e9-ba15-a6ba1d64cac8`::Granted request >Thread-1005::DEBUG::2013-03-01 13:08:29,492::task::794::TaskManager.Task::(resourceAcquired) Task=`ec625ce0-76a0-4071-8a61-609972549437`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (shared) >Thread-1005::DEBUG::2013-03-01 13:08:29,492::task::957::TaskManager.Task::(_decref) Task=`ec625ce0-76a0-4071-8a61-609972549437`::ref 1 aborting False >Thread-1005::DEBUG::2013-03-01 13:08:29,493::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1005::DEBUG::2013-03-01 13:08:29,494::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-105::DEBUG::2013-03-01 13:08:29,541::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-105::DEBUG::2013-03-01 13:08:29,543::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1005::DEBUG::2013-03-01 13:08:29,709::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1005::INFO::2013-03-01 13:08:29,712::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-1005::DEBUG::2013-03-01 13:08:29,712::task::1151::TaskManager.Task::(prepare) Task=`ec625ce0-76a0-4071-8a61-609972549437`::finished: {'info': {'spm_id': 1, 'master_uuid': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'name': 'clone_dc', 'version': '3', 'domains': 'a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-1005::DEBUG::2013-03-01 13:08:29,712::task::568::TaskManager.Task::(_updateState) Task=`ec625ce0-76a0-4071-8a61-609972549437`::moving from state preparing -> state finished >Thread-1005::DEBUG::2013-03-01 13:08:29,713::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-1005::DEBUG::2013-03-01 13:08:29,713::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1005::DEBUG::2013-03-01 13:08:29,713::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1005::DEBUG::2013-03-01 13:08:29,714::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1005::DEBUG::2013-03-01 13:08:29,714::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1005::DEBUG::2013-03-01 13:08:29,714::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1005::DEBUG::2013-03-01 13:08:29,714::task::957::TaskManager.Task::(_decref) Task=`ec625ce0-76a0-4071-8a61-609972549437`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 13:08:29,737::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 13:08:29,738::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 13:08:29,738::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:29,754::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:29,758::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:29,762::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:29,765::lvm::1043::Storage.LVM::(removeLVs) Removing active volume 4b95f32d-26ca-467b-96e6-692c57bcface/outbox >Thread-996::DEBUG::2013-03-01 13:08:29,776::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 4b95f32d-26ca-467b-96e6-692c57bcface/outbox' (cwd None) >Thread-105::DEBUG::2013-03-01 13:08:29,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000328412 s, 12.5 MB/s\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:29,990::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:29,991::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:29,991::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::WARNING::2013-03-01 13:08:29,991::lvm::1043::Storage.LVM::(removeLVs) Removing active volume 4b95f32d-26ca-467b-96e6-692c57bcface/ids >Thread-996::DEBUG::2013-03-01 13:08:29,992::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 4b95f32d-26ca-467b-96e6-692c57bcface/ids' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:30,202::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:30,203::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:30,203::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:30,203::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f 4b95f32d-26ca-467b-96e6-692c57bcface' (cwd None) >Thread-996::DEBUG::2013-03-01 13:08:30,456::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-996::DEBUG::2013-03-01 13:08:30,457::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-996::DEBUG::2013-03-01 13:08:30,457::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-996::INFO::2013-03-01 13:08:30,457::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-996::DEBUG::2013-03-01 13:08:30,458::task::1151::TaskManager.Task::(prepare) Task=`1e4f5b12-445b-46c4-88e6-04f259789f12`::finished: None >Thread-996::DEBUG::2013-03-01 13:08:30,458::task::568::TaskManager.Task::(_updateState) Task=`1e4f5b12-445b-46c4-88e6-04f259789f12`::moving from state preparing -> state finished >Thread-996::DEBUG::2013-03-01 13:08:30,458::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4b95f32d-26ca-467b-96e6-692c57bcface': < ResourceRef 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', isValid: 'True' obj: 'None'>} >Thread-996::DEBUG::2013-03-01 13:08:30,458::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-996::DEBUG::2013-03-01 13:08:30,459::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' >Thread-996::DEBUG::2013-03-01 13:08:30,459::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' (0 active users) >Thread-996::DEBUG::2013-03-01 13:08:30,459::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface' is free, finding out if anyone is waiting for it. >Thread-996::DEBUG::2013-03-01 13:08:30,459::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4b95f32d-26ca-467b-96e6-692c57bcface', Clearing records. >Thread-996::DEBUG::2013-03-01 13:08:30,459::task::957::TaskManager.Task::(_decref) Task=`1e4f5b12-445b-46c4-88e6-04f259789f12`::ref 0 aborting False >Thread-1006::DEBUG::2013-03-01 13:08:30,501::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1006::DEBUG::2013-03-01 13:08:30,502::task::568::TaskManager.Task::(_updateState) Task=`f1a03e43-ec82-4949-9637-45204a83acc6`::moving from state init -> state preparing >Thread-1006::INFO::2013-03-01 13:08:30,502::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[], options=None) >Thread-1006::DEBUG::2013-03-01 13:08:30,503::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1006::DEBUG::2013-03-01 13:08:30,503::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1006::DEBUG::2013-03-01 13:08:30,503::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1006::DEBUG::2013-03-01 13:08:30,504::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1006::DEBUG::2013-03-01 13:08:30,504::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1006::DEBUG::2013-03-01 13:08:30,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1006::DEBUG::2013-03-01 13:08:30,531::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:30,534::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:30,537::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:30,907::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:31,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503955 s, 20.3 MB/s\n'; <rc> = 0 >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:31,541::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:31,545::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:31,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:31,551::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:31,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-1006::DEBUG::2013-03-01 13:08:31,557::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-173::DEBUG::2013-03-01 13:08:33,036::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:33,150::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492632 s, 20.8 MB/s\n'; <rc> = 0 >Thread-1006::DEBUG::2013-03-01 13:08:33,560::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:35,169::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-173::DEBUG::2013-03-01 13:08:35,270::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379636 s, 27.0 MB/s\n'; <rc> = 0 >Thread-1006::DEBUG::2013-03-01 13:08:35,727::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1006::DEBUG::2013-03-01 13:08:35,728::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1006::DEBUG::2013-03-01 13:08:35,728::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1006::DEBUG::2013-03-01 13:08:35,729::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1006::DEBUG::2013-03-01 13:08:35,729::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1006::DEBUG::2013-03-01 13:08:35,729::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1006::DEBUG::2013-03-01 13:08:35,730::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1006::DEBUG::2013-03-01 13:08:35,730::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1006::INFO::2013-03-01 13:08:35,730::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': []} >Thread-1006::DEBUG::2013-03-01 13:08:35,731::task::1151::TaskManager.Task::(prepare) Task=`f1a03e43-ec82-4949-9637-45204a83acc6`::finished: {'statuslist': []} >Thread-1006::DEBUG::2013-03-01 13:08:35,731::task::568::TaskManager.Task::(_updateState) Task=`f1a03e43-ec82-4949-9637-45204a83acc6`::moving from state preparing -> state finished >Thread-1006::DEBUG::2013-03-01 13:08:35,731::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1006::DEBUG::2013-03-01 13:08:35,732::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1006::DEBUG::2013-03-01 13:08:35,732::task::957::TaskManager.Task::(_decref) Task=`f1a03e43-ec82-4949-9637-45204a83acc6`::ref 0 aborting False >Thread-1009::DEBUG::2013-03-01 13:08:36,558::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1009::DEBUG::2013-03-01 13:08:36,558::task::568::TaskManager.Task::(_updateState) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::moving from state init -> state preparing >Thread-1009::INFO::2013-03-01 13:08:36,614::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1009::DEBUG::2013-03-01 13:08:36,614::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`80d5ccaa-9706-4e0e-8bd2-922ad1e978c0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1009::DEBUG::2013-03-01 13:08:36,615::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1009::DEBUG::2013-03-01 13:08:36,615::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1009::DEBUG::2013-03-01 13:08:36,615::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`80d5ccaa-9706-4e0e-8bd2-922ad1e978c0`::Granted request >Thread-1009::DEBUG::2013-03-01 13:08:36,616::task::794::TaskManager.Task::(resourceAcquired) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-1009::DEBUG::2013-03-01 13:08:36,616::task::957::TaskManager.Task::(_decref) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::ref 1 aborting False >Thread-1009::DEBUG::2013-03-01 13:08:36,616::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`33ced141-604d-41dc-9503-07f5f907b4cc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1009::DEBUG::2013-03-01 13:08:36,617::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >Thread-1009::DEBUG::2013-03-01 13:08:36,617::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >Thread-1009::DEBUG::2013-03-01 13:08:36,617::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`33ced141-604d-41dc-9503-07f5f907b4cc`::Granted request >Thread-1009::DEBUG::2013-03-01 13:08:36,618::task::794::TaskManager.Task::(resourceAcquired) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (exclusive) >Thread-1009::DEBUG::2013-03-01 13:08:36,618::task::957::TaskManager.Task::(_decref) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::ref 1 aborting False >Thread-1009::INFO::2013-03-01 13:08:36,618::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295 spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-1009::INFO::2013-03-01 13:08:36,618::sp::1103::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1009::INFO::2013-03-01 13:08:36,619::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-1009::DEBUG::2013-03-01 13:08:36,619::task::1151::TaskManager.Task::(prepare) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::finished: None >Thread-1009::DEBUG::2013-03-01 13:08:36,619::task::568::TaskManager.Task::(_updateState) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::moving from state preparing -> state finished >Thread-1009::DEBUG::2013-03-01 13:08:36,619::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-1009::DEBUG::2013-03-01 13:08:36,620::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1009::DEBUG::2013-03-01 13:08:36,620::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-1009::DEBUG::2013-03-01 13:08:36,620::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-1009::DEBUG::2013-03-01 13:08:36,620::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-1009::DEBUG::2013-03-01 13:08:36,621::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-1009::DEBUG::2013-03-01 13:08:36,621::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1009::DEBUG::2013-03-01 13:08:36,621::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1009::DEBUG::2013-03-01 13:08:36,622::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1009::DEBUG::2013-03-01 13:08:36,622::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1009::DEBUG::2013-03-01 13:08:36,622::task::957::TaskManager.Task::(_decref) Task=`9df82e91-ab51-4b83-8d9a-71b588cdb3ae`::ref 0 aborting False >Thread-1010::DEBUG::2013-03-01 13:08:36,660::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1010::DEBUG::2013-03-01 13:08:36,661::task::568::TaskManager.Task::(_updateState) Task=`cad602bf-b513-472d-9042-cdaf0c87f39d`::moving from state init -> state preparing >Thread-1010::INFO::2013-03-01 13:08:36,661::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-1010::DEBUG::2013-03-01 13:08:36,661::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-1010::DEBUG::2013-03-01 13:08:36,661::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-1010::INFO::2013-03-01 13:08:36,662::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-1010::DEBUG::2013-03-01 13:08:36,662::task::1151::TaskManager.Task::(prepare) Task=`cad602bf-b513-472d-9042-cdaf0c87f39d`::finished: {'allTasksStatus': {}} >Thread-1010::DEBUG::2013-03-01 13:08:36,662::task::568::TaskManager.Task::(_updateState) Task=`cad602bf-b513-472d-9042-cdaf0c87f39d`::moving from state preparing -> state finished >Thread-1010::DEBUG::2013-03-01 13:08:36,662::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1010::DEBUG::2013-03-01 13:08:36,663::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1010::DEBUG::2013-03-01 13:08:36,663::task::957::TaskManager.Task::(_decref) Task=`cad602bf-b513-472d-9042-cdaf0c87f39d`::ref 0 aborting False >Thread-1011::DEBUG::2013-03-01 13:08:36,688::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1011::DEBUG::2013-03-01 13:08:36,689::task::568::TaskManager.Task::(_updateState) Task=`5502254a-366d-4fa1-b91c-f51fd75f7d18`::moving from state init -> state preparing >Thread-1011::INFO::2013-03-01 13:08:36,689::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-1011::DEBUG::2013-03-01 13:08:36,690::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`5016475a-eb41-4fe6-857f-c33d31363539`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1011::DEBUG::2013-03-01 13:08:36,690::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1011::DEBUG::2013-03-01 13:08:36,690::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1011::DEBUG::2013-03-01 13:08:36,690::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`5016475a-eb41-4fe6-857f-c33d31363539`::Granted request >Thread-1011::DEBUG::2013-03-01 13:08:36,691::task::794::TaskManager.Task::(resourceAcquired) Task=`5502254a-366d-4fa1-b91c-f51fd75f7d18`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-1011::DEBUG::2013-03-01 13:08:36,691::task::957::TaskManager.Task::(_decref) Task=`5502254a-366d-4fa1-b91c-f51fd75f7d18`::ref 1 aborting False >Thread-1011::DEBUG::2013-03-01 13:08:36,691::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-1011::DEBUG::2013-03-01 13:08:36,692::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`eceb177a-6c43-4a60-846d-d3173655f8b6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1011::DEBUG::2013-03-01 13:08:36,692::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1011::DEBUG::2013-03-01 13:08:36,692::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1011::DEBUG::2013-03-01 13:08:36,693::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`eceb177a-6c43-4a60-846d-d3173655f8b6`::Granted request >Thread-1011::DEBUG::2013-03-01 13:08:36,693::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1011::DEBUG::2013-03-01 13:08:36,693::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1011::DEBUG::2013-03-01 13:08:36,694::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1011::DEBUG::2013-03-01 13:08:36,694::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1011::DEBUG::2013-03-01 13:08:36,699::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,701::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,703::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,705::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,707::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,709::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,710::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,712::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,714::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,715::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,717::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,719::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,720::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,722::sp::353::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master >Thread-1011::DEBUG::2013-03-01 13:08:36,827::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-1011::DEBUG::2013-03-01 13:08:36,878::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,880::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,883::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,885::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,887::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,890::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,892::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,894::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,896::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,899::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,900::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,902::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,904::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,905::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,907::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,908::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,910::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,911::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,913::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,914::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,916::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,918::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-1011::DEBUG::2013-03-01 13:08:36,918::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1011::DEBUG::2013-03-01 13:08:36,918::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1011::DEBUG::2013-03-01 13:08:36,919::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a'] >Thread-1011::DEBUG::2013-03-01 13:08:36,919::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:36,919::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:36,920::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:36,920::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:36,920::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:36,923::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1011::DEBUG::2013-03-01 13:08:37,113::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1011::DEBUG::2013-03-01 13:08:37,115::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:37,115::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a removing=MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9, MDT_POOL_SPM_ID=1 >Thread-1011::DEBUG::2013-03-01 13:08:37,116::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=29545ca87b93f456108ada4914bdec86933afbd9 --addtag MDT__SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a --addtag MDT_POOL_SPM_ID=-1 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1011::DEBUG::2013-03-01 13:08:37,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1011::DEBUG::2013-03-01 13:08:37,460::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:37,461::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1011::DEBUG::2013-03-01 13:08:37,461::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1011::INFO::2013-03-01 13:08:37,462::clusterlock::252::SANLock::(release) Releasing cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1011::DEBUG::2013-03-01 13:08:37,464::clusterlock::263::SANLock::(release) Cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully released >Thread-1011::INFO::2013-03-01 13:08:37,464::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-1011::DEBUG::2013-03-01 13:08:37,464::task::1151::TaskManager.Task::(prepare) Task=`5502254a-366d-4fa1-b91c-f51fd75f7d18`::finished: None >Thread-1011::DEBUG::2013-03-01 13:08:37,465::task::568::TaskManager.Task::(_updateState) Task=`5502254a-366d-4fa1-b91c-f51fd75f7d18`::moving from state preparing -> state finished >Thread-1011::DEBUG::2013-03-01 13:08:37,465::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-1011::DEBUG::2013-03-01 13:08:37,465::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1011::DEBUG::2013-03-01 13:08:37,466::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1011::DEBUG::2013-03-01 13:08:37,466::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1011::DEBUG::2013-03-01 13:08:37,466::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1011::DEBUG::2013-03-01 13:08:37,467::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1011::DEBUG::2013-03-01 13:08:37,467::task::957::TaskManager.Task::(_decref) Task=`5502254a-366d-4fa1-b91c-f51fd75f7d18`::ref 0 aborting False >Thread-1013::DEBUG::2013-03-01 13:08:37,510::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1013::DEBUG::2013-03-01 13:08:37,510::task::568::TaskManager.Task::(_updateState) Task=`7609db94-5051-4283-a821-f070b88a1baa`::moving from state init -> state preparing >Thread-1013::INFO::2013-03-01 13:08:37,511::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', hostID=1, scsiKey='41b11cc6-b020-47d9-b70e-c4fadcc621be', remove=False, options=None) >Thread-1013::DEBUG::2013-03-01 13:08:37,511::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`4e75c678-99f6-40cb-ac6b-26cd5e00d906`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1013::DEBUG::2013-03-01 13:08:37,511::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1013::DEBUG::2013-03-01 13:08:37,512::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1013::DEBUG::2013-03-01 13:08:37,512::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`4e75c678-99f6-40cb-ac6b-26cd5e00d906`::Granted request >Thread-1013::DEBUG::2013-03-01 13:08:37,513::task::794::TaskManager.Task::(resourceAcquired) Task=`7609db94-5051-4283-a821-f070b88a1baa`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-1013::DEBUG::2013-03-01 13:08:37,513::task::957::TaskManager.Task::(_decref) Task=`7609db94-5051-4283-a821-f070b88a1baa`::ref 1 aborting False >Thread-1013::INFO::2013-03-01 13:08:37,513::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 41b11cc6-b020-47d9-b70e-c4fadcc621be >Dummy-173::INFO::2013-03-01 13:08:37,941::storage_mailbox::692::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-105::DEBUG::2013-03-01 13:08:38,620::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-105::INFO::2013-03-01 13:08:38,620::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >Thread-135::INFO::2013-03-01 13:08:38,815::storage_mailbox::447::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-135::INFO::2013-03-01 13:08:38,816::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-135::DEBUG::2013-03-01 13:08:38,816::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-105::DEBUG::2013-03-01 13:08:40,622::clusterlock::206::SANLock::(releaseHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 released successfully (id: 1) >Thread-1013::INFO::2013-03-01 13:08:40,622::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-1013::DEBUG::2013-03-01 13:08:40,623::task::1151::TaskManager.Task::(prepare) Task=`7609db94-5051-4283-a821-f070b88a1baa`::finished: True >Thread-1013::DEBUG::2013-03-01 13:08:40,623::task::568::TaskManager.Task::(_updateState) Task=`7609db94-5051-4283-a821-f070b88a1baa`::moving from state preparing -> state finished >Thread-1013::DEBUG::2013-03-01 13:08:40,623::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-1013::DEBUG::2013-03-01 13:08:40,624::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1013::DEBUG::2013-03-01 13:08:40,624::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1013::DEBUG::2013-03-01 13:08:40,624::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1013::DEBUG::2013-03-01 13:08:40,625::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1013::DEBUG::2013-03-01 13:08:40,625::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1013::DEBUG::2013-03-01 13:08:40,625::task::957::TaskManager.Task::(_decref) Task=`7609db94-5051-4283-a821-f070b88a1baa`::ref 0 aborting False >Thread-1015::DEBUG::2013-03-01 13:08:40,669::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1015::DEBUG::2013-03-01 13:08:40,669::task::568::TaskManager.Task::(_updateState) Task=`60e2de4d-1c5d-4dd6-9a03-dec4d18e541d`::moving from state init -> state preparing >Thread-1015::INFO::2013-03-01 13:08:40,670::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >MainProcess|Thread-1015::ERROR::2013-03-01 13:08:40,672::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-1015::DEBUG::2013-03-01 13:08:40,681::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 1 -u' (cwd None) >Thread-1015::DEBUG::2013-03-01 13:08:41,256::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1015::DEBUG::2013-03-01 13:08:41,257::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1015::DEBUG::2013-03-01 13:08:41,257::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1015::DEBUG::2013-03-01 13:08:41,258::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1015::DEBUG::2013-03-01 13:08:41,258::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1015::DEBUG::2013-03-01 13:08:41,258::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1015::DEBUG::2013-03-01 13:08:41,276::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1015::DEBUG::2013-03-01 13:08:41,276::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:41,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:42,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-1016::DEBUG::2013-03-01 13:08:43,043::task::568::TaskManager.Task::(_updateState) Task=`8caadf44-92de-4c38-be6d-cd67e21a38f9`::moving from state init -> state preparing >Thread-1016::INFO::2013-03-01 13:08:43,044::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1016::INFO::2013-03-01 13:08:43,044::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1016::DEBUG::2013-03-01 13:08:43,044::task::1151::TaskManager.Task::(prepare) Task=`8caadf44-92de-4c38-be6d-cd67e21a38f9`::finished: {} >Thread-1016::DEBUG::2013-03-01 13:08:43,044::task::568::TaskManager.Task::(_updateState) Task=`8caadf44-92de-4c38-be6d-cd67e21a38f9`::moving from state preparing -> state finished >Thread-1016::DEBUG::2013-03-01 13:08:43,044::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1016::DEBUG::2013-03-01 13:08:43,045::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1016::DEBUG::2013-03-01 13:08:43,045::task::957::TaskManager.Task::(_decref) Task=`8caadf44-92de-4c38-be6d-cd67e21a38f9`::ref 0 aborting False >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:43,286::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:43,290::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:43,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:43,296::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1015::DEBUG::2013-03-01 13:08:43,298::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1015::DEBUG::2013-03-01 13:08:45,302::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1015::DEBUG::2013-03-01 13:08:46,678::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1015::DEBUG::2013-03-01 13:08:46,678::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1015::DEBUG::2013-03-01 13:08:46,679::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1015::DEBUG::2013-03-01 13:08:46,679::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1015::DEBUG::2013-03-01 13:08:46,679::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1015::DEBUG::2013-03-01 13:08:46,680::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1015::DEBUG::2013-03-01 13:08:46,680::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1015::DEBUG::2013-03-01 13:08:46,680::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1015::INFO::2013-03-01 13:08:46,681::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1015::DEBUG::2013-03-01 13:08:46,681::task::1151::TaskManager.Task::(prepare) Task=`60e2de4d-1c5d-4dd6-9a03-dec4d18e541d`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1015::DEBUG::2013-03-01 13:08:46,681::task::568::TaskManager.Task::(_updateState) Task=`60e2de4d-1c5d-4dd6-9a03-dec4d18e541d`::moving from state preparing -> state finished >Thread-1015::DEBUG::2013-03-01 13:08:46,681::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1015::DEBUG::2013-03-01 13:08:46,682::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1015::DEBUG::2013-03-01 13:08:46,682::task::957::TaskManager.Task::(_decref) Task=`60e2de4d-1c5d-4dd6-9a03-dec4d18e541d`::ref 0 aborting False >Thread-1019::DEBUG::2013-03-01 13:08:47,656::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1019::DEBUG::2013-03-01 13:08:47,657::task::568::TaskManager.Task::(_updateState) Task=`888991f6-2d85-4121-9678-958fcf7565be`::moving from state init -> state preparing >Thread-1019::INFO::2013-03-01 13:08:47,696::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-1019::DEBUG::2013-03-01 13:08:47,697::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-1019::DEBUG::2013-03-01 13:08:47,722::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1019::DEBUG::2013-03-01 13:08:47,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-1019::DEBUG::2013-03-01 13:08:48,281::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1019::DEBUG::2013-03-01 13:08:48,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-1019::DEBUG::2013-03-01 13:08:48,298::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1019::INFO::2013-03-01 13:08:48,298::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1019::DEBUG::2013-03-01 13:08:48,299::task::1151::TaskManager.Task::(prepare) Task=`888991f6-2d85-4121-9678-958fcf7565be`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1019::DEBUG::2013-03-01 13:08:48,299::task::568::TaskManager.Task::(_updateState) Task=`888991f6-2d85-4121-9678-958fcf7565be`::moving from state preparing -> state finished >Thread-1019::DEBUG::2013-03-01 13:08:48,299::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1019::DEBUG::2013-03-01 13:08:48,299::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1019::DEBUG::2013-03-01 13:08:48,300::task::957::TaskManager.Task::(_decref) Task=`888991f6-2d85-4121-9678-958fcf7565be`::ref 0 aborting False >Thread-1020::DEBUG::2013-03-01 13:08:48,328::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1020::DEBUG::2013-03-01 13:08:48,329::task::568::TaskManager.Task::(_updateState) Task=`840ea501-160e-4c85-b5a7-09a45152cfdb`::moving from state init -> state preparing >Thread-1020::INFO::2013-03-01 13:08:48,330::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', hostID=1, scsiKey='41b11cc6-b020-47d9-b70e-c4fadcc621be', msdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', masterVersion=1, options=None) >Thread-1020::DEBUG::2013-03-01 13:08:48,331::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2d8debd5-e360-4d1a-a398-e2b04b7ad7b6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1020::DEBUG::2013-03-01 13:08:48,331::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1020::DEBUG::2013-03-01 13:08:48,332::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1020::DEBUG::2013-03-01 13:08:48,332::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`2d8debd5-e360-4d1a-a398-e2b04b7ad7b6`::Granted request >Thread-1020::INFO::2013-03-01 13:08:48,333::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 41b11cc6-b020-47d9-b70e-c4fadcc621be with master domain: a558fc2a-a4a3-4118-9b81-d1d601eaa295 (ver = 1) >Thread-1020::DEBUG::2013-03-01 13:08:48,334::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:08:48,335::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:08:48,335::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:08:48,336::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:08:48,336::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:08:48,337::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:08:48,337::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1020::DEBUG::2013-03-01 13:08:48,338::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1020::DEBUG::2013-03-01 13:08:48,338::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1020::DEBUG::2013-03-01 13:08:48,339::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1020::DEBUG::2013-03-01 13:08:48,339::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:08:48,380::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:08:48,381::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1020::DEBUG::2013-03-01 13:08:48,385::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1020::DEBUG::2013-03-01 13:08:49,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1020::DEBUG::2013-03-01 13:08:50,397::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1020::DEBUG::2013-03-01 13:08:51,834::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1020::DEBUG::2013-03-01 13:08:52,839::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1020::DEBUG::2013-03-01 13:08:58,684::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1020::DEBUG::2013-03-01 13:09:16,676::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host7/scan' (cwd None) >Thread-1024::DEBUG::2013-03-01 13:09:18,702::task::568::TaskManager.Task::(_updateState) Task=`3e5bb7a7-8fac-4f7b-8598-63f45e4ed875`::moving from state init -> state preparing >MainProcess|Thread-1020::DEBUG::2013-03-01 13:09:42,321::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1024::INFO::2013-03-01 13:09:42,324::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1024::INFO::2013-03-01 13:09:42,324::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1024::DEBUG::2013-03-01 13:09:42,324::task::1151::TaskManager.Task::(prepare) Task=`3e5bb7a7-8fac-4f7b-8598-63f45e4ed875`::finished: {} >Thread-1024::DEBUG::2013-03-01 13:09:42,325::task::568::TaskManager.Task::(_updateState) Task=`3e5bb7a7-8fac-4f7b-8598-63f45e4ed875`::moving from state preparing -> state finished >Thread-1024::DEBUG::2013-03-01 13:09:42,325::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1024::DEBUG::2013-03-01 13:09:42,325::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1024::DEBUG::2013-03-01 13:09:42,325::task::957::TaskManager.Task::(_decref) Task=`3e5bb7a7-8fac-4f7b-8598-63f45e4ed875`::ref 0 aborting False >Thread-1020::DEBUG::2013-03-01 13:09:44,324::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:35,861::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:35,862::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,866::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,866::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,867::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,867::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,867::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,868::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1020::DEBUG::2013-03-01 13:10:35,868::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:35,872::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,088::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,090::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,090::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-1020::DEBUG::2013-03-01 13:10:36,092::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,101::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000317757 s, 6.4 MB/s\n'; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,103::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000317757 s, 6.4 MB/s'], size: 2048 >Thread-1020::DEBUG::2013-03-01 13:10:36,103::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-1020::WARNING::2013-03-01 13:10:36,103::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1020::DEBUG::2013-03-01 13:10:36,105::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-1020::DEBUG::2013-03-01 13:10:36,105::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,105::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,106::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,106::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,106::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,107::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,288::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,289::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,290::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=0', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a', 'POOL_SPM_ID=-1'] >Thread-1020::DEBUG::2013-03-01 13:10:36,290::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,291::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,475::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,475::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-1020::WARNING::2013-03-01 13:10:36,476::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-1020::WARNING::2013-03-01 13:10:36,476::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-1020::WARNING::2013-03-01 13:10:36,476::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-1020::DEBUG::2013-03-01 13:10:36,477::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 verified, version 1 >Thread-1020::DEBUG::2013-03-01 13:10:36,477::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1020::DEBUG::2013-03-01 13:10:36,477::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1020::DEBUG::2013-03-01 13:10:36,478::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,478::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,478::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,478::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,479::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,479::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,662::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,664::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,664::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=0', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a', 'POOL_SPM_ID=-1'] >Thread-1020::DEBUG::2013-03-01 13:10:36,665::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `41b11cc6-b020-47d9-b70e-c4fadcc621be` started monitoring domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >Thread-1029::DEBUG::2013-03-01 13:10:36,666::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1020::DEBUG::2013-03-01 13:10:36,667::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1029::DEBUG::2013-03-01 13:10:36,669::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,677::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1020::DEBUG::2013-03-01 13:10:36,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-1029::DEBUG::2013-03-01 13:10:36,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1029::DEBUG::2013-03-01 13:10:36,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-1029::DEBUG::2013-03-01 13:10:36,866::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000339998 s, 12.0 MB/s\n'; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,871::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:36,876::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1029::INFO::2013-03-01 13:10:36,893::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >Thread-1029::DEBUG::2013-03-01 13:10:36,899::clusterlock::191::SANLock::(acquireHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 1) >Thread-1020::WARNING::2013-03-01 13:10:36,928::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >Thread-1020::WARNING::2013-03-01 13:10:36,929::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >Thread-1020::INFO::2013-03-01 13:10:36,929::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1020::INFO::2013-03-01 13:10:36,930::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295 to /rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd >Thread-1020::DEBUG::2013-03-01 13:10:36,930::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-1020::DEBUG::2013-03-01 13:10:36,933::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:36,940::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00143104 s, 2.9 MB/s\n'; <rc> = 0 >Thread-1020::INFO::2013-03-01 13:10:36,941::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-1020::DEBUG::2013-03-01 13:10:36,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-1020::DEBUG::2013-03-01 13:10:37,949::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00201 s, 4.1 kB/s\n'; <rc> = 0 >Thread-1020::DEBUG::2013-03-01 13:10:37,950::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-1020::DEBUG::2013-03-01 13:10:37,951::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be on master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1020::DEBUG::2013-03-01 13:10:37,951::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1020::DEBUG::2013-03-01 13:10:37,952::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1020::DEBUG::2013-03-01 13:10:37,952::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1020::DEBUG::2013-03-01 13:10:37,952::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1020::INFO::2013-03-01 13:10:37,953::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-1020::DEBUG::2013-03-01 13:10:37,953::task::1151::TaskManager.Task::(prepare) Task=`840ea501-160e-4c85-b5a7-09a45152cfdb`::finished: True >Thread-1020::DEBUG::2013-03-01 13:10:37,953::task::568::TaskManager.Task::(_updateState) Task=`840ea501-160e-4c85-b5a7-09a45152cfdb`::moving from state preparing -> state finished >Thread-1020::DEBUG::2013-03-01 13:10:37,954::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1020::DEBUG::2013-03-01 13:10:37,954::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1020::DEBUG::2013-03-01 13:10:37,954::task::957::TaskManager.Task::(_decref) Task=`840ea501-160e-4c85-b5a7-09a45152cfdb`::ref 0 aborting False >Thread-1060::DEBUG::2013-03-01 13:10:38,060::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1060::DEBUG::2013-03-01 13:10:38,061::task::568::TaskManager.Task::(_updateState) Task=`1ebec662-c788-4d31-9528-a96ba49c51c3`::moving from state init -> state preparing >Thread-1060::INFO::2013-03-01 13:10:38,061::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-1060::INFO::2013-03-01 13:10:38,061::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-1060::DEBUG::2013-03-01 13:10:38,062::task::1151::TaskManager.Task::(prepare) Task=`1ebec662-c788-4d31-9528-a96ba49c51c3`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-1060::DEBUG::2013-03-01 13:10:38,062::task::568::TaskManager.Task::(_updateState) Task=`1ebec662-c788-4d31-9528-a96ba49c51c3`::moving from state preparing -> state finished >Thread-1060::DEBUG::2013-03-01 13:10:38,062::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1060::DEBUG::2013-03-01 13:10:38,062::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1060::DEBUG::2013-03-01 13:10:38,062::task::957::TaskManager.Task::(_decref) Task=`1ebec662-c788-4d31-9528-a96ba49c51c3`::ref 0 aborting False >Thread-1061::DEBUG::2013-03-01 13:10:38,095::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1061::DEBUG::2013-03-01 13:10:38,095::task::568::TaskManager.Task::(_updateState) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::moving from state init -> state preparing >Thread-1061::INFO::2013-03-01 13:10:38,096::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-1061::DEBUG::2013-03-01 13:10:38,096::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`28fa8f00-d84a-4071-b62d-763b890dd9bc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1061::DEBUG::2013-03-01 13:10:38,097::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1061::DEBUG::2013-03-01 13:10:38,097::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1061::DEBUG::2013-03-01 13:10:38,097::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`28fa8f00-d84a-4071-b62d-763b890dd9bc`::Granted request >Thread-1061::DEBUG::2013-03-01 13:10:38,098::task::794::TaskManager.Task::(resourceAcquired) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-1061::DEBUG::2013-03-01 13:10:38,098::task::957::TaskManager.Task::(_decref) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::ref 1 aborting False >Thread-1061::INFO::2013-03-01 13:10:38,098::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-1061::DEBUG::2013-03-01 13:10:38,098::task::1146::TaskManager.Task::(prepare) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::Prepare: 1 jobs exist, move to acquiring >Thread-1061::DEBUG::2013-03-01 13:10:38,098::task::568::TaskManager.Task::(_updateState) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::moving from state preparing -> state acquiring >Thread-1061::DEBUG::2013-03-01 13:10:38,099::task::568::TaskManager.Task::(_updateState) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::moving from state acquiring -> state queued >Thread-1061::DEBUG::2013-03-01 13:10:38,099::taskManager::50::TaskManager::(_queueTask) queuing task: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1061::DEBUG::2013-03-01 13:10:38,099::taskManager::56::TaskManager::(_queueTask) task queued: 393cad59-335f-4f65-97c8-597d9d0e5467 >cd1e07ab-eb31-4958-8748-09d42d1daade::DEBUG::2013-03-01 13:10:38,100::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-1061::DEBUG::2013-03-01 13:10:38,100::task::1148::TaskManager.Task::(prepare) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::returning >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,101::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 393cad59-335f-4f65-97c8-597d9d0e5467 running: <bound method Task.commit of <storage.task.Task instance at 0x178f3b0>> with: None >Thread-1061::DEBUG::2013-03-01 13:10:38,102::task::957::TaskManager.Task::(_decref) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,102::task::1159::TaskManager.Task::(commit) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::committing task: 393cad59-335f-4f65-97c8-597d9d0e5467 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,103::task::568::TaskManager.Task::(_updateState) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::moving from state queued -> state running >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,110::task::872::TaskManager.Task::(_runJobs) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x165dd10>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,111::task::304::TaskManager.Task::(run) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x165dd10>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,112::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,113::misc::1055::SamplingMethod::(__call__) Got in to sampling method >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,114::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,114::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,115::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,115::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,115::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,116::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,291::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,292::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,293::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=0', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a', 'POOL_SPM_ID=-1'] >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,293::misc::1063::SamplingMethod::(__call__) Returning last result >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,294::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,294::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,294::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,295::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,295::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,295::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,475::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,477::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:38,477::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=0', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a', 'POOL_SPM_ID=-1'] >393cad59-335f-4f65-97c8-597d9d0e5467::INFO::2013-03-01 13:10:38,478::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >Thread-1062::DEBUG::2013-03-01 13:10:39,135::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1063::DEBUG::2013-03-01 13:10:39,803::task::568::TaskManager.Task::(_updateState) Task=`99f1a16a-79b5-42f3-8b36-c0d21bbe60ea`::moving from state init -> state preparing >Thread-1063::INFO::2013-03-01 13:10:39,839::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1063::INFO::2013-03-01 13:10:39,840::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.01069688797', 'lastCheck': '2.9', 'code': 0, 'valid': True}} >Thread-1063::DEBUG::2013-03-01 13:10:39,840::task::1151::TaskManager.Task::(prepare) Task=`99f1a16a-79b5-42f3-8b36-c0d21bbe60ea`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.01069688797', 'lastCheck': '2.9', 'code': 0, 'valid': True}} >Thread-1063::DEBUG::2013-03-01 13:10:39,840::task::568::TaskManager.Task::(_updateState) Task=`99f1a16a-79b5-42f3-8b36-c0d21bbe60ea`::moving from state preparing -> state finished >Thread-1063::DEBUG::2013-03-01 13:10:39,840::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1063::DEBUG::2013-03-01 13:10:39,841::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1063::DEBUG::2013-03-01 13:10:39,841::task::957::TaskManager.Task::(_decref) Task=`99f1a16a-79b5-42f3-8b36-c0d21bbe60ea`::ref 0 aborting False >Thread-1062::DEBUG::2013-03-01 13:10:39,839::task::568::TaskManager.Task::(_updateState) Task=`39988faf-eb30-4760-a6be-c919b5d26f87`::moving from state init -> state preparing >Thread-1062::INFO::2013-03-01 13:10:39,845::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1062::DEBUG::2013-03-01 13:10:39,845::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1062::DEBUG::2013-03-01 13:10:39,845::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1062::INFO::2013-03-01 13:10:39,846::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1062::DEBUG::2013-03-01 13:10:39,846::task::1151::TaskManager.Task::(prepare) Task=`39988faf-eb30-4760-a6be-c919b5d26f87`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1062::DEBUG::2013-03-01 13:10:39,846::task::568::TaskManager.Task::(_updateState) Task=`39988faf-eb30-4760-a6be-c919b5d26f87`::moving from state preparing -> state finished >Thread-1062::DEBUG::2013-03-01 13:10:39,846::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1062::DEBUG::2013-03-01 13:10:39,847::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1062::DEBUG::2013-03-01 13:10:39,847::task::957::TaskManager.Task::(_decref) Task=`39988faf-eb30-4760-a6be-c919b5d26f87`::ref 0 aborting False >Thread-1065::DEBUG::2013-03-01 13:10:40,874::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1065::DEBUG::2013-03-01 13:10:40,875::task::568::TaskManager.Task::(_updateState) Task=`4cfae008-c67f-46ba-aecc-aeebabdef222`::moving from state init -> state preparing >Thread-1065::INFO::2013-03-01 13:10:40,875::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1065::DEBUG::2013-03-01 13:10:40,875::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1065::DEBUG::2013-03-01 13:10:40,875::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1065::INFO::2013-03-01 13:10:40,875::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1065::DEBUG::2013-03-01 13:10:40,876::task::1151::TaskManager.Task::(prepare) Task=`4cfae008-c67f-46ba-aecc-aeebabdef222`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1065::DEBUG::2013-03-01 13:10:40,876::task::568::TaskManager.Task::(_updateState) Task=`4cfae008-c67f-46ba-aecc-aeebabdef222`::moving from state preparing -> state finished >Thread-1065::DEBUG::2013-03-01 13:10:40,876::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1065::DEBUG::2013-03-01 13:10:40,876::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1065::DEBUG::2013-03-01 13:10:40,876::task::957::TaskManager.Task::(_decref) Task=`4cfae008-c67f-46ba-aecc-aeebabdef222`::ref 0 aborting False >Thread-1066::DEBUG::2013-03-01 13:10:41,903::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1066::DEBUG::2013-03-01 13:10:41,903::task::568::TaskManager.Task::(_updateState) Task=`124fa0f2-a942-49e0-98b4-e26854936ddf`::moving from state init -> state preparing >Thread-1066::INFO::2013-03-01 13:10:41,904::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1066::DEBUG::2013-03-01 13:10:41,904::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1066::DEBUG::2013-03-01 13:10:41,904::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1066::INFO::2013-03-01 13:10:41,904::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1066::DEBUG::2013-03-01 13:10:41,904::task::1151::TaskManager.Task::(prepare) Task=`124fa0f2-a942-49e0-98b4-e26854936ddf`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1066::DEBUG::2013-03-01 13:10:41,904::task::568::TaskManager.Task::(_updateState) Task=`124fa0f2-a942-49e0-98b4-e26854936ddf`::moving from state preparing -> state finished >Thread-1066::DEBUG::2013-03-01 13:10:41,905::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1066::DEBUG::2013-03-01 13:10:41,905::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1066::DEBUG::2013-03-01 13:10:41,905::task::957::TaskManager.Task::(_decref) Task=`124fa0f2-a942-49e0-98b4-e26854936ddf`::ref 0 aborting False >Thread-1068::DEBUG::2013-03-01 13:10:42,936::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1068::DEBUG::2013-03-01 13:10:42,937::task::568::TaskManager.Task::(_updateState) Task=`65cf1ab8-9010-423f-8b57-56b4c102dfd9`::moving from state init -> state preparing >Thread-1068::INFO::2013-03-01 13:10:42,937::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1068::DEBUG::2013-03-01 13:10:42,938::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1068::DEBUG::2013-03-01 13:10:42,938::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1068::INFO::2013-03-01 13:10:42,939::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1068::DEBUG::2013-03-01 13:10:42,939::task::1151::TaskManager.Task::(prepare) Task=`65cf1ab8-9010-423f-8b57-56b4c102dfd9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1068::DEBUG::2013-03-01 13:10:42,939::task::568::TaskManager.Task::(_updateState) Task=`65cf1ab8-9010-423f-8b57-56b4c102dfd9`::moving from state preparing -> state finished >Thread-1068::DEBUG::2013-03-01 13:10:42,939::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1068::DEBUG::2013-03-01 13:10:42,939::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1068::DEBUG::2013-03-01 13:10:42,940::task::957::TaskManager.Task::(_decref) Task=`65cf1ab8-9010-423f-8b57-56b4c102dfd9`::ref 0 aborting False >Thread-1069::DEBUG::2013-03-01 13:10:43,966::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1069::DEBUG::2013-03-01 13:10:43,967::task::568::TaskManager.Task::(_updateState) Task=`3f879ee9-490c-4bc3-bafd-ed59bb125d68`::moving from state init -> state preparing >Thread-1069::INFO::2013-03-01 13:10:43,967::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1069::DEBUG::2013-03-01 13:10:43,967::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1069::DEBUG::2013-03-01 13:10:43,967::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1069::INFO::2013-03-01 13:10:43,967::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1069::DEBUG::2013-03-01 13:10:43,967::task::1151::TaskManager.Task::(prepare) Task=`3f879ee9-490c-4bc3-bafd-ed59bb125d68`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1069::DEBUG::2013-03-01 13:10:43,968::task::568::TaskManager.Task::(_updateState) Task=`3f879ee9-490c-4bc3-bafd-ed59bb125d68`::moving from state preparing -> state finished >Thread-1069::DEBUG::2013-03-01 13:10:43,968::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1069::DEBUG::2013-03-01 13:10:43,968::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1069::DEBUG::2013-03-01 13:10:43,968::task::957::TaskManager.Task::(_decref) Task=`3f879ee9-490c-4bc3-bafd-ed59bb125d68`::ref 0 aborting False >Thread-1070::DEBUG::2013-03-01 13:10:44,995::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1070::DEBUG::2013-03-01 13:10:45,090::task::568::TaskManager.Task::(_updateState) Task=`e51abf58-1305-403b-9bb7-91bf14249e34`::moving from state init -> state preparing >Thread-1070::INFO::2013-03-01 13:10:45,090::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1070::DEBUG::2013-03-01 13:10:45,090::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1070::DEBUG::2013-03-01 13:10:45,091::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1070::INFO::2013-03-01 13:10:45,091::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1070::DEBUG::2013-03-01 13:10:45,091::task::1151::TaskManager.Task::(prepare) Task=`e51abf58-1305-403b-9bb7-91bf14249e34`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1070::DEBUG::2013-03-01 13:10:45,091::task::568::TaskManager.Task::(_updateState) Task=`e51abf58-1305-403b-9bb7-91bf14249e34`::moving from state preparing -> state finished >Thread-1070::DEBUG::2013-03-01 13:10:45,092::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1070::DEBUG::2013-03-01 13:10:45,092::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1070::DEBUG::2013-03-01 13:10:45,092::task::957::TaskManager.Task::(_decref) Task=`e51abf58-1305-403b-9bb7-91bf14249e34`::ref 0 aborting False >Thread-1072::DEBUG::2013-03-01 13:10:46,122::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1072::DEBUG::2013-03-01 13:10:46,122::task::568::TaskManager.Task::(_updateState) Task=`d3fbbcce-6db6-40d3-8be7-cf24228df6a8`::moving from state init -> state preparing >Thread-1072::INFO::2013-03-01 13:10:46,123::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1072::DEBUG::2013-03-01 13:10:46,123::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1072::DEBUG::2013-03-01 13:10:46,123::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1072::INFO::2013-03-01 13:10:46,124::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1072::DEBUG::2013-03-01 13:10:46,124::task::1151::TaskManager.Task::(prepare) Task=`d3fbbcce-6db6-40d3-8be7-cf24228df6a8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1072::DEBUG::2013-03-01 13:10:46,124::task::568::TaskManager.Task::(_updateState) Task=`d3fbbcce-6db6-40d3-8be7-cf24228df6a8`::moving from state preparing -> state finished >Thread-1072::DEBUG::2013-03-01 13:10:46,125::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1072::DEBUG::2013-03-01 13:10:46,125::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1072::DEBUG::2013-03-01 13:10:46,126::task::957::TaskManager.Task::(_decref) Task=`d3fbbcce-6db6-40d3-8be7-cf24228df6a8`::ref 0 aborting False >Thread-1029::DEBUG::2013-03-01 13:10:46,904::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-1029::DEBUG::2013-03-01 13:10:46,919::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00034666 s, 11.8 MB/s\n'; <rc> = 0 >Thread-1073::DEBUG::2013-03-01 13:10:47,155::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1073::DEBUG::2013-03-01 13:10:47,162::task::568::TaskManager.Task::(_updateState) Task=`c93c862c-2dff-45f5-9635-6ffead5dd414`::moving from state init -> state preparing >Thread-1073::INFO::2013-03-01 13:10:47,163::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1073::DEBUG::2013-03-01 13:10:47,163::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1073::DEBUG::2013-03-01 13:10:47,163::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1073::INFO::2013-03-01 13:10:47,164::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1073::DEBUG::2013-03-01 13:10:47,164::task::1151::TaskManager.Task::(prepare) Task=`c93c862c-2dff-45f5-9635-6ffead5dd414`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1073::DEBUG::2013-03-01 13:10:47,164::task::568::TaskManager.Task::(_updateState) Task=`c93c862c-2dff-45f5-9635-6ffead5dd414`::moving from state preparing -> state finished >Thread-1073::DEBUG::2013-03-01 13:10:47,165::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1073::DEBUG::2013-03-01 13:10:47,165::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1073::DEBUG::2013-03-01 13:10:47,165::task::957::TaskManager.Task::(_decref) Task=`c93c862c-2dff-45f5-9635-6ffead5dd414`::ref 0 aborting False >Thread-1074::DEBUG::2013-03-01 13:10:48,198::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1074::DEBUG::2013-03-01 13:10:48,199::task::568::TaskManager.Task::(_updateState) Task=`73ca07ae-d0ac-4feb-89e6-9ee035b9b643`::moving from state init -> state preparing >Thread-1074::INFO::2013-03-01 13:10:48,199::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1074::DEBUG::2013-03-01 13:10:48,199::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1074::DEBUG::2013-03-01 13:10:48,199::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1074::INFO::2013-03-01 13:10:48,200::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1074::DEBUG::2013-03-01 13:10:48,200::task::1151::TaskManager.Task::(prepare) Task=`73ca07ae-d0ac-4feb-89e6-9ee035b9b643`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1074::DEBUG::2013-03-01 13:10:48,200::task::568::TaskManager.Task::(_updateState) Task=`73ca07ae-d0ac-4feb-89e6-9ee035b9b643`::moving from state preparing -> state finished >Thread-1074::DEBUG::2013-03-01 13:10:48,200::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1074::DEBUG::2013-03-01 13:10:48,200::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1074::DEBUG::2013-03-01 13:10:48,201::task::957::TaskManager.Task::(_decref) Task=`73ca07ae-d0ac-4feb-89e6-9ee035b9b643`::ref 0 aborting False >Thread-1076::DEBUG::2013-03-01 13:10:49,228::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1076::DEBUG::2013-03-01 13:10:49,229::task::568::TaskManager.Task::(_updateState) Task=`1dbd7949-6ff5-4718-93df-62cb28ecc7f8`::moving from state init -> state preparing >Thread-1076::INFO::2013-03-01 13:10:49,229::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1076::DEBUG::2013-03-01 13:10:49,229::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1076::DEBUG::2013-03-01 13:10:49,230::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1076::INFO::2013-03-01 13:10:49,230::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1076::DEBUG::2013-03-01 13:10:49,230::task::1151::TaskManager.Task::(prepare) Task=`1dbd7949-6ff5-4718-93df-62cb28ecc7f8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1076::DEBUG::2013-03-01 13:10:49,230::task::568::TaskManager.Task::(_updateState) Task=`1dbd7949-6ff5-4718-93df-62cb28ecc7f8`::moving from state preparing -> state finished >Thread-1076::DEBUG::2013-03-01 13:10:49,230::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1076::DEBUG::2013-03-01 13:10:49,231::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1076::DEBUG::2013-03-01 13:10:49,231::task::957::TaskManager.Task::(_decref) Task=`1dbd7949-6ff5-4718-93df-62cb28ecc7f8`::ref 0 aborting False >Thread-1077::DEBUG::2013-03-01 13:10:50,258::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1077::DEBUG::2013-03-01 13:10:50,259::task::568::TaskManager.Task::(_updateState) Task=`0e1ae858-2334-4318-91ec-ef61516bf5ff`::moving from state init -> state preparing >Thread-1077::INFO::2013-03-01 13:10:50,259::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1077::DEBUG::2013-03-01 13:10:50,259::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1077::DEBUG::2013-03-01 13:10:50,260::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1077::INFO::2013-03-01 13:10:50,260::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1077::DEBUG::2013-03-01 13:10:50,260::task::1151::TaskManager.Task::(prepare) Task=`0e1ae858-2334-4318-91ec-ef61516bf5ff`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1077::DEBUG::2013-03-01 13:10:50,260::task::568::TaskManager.Task::(_updateState) Task=`0e1ae858-2334-4318-91ec-ef61516bf5ff`::moving from state preparing -> state finished >Thread-1077::DEBUG::2013-03-01 13:10:50,261::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1077::DEBUG::2013-03-01 13:10:50,261::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1077::DEBUG::2013-03-01 13:10:50,261::task::957::TaskManager.Task::(_decref) Task=`0e1ae858-2334-4318-91ec-ef61516bf5ff`::ref 0 aborting False >Thread-1078::DEBUG::2013-03-01 13:10:51,288::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,481::clusterlock::191::SANLock::(acquireHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 1) >Thread-1078::DEBUG::2013-03-01 13:10:58,526::task::568::TaskManager.Task::(_updateState) Task=`298376ca-9fc3-4ea2-b39a-8213d7317636`::moving from state init -> state preparing >Thread-1078::INFO::2013-03-01 13:10:58,528::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1078::DEBUG::2013-03-01 13:10:58,529::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1078::DEBUG::2013-03-01 13:10:58,529::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1078::INFO::2013-03-01 13:10:58,529::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1078::DEBUG::2013-03-01 13:10:58,529::task::1151::TaskManager.Task::(prepare) Task=`298376ca-9fc3-4ea2-b39a-8213d7317636`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1078::DEBUG::2013-03-01 13:10:58,530::task::568::TaskManager.Task::(_updateState) Task=`298376ca-9fc3-4ea2-b39a-8213d7317636`::moving from state preparing -> state finished >Thread-1078::DEBUG::2013-03-01 13:10:58,530::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1078::DEBUG::2013-03-01 13:10:58,530::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1078::DEBUG::2013-03-01 13:10:58,530::task::957::TaskManager.Task::(_decref) Task=`298376ca-9fc3-4ea2-b39a-8213d7317636`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:10:58,529::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/images already exists >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:10:58,534::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/dom_md already exists >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,535::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,535::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,536::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,536::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,536::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,536::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,545::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000302252 s, 6.8 MB/s\n'; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,545::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000302252 s, 6.8 MB/s'], size: 2048 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,545::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:10:58,545::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,550::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,550::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,550::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,551::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,551::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,551::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:10:58,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1080::DEBUG::2013-03-01 13:10:59,558::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1080::DEBUG::2013-03-01 13:11:20,274::task::568::TaskManager.Task::(_updateState) Task=`9e4a1870-0dce-41fb-8f9c-a2a8d8f92866`::moving from state init -> state preparing >Thread-1081::DEBUG::2013-03-01 13:11:01,556::task::568::TaskManager.Task::(_updateState) Task=`bf872d70-d656-48ae-9969-ac61e474fb2f`::moving from state init -> state preparing >Thread-1029::DEBUG::2013-03-01 13:11:08,535::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-1080::INFO::2013-03-01 13:11:20,275::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1081::INFO::2013-03-01 13:11:20,276::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1029::DEBUG::2013-03-01 13:11:20,277::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1080::DEBUG::2013-03-01 13:11:20,277::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1081::INFO::2013-03-01 13:11:20,277::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.016270160675', 'lastCheck': '21.7', 'code': 0, 'valid': True}} >Thread-1080::DEBUG::2013-03-01 13:11:20,278::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1081::DEBUG::2013-03-01 13:11:20,278::task::1151::TaskManager.Task::(prepare) Task=`bf872d70-d656-48ae-9969-ac61e474fb2f`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.016270160675', 'lastCheck': '21.7', 'code': 0, 'valid': True}} >Thread-1080::INFO::2013-03-01 13:11:20,285::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1081::DEBUG::2013-03-01 13:11:20,286::task::568::TaskManager.Task::(_updateState) Task=`bf872d70-d656-48ae-9969-ac61e474fb2f`::moving from state preparing -> state finished >Thread-1080::DEBUG::2013-03-01 13:11:20,286::task::1151::TaskManager.Task::(prepare) Task=`9e4a1870-0dce-41fb-8f9c-a2a8d8f92866`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1081::DEBUG::2013-03-01 13:11:20,286::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1080::DEBUG::2013-03-01 13:11:20,287::task::568::TaskManager.Task::(_updateState) Task=`9e4a1870-0dce-41fb-8f9c-a2a8d8f92866`::moving from state preparing -> state finished >Thread-1081::DEBUG::2013-03-01 13:11:20,287::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1080::DEBUG::2013-03-01 13:11:20,287::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1081::DEBUG::2013-03-01 13:11:20,287::task::957::TaskManager.Task::(_decref) Task=`bf872d70-d656-48ae-9969-ac61e474fb2f`::ref 0 aborting False >Thread-1080::DEBUG::2013-03-01 13:11:20,288::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1080::DEBUG::2013-03-01 13:11:20,288::task::957::TaskManager.Task::(_decref) Task=`9e4a1870-0dce-41fb-8f9c-a2a8d8f92866`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:20,319::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:20,321::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=0', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a', 'POOL_SPM_ID=-1'] >393cad59-335f-4f65-97c8-597d9d0e5467::INFO::2013-03-01 13:11:20,321::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:20,332::clusterlock::248::SANLock::(acquire) Cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully acquired (id: 1) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:20,333::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:20,333::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-1083::DEBUG::2013-03-01 13:11:21,318::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1083::DEBUG::2013-03-01 13:11:42,072::task::568::TaskManager.Task::(_updateState) Task=`0feb87af-a2bd-4f33-b19b-8bf11fd219a4`::moving from state init -> state preparing >Thread-1083::INFO::2013-03-01 13:11:42,072::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1083::DEBUG::2013-03-01 13:11:42,072::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1083::DEBUG::2013-03-01 13:11:42,072::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1083::INFO::2013-03-01 13:11:42,073::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1083::DEBUG::2013-03-01 13:11:42,073::task::1151::TaskManager.Task::(prepare) Task=`0feb87af-a2bd-4f33-b19b-8bf11fd219a4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1083::DEBUG::2013-03-01 13:11:42,073::task::568::TaskManager.Task::(_updateState) Task=`0feb87af-a2bd-4f33-b19b-8bf11fd219a4`::moving from state preparing -> state finished >Thread-1083::DEBUG::2013-03-01 13:11:42,073::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1083::DEBUG::2013-03-01 13:11:42,073::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1083::DEBUG::2013-03-01 13:11:42,121::task::957::TaskManager.Task::(_decref) Task=`0feb87af-a2bd-4f33-b19b-8bf11fd219a4`::ref 0 aborting False >Thread-1029::DEBUG::2013-03-01 13:11:42,153::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1029::DEBUG::2013-03-01 13:11:42,155::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,162::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1029::DEBUG::2013-03-01 13:11:42,162::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,169::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,171::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,173::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,175::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,181::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1029::DEBUG::2013-03-01 13:11:42,189::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000284358 s, 14.4 MB/s\n'; <rc> = 0 >Thread-1029::DEBUG::2013-03-01 13:11:42,189::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-1029::DEBUG::2013-03-01 13:11:42,190::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,397::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,400::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=0', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', '_SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a', 'POOL_SPM_ID=-1'] >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,401::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,401::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,402::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=e8f514250318c772b40aeb6a79bc25ae7e793cfd'] >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,402::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-1029::DEBUG::2013-03-01 13:11:42,410::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1029::DEBUG::2013-03-01 13:11:42,411::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,412::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,412::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,412::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,412::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,413::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:42,413::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1085::DEBUG::2013-03-01 13:11:43,241::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1085::DEBUG::2013-03-01 13:11:43,254::task::568::TaskManager.Task::(_updateState) Task=`f741da2c-fd63-4545-bb34-7dd476c2d8e5`::moving from state init -> state preparing >Thread-1085::INFO::2013-03-01 13:11:43,259::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1085::DEBUG::2013-03-01 13:11:43,262::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1085::DEBUG::2013-03-01 13:11:43,266::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1085::INFO::2013-03-01 13:11:43,270::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1085::DEBUG::2013-03-01 13:11:43,273::task::1151::TaskManager.Task::(prepare) Task=`f741da2c-fd63-4545-bb34-7dd476c2d8e5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1085::DEBUG::2013-03-01 13:11:43,275::task::568::TaskManager.Task::(_updateState) Task=`f741da2c-fd63-4545-bb34-7dd476c2d8e5`::moving from state preparing -> state finished >Thread-1085::DEBUG::2013-03-01 13:11:43,278::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1085::DEBUG::2013-03-01 13:11:43,280::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1085::DEBUG::2013-03-01 13:11:43,283::task::957::TaskManager.Task::(_decref) Task=`f741da2c-fd63-4545-bb34-7dd476c2d8e5`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:43,938::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:43,989::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:44,002::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=e8f514250318c772b40aeb6a79bc25ae7e793cfd, MDT_POOL_SPM_LVER=1, MDT_POOL_SPM_ID=1 removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=0, MDT__SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:44,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=c29a6884f6697f8519ac0a0e7f36089adb46d65a --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=0 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=e8f514250318c772b40aeb6a79bc25ae7e793cfd --addtag MDT_POOL_SPM_LVER=1 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1086::DEBUG::2013-03-01 13:11:44,552::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1086::DEBUG::2013-03-01 13:11:44,565::task::568::TaskManager.Task::(_updateState) Task=`8117a9bb-2a71-441a-a783-10cbd4772467`::moving from state init -> state preparing >Thread-1086::INFO::2013-03-01 13:11:44,571::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1086::DEBUG::2013-03-01 13:11:44,573::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1086::DEBUG::2013-03-01 13:11:44,576::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1086::INFO::2013-03-01 13:11:44,580::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1086::DEBUG::2013-03-01 13:11:44,582::task::1151::TaskManager.Task::(prepare) Task=`8117a9bb-2a71-441a-a783-10cbd4772467`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1086::DEBUG::2013-03-01 13:11:44,586::task::568::TaskManager.Task::(_updateState) Task=`8117a9bb-2a71-441a-a783-10cbd4772467`::moving from state preparing -> state finished >Thread-1086::DEBUG::2013-03-01 13:11:44,589::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1086::DEBUG::2013-03-01 13:11:44,592::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1086::DEBUG::2013-03-01 13:11:44,595::task::957::TaskManager.Task::(_decref) Task=`8117a9bb-2a71-441a-a783-10cbd4772467`::ref 0 aborting False >Thread-1088::DEBUG::2013-03-01 13:11:45,634::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1088::DEBUG::2013-03-01 13:11:45,634::task::568::TaskManager.Task::(_updateState) Task=`8c5107eb-ae40-45ac-8097-382096be0ac6`::moving from state init -> state preparing >Thread-1088::INFO::2013-03-01 13:11:45,634::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1088::DEBUG::2013-03-01 13:11:45,635::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1088::DEBUG::2013-03-01 13:11:45,635::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1088::INFO::2013-03-01 13:11:45,635::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1088::DEBUG::2013-03-01 13:11:45,635::task::1151::TaskManager.Task::(prepare) Task=`8c5107eb-ae40-45ac-8097-382096be0ac6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1088::DEBUG::2013-03-01 13:11:45,635::task::568::TaskManager.Task::(_updateState) Task=`8c5107eb-ae40-45ac-8097-382096be0ac6`::moving from state preparing -> state finished >Thread-1088::DEBUG::2013-03-01 13:11:45,635::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1088::DEBUG::2013-03-01 13:11:45,636::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1088::DEBUG::2013-03-01 13:11:45,636::task::957::TaskManager.Task::(_decref) Task=`8c5107eb-ae40-45ac-8097-382096be0ac6`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,616::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,617::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,617::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,617::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,619::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`5c6a4b30-ea4f-47f8-934e-b43997e8d81d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,621::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,621::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,623::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`5c6a4b30-ea4f-47f8-934e-b43997e8d81d`::Granted request >393cad59-335f-4f65-97c8-597d9d0e5467::INFO::2013-03-01 13:11:46,624::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,625::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`49996f92-2561-4732-a024-aa1e67efd6e7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,626::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,628::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,629::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`49996f92-2561-4732-a024-aa1e67efd6e7`::Granted request >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,630::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,631::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1089::DEBUG::2013-03-01 13:11:46,663::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1089::DEBUG::2013-03-01 13:11:46,664::task::568::TaskManager.Task::(_updateState) Task=`91552c70-50dd-4947-ad3a-bf35efbb41c2`::moving from state init -> state preparing >Thread-1089::INFO::2013-03-01 13:11:46,664::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1089::DEBUG::2013-03-01 13:11:46,664::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1089::DEBUG::2013-03-01 13:11:46,665::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1089::INFO::2013-03-01 13:11:46,665::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1089::DEBUG::2013-03-01 13:11:46,665::task::1151::TaskManager.Task::(prepare) Task=`91552c70-50dd-4947-ad3a-bf35efbb41c2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1089::DEBUG::2013-03-01 13:11:46,665::task::568::TaskManager.Task::(_updateState) Task=`91552c70-50dd-4947-ad3a-bf35efbb41c2`::moving from state preparing -> state finished >Thread-1089::DEBUG::2013-03-01 13:11:46,665::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1089::DEBUG::2013-03-01 13:11:46,666::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1089::DEBUG::2013-03-01 13:11:46,666::task::957::TaskManager.Task::(_decref) Task=`91552c70-50dd-4947-ad3a-bf35efbb41c2`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,825::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,826::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,827::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,827::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,835::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000318646 s, 6.4 MB/s\n'; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,835::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000318646 s, 6.4 MB/s'], size: 2048 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,836::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:11:46,836::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,836::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,837::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,837::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,837::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,838::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,838::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:46,839::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,443::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,444::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=e8f514250318c772b40aeb6a79bc25ae7e793cfd', 'POOL_SPM_LVER=1'] >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:11:47,445::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:11:47,446::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:11:47,446::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,446::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,447::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,447::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,447::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,447::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,447::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,448::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,448::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,448::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,448::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,448::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >393cad59-335f-4f65-97c8-597d9d0e5467::WARNING::2013-03-01 13:11:47,449::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master already exists >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/fsck -p /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,492::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,493::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,508::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:47,508::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-1090::DEBUG::2013-03-01 13:11:47,694::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1029::DEBUG::2013-03-01 13:11:56,632::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1090::DEBUG::2013-03-01 13:11:58,992::task::568::TaskManager.Task::(_updateState) Task=`45de6342-823e-41e3-862f-1d291150c560`::moving from state init -> state preparing >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,001::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-1090::INFO::2013-03-01 13:11:59,018::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1090::DEBUG::2013-03-01 13:11:59,019::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1090::DEBUG::2013-03-01 13:11:59,020::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1090::INFO::2013-03-01 13:11:59,020::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1090::DEBUG::2013-03-01 13:11:59,020::task::1151::TaskManager.Task::(prepare) Task=`45de6342-823e-41e3-862f-1d291150c560`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1090::DEBUG::2013-03-01 13:11:59,020::task::568::TaskManager.Task::(_updateState) Task=`45de6342-823e-41e3-862f-1d291150c560`::moving from state preparing -> state finished >Thread-1090::DEBUG::2013-03-01 13:11:59,021::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1090::DEBUG::2013-03-01 13:11:59,021::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1090::DEBUG::2013-03-01 13:11:59,021::task::957::TaskManager.Task::(_decref) Task=`45de6342-823e-41e3-862f-1d291150c560`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,024::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,026::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,030::storage_mailbox::504::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,030::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329685 s, 31.1 MB/s\n'; <rc> = 0 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,071::storage_mailbox::511::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,072::sp::302::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 41b11cc6-b020-47d9-b70e-c4fadcc621be on master domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,073::sp::309::Storage.StoragePool::(startSpm) ended. >Dummy-1097::DEBUG::2013-03-01 13:11:59,072::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,074::task::568::TaskManager.Task::(_updateState) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::moving from state running -> state finished >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,082::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,084::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,087::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,089::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,090::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,091::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,093::task::880::TaskManager.Task::(_runJobs) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::Task.run: exit - success: result >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,094::task::957::TaskManager.Task::(_decref) Task=`393cad59-335f-4f65-97c8-597d9d0e5467`::ref 0 aborting False >393cad59-335f-4f65-97c8-597d9d0e5467::DEBUG::2013-03-01 13:11:59,096::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-1097::DEBUG::2013-03-01 13:11:59,169::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049621 s, 20.6 MB/s\n'; <rc> = 0 >Thread-1098::DEBUG::2013-03-01 13:12:00,050::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1098::DEBUG::2013-03-01 13:12:24,974::task::568::TaskManager.Task::(_updateState) Task=`ceb8930e-d698-40f5-8886-3f0bf62c00bf`::moving from state init -> state preparing >Thread-1098::INFO::2013-03-01 13:12:24,975::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1098::DEBUG::2013-03-01 13:12:24,975::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1098::DEBUG::2013-03-01 13:12:24,976::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'} >Thread-1098::INFO::2013-03-01 13:12:24,976::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1098::DEBUG::2013-03-01 13:12:24,976::task::1151::TaskManager.Task::(prepare) Task=`ceb8930e-d698-40f5-8886-3f0bf62c00bf`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '393cad59-335f-4f65-97c8-597d9d0e5467'}} >Thread-1098::DEBUG::2013-03-01 13:12:24,976::task::568::TaskManager.Task::(_updateState) Task=`ceb8930e-d698-40f5-8886-3f0bf62c00bf`::moving from state preparing -> state finished >Thread-1098::DEBUG::2013-03-01 13:12:24,976::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1098::DEBUG::2013-03-01 13:12:24,976::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1098::DEBUG::2013-03-01 13:12:24,977::task::957::TaskManager.Task::(_decref) Task=`ceb8930e-d698-40f5-8886-3f0bf62c00bf`::ref 0 aborting False >Thread-1100::DEBUG::2013-03-01 13:12:25,001::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1100::DEBUG::2013-03-01 13:12:25,001::task::568::TaskManager.Task::(_updateState) Task=`194b9eda-9f47-431d-9523-78f13d0f6caf`::moving from state init -> state preparing >Thread-1100::INFO::2013-03-01 13:12:25,002::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-1100::INFO::2013-03-01 13:12:25,002::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-1100::DEBUG::2013-03-01 13:12:25,002::task::1151::TaskManager.Task::(prepare) Task=`194b9eda-9f47-431d-9523-78f13d0f6caf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-1100::DEBUG::2013-03-01 13:12:25,002::task::568::TaskManager.Task::(_updateState) Task=`194b9eda-9f47-431d-9523-78f13d0f6caf`::moving from state preparing -> state finished >Thread-1100::DEBUG::2013-03-01 13:12:25,003::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1100::DEBUG::2013-03-01 13:12:25,003::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1100::DEBUG::2013-03-01 13:12:25,003::task::957::TaskManager.Task::(_decref) Task=`194b9eda-9f47-431d-9523-78f13d0f6caf`::ref 0 aborting False >Thread-1029::DEBUG::2013-03-01 13:12:25,011::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1029::DEBUG::2013-03-01 13:12:25,012::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata bs=4096 count=1' (cwd None) >Thread-1029::DEBUG::2013-03-01 13:12:25,022::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000334549 s, 12.2 MB/s\n'; <rc> = 0 >Thread-1101::DEBUG::2013-03-01 13:12:25,031::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1101::DEBUG::2013-03-01 13:12:25,032::task::568::TaskManager.Task::(_updateState) Task=`688d7cce-8aa0-4a21-b633-58473dc99f7d`::moving from state init -> state preparing >Thread-1101::INFO::2013-03-01 13:12:25,032::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='393cad59-335f-4f65-97c8-597d9d0e5467', spUUID=None, options=None) >Thread-1101::DEBUG::2013-03-01 13:12:25,032::taskManager::161::TaskManager::(clearTask) Entry. taskID: 393cad59-335f-4f65-97c8-597d9d0e5467 >Thread-1101::DEBUG::2013-03-01 13:12:25,032::taskManager::166::TaskManager::(clearTask) Return. >Thread-1101::INFO::2013-03-01 13:12:25,032::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-1101::DEBUG::2013-03-01 13:12:25,033::task::1151::TaskManager.Task::(prepare) Task=`688d7cce-8aa0-4a21-b633-58473dc99f7d`::finished: None >Thread-1101::DEBUG::2013-03-01 13:12:25,033::task::568::TaskManager.Task::(_updateState) Task=`688d7cce-8aa0-4a21-b633-58473dc99f7d`::moving from state preparing -> state finished >Thread-1101::DEBUG::2013-03-01 13:12:25,033::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1101::DEBUG::2013-03-01 13:12:25,033::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1101::DEBUG::2013-03-01 13:12:25,033::task::957::TaskManager.Task::(_decref) Task=`688d7cce-8aa0-4a21-b633-58473dc99f7d`::ref 0 aborting False >Thread-1102::DEBUG::2013-03-01 13:12:25,072::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1102::DEBUG::2013-03-01 13:12:25,073::task::568::TaskManager.Task::(_updateState) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::moving from state init -> state preparing >Thread-1102::INFO::2013-03-01 13:12:25,073::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', hostID=1, scsiKey='41b11cc6-b020-47d9-b70e-c4fadcc621be', options=None) >Thread-1102::INFO::2013-03-01 13:12:25,073::hsm::1042::Storage.HSM::(destroyStoragePool) spUUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-1102::DEBUG::2013-03-01 13:12:25,073::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`0faca74b-eb4a-4462-a540-0e4f63335d57`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1102::DEBUG::2013-03-01 13:12:25,074::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1102::DEBUG::2013-03-01 13:12:25,074::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1102::DEBUG::2013-03-01 13:12:25,074::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`0faca74b-eb4a-4462-a540-0e4f63335d57`::Granted request >Thread-1102::DEBUG::2013-03-01 13:12:25,075::task::794::TaskManager.Task::(resourceAcquired) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::_resourcesAcquired: Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be (exclusive) >Thread-1102::DEBUG::2013-03-01 13:12:25,075::task::957::TaskManager.Task::(_decref) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::ref 1 aborting False >Thread-1102::DEBUG::2013-03-01 13:12:25,075::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`47448d34-e157-4936-a7d3-4e36255a4622`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1102::DEBUG::2013-03-01 13:12:25,075::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >Thread-1102::DEBUG::2013-03-01 13:12:25,076::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >Thread-1102::DEBUG::2013-03-01 13:12:25,076::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`47448d34-e157-4936-a7d3-4e36255a4622`::Granted request >Thread-1102::DEBUG::2013-03-01 13:12:25,076::task::794::TaskManager.Task::(resourceAcquired) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (exclusive) >Thread-1102::DEBUG::2013-03-01 13:12:25,076::task::957::TaskManager.Task::(_decref) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::ref 1 aborting False >Thread-1102::WARNING::2013-03-01 13:12:25,077::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >Thread-1102::DEBUG::2013-03-01 13:12:25,078::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1102::DEBUG::2013-03-01 13:12:25,078::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1102::DEBUG::2013-03-01 13:12:25,079::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=8fb5756ea78a3aeaf879b35b7a716f8d89f5c017'] >Thread-1102::DEBUG::2013-03-01 13:12:25,079::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:25,079::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:25,080::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:25,080::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:25,080::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:25,081::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:25,311::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:25,313::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:25,313::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=, MDT__SHA_CKSUM=8fb5756ea78a3aeaf879b35b7a716f8d89f5c017 removing=MDT__SHA_CKSUM=e8f514250318c772b40aeb6a79bc25ae7e793cfd, MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active >Thread-1102::DEBUG::2013-03-01 13:12:25,314::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=e8f514250318c772b40aeb6a79bc25ae7e793cfd --deltag MDT_POOL_DOMAINS=a558fc2a-a4a3-4118-9b81-d1d601eaa295:Active --addtag MDT_POOL_DOMAINS= --addtag MDT__SHA_CKSUM=8fb5756ea78a3aeaf879b35b7a716f8d89f5c017 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Dummy-1097::DEBUG::2013-03-01 13:12:26,977::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1103::DEBUG::2013-03-01 13:12:28,005::task::568::TaskManager.Task::(_updateState) Task=`ceba9a39-35fb-4c7c-8d22-74538c3ddcdb`::moving from state init -> state preparing >Thread-1103::INFO::2013-03-01 13:12:28,414::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1103::INFO::2013-03-01 13:12:28,415::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0106089115143', 'lastCheck': '3.4', 'code': 0, 'valid': True}} >Thread-1103::DEBUG::2013-03-01 13:12:28,417::task::1151::TaskManager.Task::(prepare) Task=`ceba9a39-35fb-4c7c-8d22-74538c3ddcdb`::finished: {'a558fc2a-a4a3-4118-9b81-d1d601eaa295': {'delay': '0.0106089115143', 'lastCheck': '3.4', 'code': 0, 'valid': True}} >Dummy-1097::DEBUG::2013-03-01 13:12:28,511::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379093 s, 27.0 MB/s\n'; <rc> = 0 >Thread-1103::DEBUG::2013-03-01 13:12:29,102::task::568::TaskManager.Task::(_updateState) Task=`ceba9a39-35fb-4c7c-8d22-74538c3ddcdb`::moving from state preparing -> state finished >Thread-1103::DEBUG::2013-03-01 13:12:29,124::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1103::DEBUG::2013-03-01 13:12:29,125::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1103::DEBUG::2013-03-01 13:12:29,127::task::957::TaskManager.Task::(_decref) Task=`ceba9a39-35fb-4c7c-8d22-74538c3ddcdb`::ref 0 aborting False >Thread-1102::DEBUG::2013-03-01 13:12:29,171::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:29,221::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,221::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,221::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1102::DEBUG::2013-03-01 13:12:29,222::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-1102::DEBUG::2013-03-01 13:12:29,222::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`60f0340c-dafb-443c-affe-cec2287424af`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1102::DEBUG::2013-03-01 13:12:29,223::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' for lock type 'exclusive' >Thread-1102::DEBUG::2013-03-01 13:12:29,223::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free. Now locking as 'exclusive' (1 active user) >Thread-1102::DEBUG::2013-03-01 13:12:29,223::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be`ReqID=`60f0340c-dafb-443c-affe-cec2287424af`::Granted request >Thread-1102::DEBUG::2013-03-01 13:12:29,224::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1102::DEBUG::2013-03-01 13:12:29,224::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1102::DEBUG::2013-03-01 13:12:29,225::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1102::DEBUG::2013-03-01 13:12:29,225::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1102::DEBUG::2013-03-01 13:12:29,231::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,233::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,235::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,237::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,240::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,242::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,245::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,247::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,249::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,251::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,253::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,267::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,269::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,271::sp::353::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master >Thread-1102::DEBUG::2013-03-01 13:12:29,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:29,468::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,471::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,473::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,475::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,478::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,480::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,481::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,483::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,485::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,486::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,488::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,489::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,491::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,493::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,494::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,496::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,497::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,499::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,501::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,503::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,505::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,506::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-1102::DEBUG::2013-03-01 13:12:29,507::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1102::DEBUG::2013-03-01 13:12:29,507::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1102::DEBUG::2013-03-01 13:12:29,508::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4'] >Thread-1102::DEBUG::2013-03-01 13:12:29,508::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,515::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,515::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,515::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,516::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,516::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:29,750::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:29,752::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:29,752::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4 removing=MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=8fb5756ea78a3aeaf879b35b7a716f8d89f5c017 >Thread-1102::DEBUG::2013-03-01 13:12:29,753::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=8fb5756ea78a3aeaf879b35b7a716f8d89f5c017 --addtag MDT_POOL_SPM_ID=-1 --addtag MDT__SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:30,226::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:30,226::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,227::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,227::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1102::INFO::2013-03-01 13:12:30,227::clusterlock::252::SANLock::(release) Releasing cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1102::DEBUG::2013-03-01 13:12:30,229::clusterlock::263::SANLock::(release) Cluster lock for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 successfully released >Thread-1102::DEBUG::2013-03-01 13:12:30,229::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1102::DEBUG::2013-03-01 13:12:30,229::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1102::DEBUG::2013-03-01 13:12:30,230::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,230::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,230::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,230::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,231::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,231::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:30,414::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:30,417::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:30,417::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4'] >Thread-1029::DEBUG::2013-03-01 13:12:30,418::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for a558fc2a-a4a3-4118-9b81-d1d601eaa295 >Thread-1029::INFO::2013-03-01 13:12:30,418::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 (id: 1) >Dummy-1097::INFO::2013-03-01 13:12:32,035::storage_mailbox::692::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-1029::DEBUG::2013-03-01 13:12:33,420::clusterlock::206::SANLock::(releaseHostId) Host id for domain a558fc2a-a4a3-4118-9b81-d1d601eaa295 released successfully (id: 1) >Thread-1102::DEBUG::2013-03-01 13:12:33,488::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `41b11cc6-b020-47d9-b70e-c4fadcc621be` stopped monitoring domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` >Thread-1102::DEBUG::2013-03-01 13:12:33,488::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1102::DEBUG::2013-03-01 13:12:33,488::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `a558fc2a-a4a3-4118-9b81-d1d601eaa295` is done >Thread-1102::DEBUG::2013-03-01 13:12:33,488::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,488::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,489::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,489::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,489::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,490::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:33,680::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:33,682::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,682::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4'] >Thread-1102::DEBUG::2013-03-01 13:12:33,683::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1102::DEBUG::2013-03-01 13:12:33,683::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1102::DEBUG::2013-03-01 13:12:33,683::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1102::DEBUG::2013-03-01 13:12:33,683::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1102::DEBUG::2013-03-01 13:12:33,684::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=data_sd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=clone_dc', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', '_SHA_CKSUM=21b20a0e3318c45db06a7faf515c088ab7b59c34'] >Thread-1102::DEBUG::2013-03-01 13:12:33,684::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,684::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,684::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,685::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,685::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:33,686::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:12:47,055::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:12:47,057::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:12:47,058::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=21b20a0e3318c45db06a7faf515c088ab7b59c34, MDT_POOL_UUID=, MDT_ROLE=Regular removing=MDT__SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4, MDT_ROLE=Master, MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-1102::DEBUG::2013-03-01 13:12:47,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_ROLE=Master --deltag MDT_POOL_UUID=41b11cc6-b020-47d9-b70e-c4fadcc621be --deltag MDT__SHA_CKSUM=a3cc437c068135840aa96ba82cc23db9e8c35db4 --addtag MDT_ROLE=Regular --addtag MDT_POOL_UUID= --addtag MDT__SHA_CKSUM=21b20a0e3318c45db06a7faf515c088ab7b59c34 a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:13:24,827::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:13:24,828::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,828::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,829::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1102::DEBUG::2013-03-01 13:13:24,829::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1102::DEBUG::2013-03-01 13:13:24,829::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1102::DEBUG::2013-03-01 13:13:24,829::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,830::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,830::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,830::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,830::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:24,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:13:25,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1102::DEBUG::2013-03-01 13:13:25,018::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1102::DEBUG::2013-03-01 13:13:25,018::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'ROLE=Regular', 'POOL_UUID=', '_SHA_CKSUM=21b20a0e3318c45db06a7faf515c088ab7b59c34'] >Thread-1102::DEBUG::2013-03-01 13:13:25,019::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1102::INFO::2013-03-01 13:13:25,019::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 41b11cc6-b020-47d9-b70e-c4fadcc621be >Thread-1059::INFO::2013-03-01 13:13:25,973::storage_mailbox::447::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-1109::DEBUG::2013-03-01 13:13:26,171::task::568::TaskManager.Task::(_updateState) Task=`ca43e036-5327-4c9f-90e9-d56a99da7462`::moving from state init -> state preparing >Thread-1059::INFO::2013-03-01 13:13:49,732::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-1102::INFO::2013-03-01 13:13:49,733::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-1109::INFO::2013-03-01 13:13:49,746::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1059::DEBUG::2013-03-01 13:13:49,747::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/41b11cc6-b020-47d9-b70e-c4fadcc621be/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-1102::DEBUG::2013-03-01 13:13:49,747::task::1151::TaskManager.Task::(prepare) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::finished: True >Thread-1109::INFO::2013-03-01 13:13:49,747::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1102::DEBUG::2013-03-01 13:13:49,756::task::568::TaskManager.Task::(_updateState) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::moving from state preparing -> state finished >Thread-1109::DEBUG::2013-03-01 13:13:49,758::task::1151::TaskManager.Task::(prepare) Task=`ca43e036-5327-4c9f-90e9-d56a99da7462`::finished: {} >Thread-1102::DEBUG::2013-03-01 13:13:49,759::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>, 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be': < ResourceRef 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', isValid: 'True' obj: 'None'>} >Thread-1109::DEBUG::2013-03-01 13:13:49,761::task::568::TaskManager.Task::(_updateState) Task=`ca43e036-5327-4c9f-90e9-d56a99da7462`::moving from state preparing -> state finished >Thread-1102::DEBUG::2013-03-01 13:13:49,761::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1109::DEBUG::2013-03-01 13:13:49,763::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1102::DEBUG::2013-03-01 13:13:49,763::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-1109::DEBUG::2013-03-01 13:13:49,764::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1109::DEBUG::2013-03-01 13:13:49,765::task::957::TaskManager.Task::(_decref) Task=`ca43e036-5327-4c9f-90e9-d56a99da7462`::ref 0 aborting False >Thread-1102::DEBUG::2013-03-01 13:13:49,765::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-1102::DEBUG::2013-03-01 13:13:49,766::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-1102::DEBUG::2013-03-01 13:13:49,768::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-1102::DEBUG::2013-03-01 13:13:49,771::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' >Thread-1102::DEBUG::2013-03-01 13:13:49,773::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' (0 active users) >Thread-1102::DEBUG::2013-03-01 13:13:49,774::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be' is free, finding out if anyone is waiting for it. >Thread-1102::DEBUG::2013-03-01 13:13:49,775::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.41b11cc6-b020-47d9-b70e-c4fadcc621be', Clearing records. >Thread-1102::DEBUG::2013-03-01 13:13:49,777::task::957::TaskManager.Task::(_decref) Task=`d91f0df8-4035-4541-b41f-6cc35c4a2177`::ref 0 aborting False >Thread-1111::DEBUG::2013-03-01 13:13:49,863::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1111::DEBUG::2013-03-01 13:13:49,863::task::568::TaskManager.Task::(_updateState) Task=`e497251e-fa19-4500-a6ae-fc3125436d5f`::moving from state init -> state preparing >Thread-1111::INFO::2013-03-01 13:13:49,864::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >MainProcess|Thread-1111::ERROR::2013-03-01 13:13:49,867::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-1111::DEBUG::2013-03-01 13:13:49,869::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 2 -u' (cwd None) >Thread-1111::DEBUG::2013-03-01 13:13:50,431::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1111::DEBUG::2013-03-01 13:13:50,432::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1111::DEBUG::2013-03-01 13:13:50,432::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1111::DEBUG::2013-03-01 13:13:50,432::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1111::DEBUG::2013-03-01 13:13:50,433::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1111::DEBUG::2013-03-01 13:13:50,433::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1111::DEBUG::2013-03-01 13:13:50,452::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1111::DEBUG::2013-03-01 13:13:50,452::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:50,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:51,458::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:52,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:52,806::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:52,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:52,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1111::DEBUG::2013-03-01 13:13:53,816::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1111::DEBUG::2013-03-01 13:13:55,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1111::DEBUG::2013-03-01 13:14:01,138::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1111::DEBUG::2013-03-01 13:14:01,138::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1111::DEBUG::2013-03-01 13:14:01,144::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1111::DEBUG::2013-03-01 13:14:01,145::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1111::DEBUG::2013-03-01 13:14:01,145::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1111::DEBUG::2013-03-01 13:14:01,145::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1111::DEBUG::2013-03-01 13:14:01,146::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1111::DEBUG::2013-03-01 13:14:01,146::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1111::INFO::2013-03-01 13:14:01,146::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1111::DEBUG::2013-03-01 13:14:01,147::task::1151::TaskManager.Task::(prepare) Task=`e497251e-fa19-4500-a6ae-fc3125436d5f`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1111::DEBUG::2013-03-01 13:14:01,147::task::568::TaskManager.Task::(_updateState) Task=`e497251e-fa19-4500-a6ae-fc3125436d5f`::moving from state preparing -> state finished >Thread-1111::DEBUG::2013-03-01 13:14:01,147::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1111::DEBUG::2013-03-01 13:14:01,148::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1111::DEBUG::2013-03-01 13:14:01,148::task::957::TaskManager.Task::(_decref) Task=`e497251e-fa19-4500-a6ae-fc3125436d5f`::ref 0 aborting False >Thread-1115::DEBUG::2013-03-01 13:14:01,182::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1115::DEBUG::2013-03-01 13:14:01,183::task::568::TaskManager.Task::(_updateState) Task=`e372ae0c-a27c-4d9a-be0d-75da924d0b92`::moving from state init -> state preparing >Thread-1115::INFO::2013-03-01 13:14:01,184::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='41b11cc6-b020-47d9-b70e-c4fadcc621be', hostID=1, scsiKey='41b11cc6-b020-47d9-b70e-c4fadcc621be', remove=False, options=None) >Thread-1115::WARNING::2013-03-01 13:14:01,184::hsm::1008::Storage.HSM::(disconnectStoragePool) disconnect sp: 41b11cc6-b020-47d9-b70e-c4fadcc621be failed. Known pools {} >Thread-1115::INFO::2013-03-01 13:14:01,185::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-1115::DEBUG::2013-03-01 13:14:01,185::task::1151::TaskManager.Task::(prepare) Task=`e372ae0c-a27c-4d9a-be0d-75da924d0b92`::finished: None >Thread-1115::DEBUG::2013-03-01 13:14:01,186::task::568::TaskManager.Task::(_updateState) Task=`e372ae0c-a27c-4d9a-be0d-75da924d0b92`::moving from state preparing -> state finished >Thread-1115::DEBUG::2013-03-01 13:14:01,186::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1115::DEBUG::2013-03-01 13:14:01,186::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1115::DEBUG::2013-03-01 13:14:01,186::task::957::TaskManager.Task::(_decref) Task=`e372ae0c-a27c-4d9a-be0d-75da924d0b92`::ref 0 aborting False >Thread-1117::DEBUG::2013-03-01 13:14:05,047::task::568::TaskManager.Task::(_updateState) Task=`8bbc4b90-83f7-4a4c-89f9-368c245bc372`::moving from state init -> state preparing >Thread-1117::INFO::2013-03-01 13:14:07,566::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1117::INFO::2013-03-01 13:14:07,566::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1117::DEBUG::2013-03-01 13:14:07,567::task::1151::TaskManager.Task::(prepare) Task=`8bbc4b90-83f7-4a4c-89f9-368c245bc372`::finished: {} >Thread-1117::DEBUG::2013-03-01 13:14:07,567::task::568::TaskManager.Task::(_updateState) Task=`8bbc4b90-83f7-4a4c-89f9-368c245bc372`::moving from state preparing -> state finished >Thread-1117::DEBUG::2013-03-01 13:14:07,567::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1117::DEBUG::2013-03-01 13:14:07,567::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1117::DEBUG::2013-03-01 13:14:07,567::task::957::TaskManager.Task::(_decref) Task=`8bbc4b90-83f7-4a4c-89f9-368c245bc372`::ref 0 aborting False >Thread-1123::DEBUG::2013-03-01 13:14:22,836::task::568::TaskManager.Task::(_updateState) Task=`5924488b-cbfd-4eb5-91f4-40155d5d51b0`::moving from state init -> state preparing >Thread-1123::INFO::2013-03-01 13:14:22,843::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1123::INFO::2013-03-01 13:14:22,843::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1123::DEBUG::2013-03-01 13:14:22,844::task::1151::TaskManager.Task::(prepare) Task=`5924488b-cbfd-4eb5-91f4-40155d5d51b0`::finished: {} >Thread-1123::DEBUG::2013-03-01 13:14:22,844::task::568::TaskManager.Task::(_updateState) Task=`5924488b-cbfd-4eb5-91f4-40155d5d51b0`::moving from state preparing -> state finished >Thread-1123::DEBUG::2013-03-01 13:14:22,844::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1123::DEBUG::2013-03-01 13:14:22,844::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1123::DEBUG::2013-03-01 13:14:22,844::task::957::TaskManager.Task::(_decref) Task=`5924488b-cbfd-4eb5-91f4-40155d5d51b0`::ref 0 aborting False >Thread-1126::DEBUG::2013-03-01 13:14:31,979::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1126::DEBUG::2013-03-01 13:14:32,789::task::568::TaskManager.Task::(_updateState) Task=`2af0e410-af17-4c60-94a3-88bca875cfa7`::moving from state init -> state preparing >Thread-1126::INFO::2013-03-01 13:14:32,790::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >Thread-1126::DEBUG::2013-03-01 13:14:32,790::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-1126::DEBUG::2013-03-01 13:14:32,832::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1126::DEBUG::2013-03-01 13:14:32,833::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-1126::DEBUG::2013-03-01 13:14:33,395::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1126::DEBUG::2013-03-01 13:15:03,633::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-1126::DEBUG::2013-03-01 13:15:03,681::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1126::INFO::2013-03-01 13:15:03,682::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1126::DEBUG::2013-03-01 13:15:03,689::task::1151::TaskManager.Task::(prepare) Task=`2af0e410-af17-4c60-94a3-88bca875cfa7`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1126::DEBUG::2013-03-01 13:15:03,689::task::568::TaskManager.Task::(_updateState) Task=`2af0e410-af17-4c60-94a3-88bca875cfa7`::moving from state preparing -> state finished >Thread-1126::DEBUG::2013-03-01 13:15:03,690::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1126::DEBUG::2013-03-01 13:15:03,690::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1126::DEBUG::2013-03-01 13:15:03,690::task::957::TaskManager.Task::(_decref) Task=`2af0e410-af17-4c60-94a3-88bca875cfa7`::ref 0 aborting False >Thread-1128::DEBUG::2013-03-01 13:15:03,723::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1128::DEBUG::2013-03-01 13:15:03,724::task::568::TaskManager.Task::(_updateState) Task=`f2de7ec6-903a-492c-9d5d-3ac7255d6195`::moving from state init -> state preparing >Thread-1128::INFO::2013-03-01 13:15:03,724::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='a558fc2a-a4a3-4118-9b81-d1d601eaa295', autoDetach=False, options=None) >Thread-1128::DEBUG::2013-03-01 13:15:03,725::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1128::DEBUG::2013-03-01 13:15:03,725::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1128::DEBUG::2013-03-01 13:15:03,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:15:03,768::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:15:03,769::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:03,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:04,778::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:05,741::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:06,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:06,748::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:06,751::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:06,753::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host8/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:15:06,755::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1128::DEBUG::2013-03-01 13:15:08,764::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1131::DEBUG::2013-03-01 13:15:15,286::task::568::TaskManager.Task::(_updateState) Task=`dc955cfa-1294-49c3-aa10-a6b872ae7c1f`::moving from state init -> state preparing >Thread-1131::INFO::2013-03-01 13:15:36,598::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1131::INFO::2013-03-01 13:15:36,599::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1131::DEBUG::2013-03-01 13:15:36,599::task::1151::TaskManager.Task::(prepare) Task=`dc955cfa-1294-49c3-aa10-a6b872ae7c1f`::finished: {} >Thread-1131::DEBUG::2013-03-01 13:15:36,599::task::568::TaskManager.Task::(_updateState) Task=`dc955cfa-1294-49c3-aa10-a6b872ae7c1f`::moving from state preparing -> state finished >Thread-1131::DEBUG::2013-03-01 13:15:36,599::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1131::DEBUG::2013-03-01 13:15:36,599::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1131::DEBUG::2013-03-01 13:15:36,600::task::957::TaskManager.Task::(_decref) Task=`dc955cfa-1294-49c3-aa10-a6b872ae7c1f`::ref 0 aborting False >Thread-1128::DEBUG::2013-03-01 13:16:01,764::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:01,765::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e0af22b3-0a2f-4dd1-b4d9-5908bb3b746f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1128::DEBUG::2013-03-01 13:16:01,766::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' for lock type 'exclusive' >Thread-1128::DEBUG::2013-03-01 13:16:01,766::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free. Now locking as 'exclusive' (1 active user) >Thread-1128::DEBUG::2013-03-01 13:16:01,766::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295`ReqID=`e0af22b3-0a2f-4dd1-b4d9-5908bb3b746f`::Granted request >Thread-1128::DEBUG::2013-03-01 13:16:01,767::task::794::TaskManager.Task::(resourceAcquired) Task=`f2de7ec6-903a-492c-9d5d-3ac7255d6195`::_resourcesAcquired: Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295 (exclusive) >Thread-1128::DEBUG::2013-03-01 13:16:01,767::task::957::TaskManager.Task::(_decref) Task=`f2de7ec6-903a-492c-9d5d-3ac7255d6195`::ref 1 aborting False >Thread-1128::DEBUG::2013-03-01 13:16:01,768::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:01,768::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:01,768::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:01,769::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:01,769::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:01,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:01,983::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:01,984::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:01,985::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'ROLE=Regular', 'POOL_UUID=', '_SHA_CKSUM=21b20a0e3318c45db06a7faf515c088ab7b59c34'] >Thread-1128::DEBUG::2013-03-01 13:16:01,985::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1128::DEBUG::2013-03-01 13:16:01,986::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1128::DEBUG::2013-03-01 13:16:01,986::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1128::DEBUG::2013-03-01 13:16:01,986::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1128::DEBUG::2013-03-01 13:16:01,986::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:02,011::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:02,011::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:02,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,017::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,022::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,029::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host8/scan' (cwd None) >MainProcess|Thread-1128::DEBUG::2013-03-01 13:16:03,031::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1128::DEBUG::2013-03-01 13:16:05,035::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:09,684::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:09,685::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,691::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,691::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,692::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,692::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,693::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,693::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1128::DEBUG::2013-03-01 13:16:09,693::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,696::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:09,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:09,924::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,925::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-1128::DEBUG::2013-03-01 13:16:09,925::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata count=1' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:09,932::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000316233 s, 6.5 MB/s\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:09,933::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000316233 s, 6.5 MB/s'], size: 2048 >Thread-1128::DEBUG::2013-03-01 13:16:09,933::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-1128::WARNING::2013-03-01 13:16:09,933::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1128::DEBUG::2013-03-01 13:16:09,934::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-1128::DEBUG::2013-03-01 13:16:09,935::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,935::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,935::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,936::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,936::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:09,937::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:10,154::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:10,156::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:10,156::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'VGUUID=CBgVi8-qZUH-dpII-Oba0-oFiE-qzpo-MgbKfS', 'TYPE=ISCSI', u'PV0=pv:3514f0c542a0004b8,uuid:bz31hK-mMvQ-72Tl-kpfe-dcii-bPI0-Q5k9jJ,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'DESCRIPTION=data_sd', 'SDUUID=a558fc2a-a4a3-4118-9b81-d1d601eaa295', 'VERSION=3', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=clone_dc', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'ROLE=Regular', 'POOL_UUID=', '_SHA_CKSUM=21b20a0e3318c45db06a7faf515c088ab7b59c34'] >Thread-1128::DEBUG::2013-03-01 13:16:10,157::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:10,158::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:10,392::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:10,392::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:10,393::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_imageNS already registered >Thread-1128::WARNING::2013-03-01 13:16:10,393::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_volumeNS already registered >Thread-1128::WARNING::2013-03-01 13:16:10,393::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a558fc2a-a4a3-4118-9b81-d1d601eaa295_lvmActivationNS already registered >Thread-1128::DEBUG::2013-03-01 13:16:10,394::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:10,395::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:10,615::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:10,620::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:10,621::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata >Thread-1128::DEBUG::2013-03-01 13:16:10,621::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/metadata' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:11,046::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:11,046::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:11,047::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:11,047::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/master >Thread-1128::DEBUG::2013-03-01 13:16:11,048::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/master' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:11,366::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:11,366::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:11,367::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:11,367::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/inbox >Thread-1128::DEBUG::2013-03-01 13:16:11,368::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/inbox' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:11,684::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:11,685::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:11,685::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:11,685::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/leases >Thread-1128::DEBUG::2013-03-01 13:16:11,686::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/leases' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:12,021::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:12,021::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:12,022::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:12,022::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/ids >Thread-1128::DEBUG::2013-03-01 13:16:12,023::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/ids' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:12,331::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:12,331::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:12,332::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::WARNING::2013-03-01 13:16:12,332::lvm::1043::Storage.LVM::(removeLVs) Removing active volume a558fc2a-a4a3-4118-9b81-d1d601eaa295/outbox >Thread-1128::DEBUG::2013-03-01 13:16:12,333::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n a558fc2a-a4a3-4118-9b81-d1d601eaa295/outbox' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:12,660::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:12,661::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:12,661::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:12,662::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a000488|3514f0c542a000489|3514f0c542a00048a|3514f0c542a00049f|3514f0c542a0004b8|3514f0c542a0004b9%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f a558fc2a-a4a3-4118-9b81-d1d601eaa295' (cwd None) >Thread-1128::DEBUG::2013-03-01 13:16:12,844::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1128::DEBUG::2013-03-01 13:16:12,844::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1128::DEBUG::2013-03-01 13:16:12,844::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1128::INFO::2013-03-01 13:16:12,845::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-1128::DEBUG::2013-03-01 13:16:12,845::task::1151::TaskManager.Task::(prepare) Task=`f2de7ec6-903a-492c-9d5d-3ac7255d6195`::finished: None >Thread-1128::DEBUG::2013-03-01 13:16:12,845::task::568::TaskManager.Task::(_updateState) Task=`f2de7ec6-903a-492c-9d5d-3ac7255d6195`::moving from state preparing -> state finished >Thread-1128::DEBUG::2013-03-01 13:16:12,845::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295': < ResourceRef 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', isValid: 'True' obj: 'None'>} >Thread-1128::DEBUG::2013-03-01 13:16:12,846::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1128::DEBUG::2013-03-01 13:16:12,846::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' >Thread-1128::DEBUG::2013-03-01 13:16:12,846::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' (0 active users) >Thread-1128::DEBUG::2013-03-01 13:16:12,846::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295' is free, finding out if anyone is waiting for it. >Thread-1128::DEBUG::2013-03-01 13:16:12,847::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a558fc2a-a4a3-4118-9b81-d1d601eaa295', Clearing records. >Thread-1128::DEBUG::2013-03-01 13:16:12,847::task::957::TaskManager.Task::(_decref) Task=`f2de7ec6-903a-492c-9d5d-3ac7255d6195`::ref 0 aborting False >Thread-1137::DEBUG::2013-03-01 13:16:12,883::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1137::DEBUG::2013-03-01 13:16:12,884::task::568::TaskManager.Task::(_updateState) Task=`d55301e4-4310-437a-84cc-3c5d9ce03c16`::moving from state init -> state preparing >Thread-1137::INFO::2013-03-01 13:16:12,884::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001', 'port': '3260'}], options=None) >MainProcess|Thread-1137::ERROR::2013-03-01 13:16:12,888::supervdsmServer::81::SuperVdsm.ServerCallback::(wrapper) Error in readSessionInfo >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 79, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 145, in readSessionInfo > return _readSessionInfo(sessionID) > File "/usr/share/vdsm/storage/iscsi.py", line 83, in readSessionInfo > raise OSError(errno.ENOENT, "No such session") >OSError: [Errno 2] No such session >Thread-1137::DEBUG::2013-03-01 13:16:12,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 3 -u' (cwd None) >Thread-1137::DEBUG::2013-03-01 13:16:13,450::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1137::DEBUG::2013-03-01 13:16:13,451::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1137::DEBUG::2013-03-01 13:16:13,451::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1137::DEBUG::2013-03-01 13:16:13,452::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1137::DEBUG::2013-03-01 13:16:13,452::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1137::DEBUG::2013-03-01 13:16:13,452::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1137::DEBUG::2013-03-01 13:16:13,469::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1137::DEBUG::2013-03-01 13:16:13,470::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:13,471::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:13,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-1138::DEBUG::2013-03-01 13:16:13,572::task::568::TaskManager.Task::(_updateState) Task=`bd60e3ad-97f8-4e00-b0b8-1c4e0d426b23`::moving from state init -> state preparing >Thread-1138::INFO::2013-03-01 13:16:13,573::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1138::INFO::2013-03-01 13:16:13,573::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1138::DEBUG::2013-03-01 13:16:13,573::task::1151::TaskManager.Task::(prepare) Task=`bd60e3ad-97f8-4e00-b0b8-1c4e0d426b23`::finished: {} >Thread-1138::DEBUG::2013-03-01 13:16:13,573::task::568::TaskManager.Task::(_updateState) Task=`bd60e3ad-97f8-4e00-b0b8-1c4e0d426b23`::moving from state preparing -> state finished >Thread-1138::DEBUG::2013-03-01 13:16:13,574::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1138::DEBUG::2013-03-01 13:16:13,574::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1138::DEBUG::2013-03-01 13:16:13,574::task::957::TaskManager.Task::(_decref) Task=`bd60e3ad-97f8-4e00-b0b8-1c4e0d426b23`::ref 0 aborting False >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:14,479::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:14,482::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:14,484::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:15,487::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1137::DEBUG::2013-03-01 13:16:16,492::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1137::DEBUG::2013-03-01 13:16:18,496::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1137::DEBUG::2013-03-01 13:16:19,332::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1137::DEBUG::2013-03-01 13:16:19,333::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1137::DEBUG::2013-03-01 13:16:19,333::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1137::DEBUG::2013-03-01 13:16:19,334::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1137::DEBUG::2013-03-01 13:16:19,334::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1137::DEBUG::2013-03-01 13:16:19,334::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1137::DEBUG::2013-03-01 13:16:19,335::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1137::DEBUG::2013-03-01 13:16:19,335::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1137::INFO::2013-03-01 13:16:19,335::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1137::DEBUG::2013-03-01 13:16:19,336::task::1151::TaskManager.Task::(prepare) Task=`d55301e4-4310-437a-84cc-3c5d9ce03c16`::finished: {'statuslist': [{'status': 0, 'id': 'c002bb8c-140c-4f79-9c1d-85cf1855f001'}]} >Thread-1137::DEBUG::2013-03-01 13:16:19,336::task::568::TaskManager.Task::(_updateState) Task=`d55301e4-4310-437a-84cc-3c5d9ce03c16`::moving from state preparing -> state finished >Thread-1137::DEBUG::2013-03-01 13:16:19,336::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1137::DEBUG::2013-03-01 13:16:19,337::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1137::DEBUG::2013-03-01 13:16:19,337::task::957::TaskManager.Task::(_decref) Task=`d55301e4-4310-437a-84cc-3c5d9ce03c16`::ref 0 aborting False >Thread-1142::DEBUG::2013-03-01 13:16:22,717::task::568::TaskManager.Task::(_updateState) Task=`05e12a21-c7a7-4a1e-8cc1-de9fe6dba92d`::moving from state init -> state preparing >Thread-1142::INFO::2013-03-01 13:16:22,717::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1142::INFO::2013-03-01 13:16:22,718::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1142::DEBUG::2013-03-01 13:16:22,718::task::1151::TaskManager.Task::(prepare) Task=`05e12a21-c7a7-4a1e-8cc1-de9fe6dba92d`::finished: {} >Thread-1142::DEBUG::2013-03-01 13:16:22,718::task::568::TaskManager.Task::(_updateState) Task=`05e12a21-c7a7-4a1e-8cc1-de9fe6dba92d`::moving from state preparing -> state finished >Thread-1142::DEBUG::2013-03-01 13:16:22,718::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1142::DEBUG::2013-03-01 13:16:22,718::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1142::DEBUG::2013-03-01 13:16:22,718::task::957::TaskManager.Task::(_decref) Task=`05e12a21-c7a7-4a1e-8cc1-de9fe6dba92d`::ref 0 aborting False >Thread-1144::DEBUG::2013-03-01 13:45:16,843::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-1144::DEBUG::2013-03-01 13:45:16,900::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >MainThread::INFO::2013-03-01 13:46:23,858::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-03-01 13:46:23,865::task::568::TaskManager.Task::(_updateState) Task=`acc49c81-c490-4323-b2c4-9a8c6a871ff6`::moving from state init -> state preparing >MainThread::INFO::2013-03-01 13:46:23,865::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-03-01 13:46:23,866::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-03-01 13:46:23,870::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,871::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,873::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,874::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,875::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,877::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,878::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,879::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,881::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,882::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,883::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,885::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,886::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,887::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,889::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,890::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,891::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,893::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,894::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,895::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,897::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,898::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,899::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,901::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,902::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,903::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,905::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,906::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,907::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,909::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,910::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,911::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,913::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,914::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,915::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:23,917::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:46:24,034::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-03-01 13:46:24,034::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-03-01 13:46:24,035::task::1151::TaskManager.Task::(prepare) Task=`acc49c81-c490-4323-b2c4-9a8c6a871ff6`::finished: None >MainThread::DEBUG::2013-03-01 13:46:24,035::task::568::TaskManager.Task::(_updateState) Task=`acc49c81-c490-4323-b2c4-9a8c6a871ff6`::moving from state preparing -> state finished >MainThread::DEBUG::2013-03-01 13:46:24,035::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-03-01 13:46:24,035::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-03-01 13:46:24,035::task::957::TaskManager.Task::(_decref) Task=`acc49c81-c490-4323-b2c4-9a8c6a871ff6`::ref 0 aborting False >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::99::vds::(run) <_MainThread(MainThread, started 139733042976512)> >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 139732949083904)> >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::99::vds::(run) <WorkerThread(f75ede85-8a68-4e8e-aa0e-d41087dfcfec, started daemon 139732331788032)> >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::99::vds::(run) <WorkerThread(c87bcef9-8c00-46a7-9dbf-534cb3680559, started daemon 139732681991936)> >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::99::vds::(run) <WorkerThread(40f6218e-4f7d-4790-a04c-295dca7b06b1, started daemon 139732692481792)> >MainThread::INFO::2013-03-01 13:46:24,036::vdsm::99::vds::(run) <WorkerThread(d803a7e4-5951-47c8-8515-0ccc6d24fa67, started daemon 139732702971648)> >MainThread::INFO::2013-03-01 13:46:24,037::vdsm::99::vds::(run) <WorkerThread(ebfa628d-d34f-45fa-a48d-fa4170f58bca, started daemon 139732713461504)> >MainThread::INFO::2013-03-01 13:46:24,037::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 139732321298176)> >MainThread::INFO::2013-03-01 13:46:24,037::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 139732310808320)> >MainThread::INFO::2013-03-01 13:46:24,037::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139731862025984)> >MainThread::INFO::2013-03-01 13:46:24,037::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-03-01 13:46:24,037::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 139731841046272)> >MainThread::INFO::2013-03-01 13:46:24,037::vdsm::99::vds::(run) <WorkerThread(90b71e4e-999a-4d41-acb8-ec5864b43b1e, started daemon 139732723951360)> >MainThread::INFO::2013-03-01 13:46:24,038::vdsm::99::vds::(run) <WorkerThread(393cad59-335f-4f65-97c8-597d9d0e5467, started daemon 139732734441216)> >MainThread::INFO::2013-03-01 13:46:24,038::vdsm::99::vds::(run) <WorkerThread(0aebe01b-7949-4f4d-9c0e-b831b2641300, started daemon 139732816557824)> >MainThread::INFO::2013-03-01 13:52:24,100::vdsm::89::vds::(run) I am the actual vdsm 4.10-10.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-03-01 13:52:24,428::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-03-01 13:52:24,428::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-03-01 13:52:24,439::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-03-01 13:52:24,819::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,820::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,822::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,824::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,825::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,827::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,829::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,831::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,833::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,835::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,838::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,840::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,842::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,845::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,847::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,849::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,852::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,854::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,857::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,859::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,861::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,864::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,866::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,869::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,871::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,873::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,876::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,878::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,881::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,883::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,885::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,888::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,890::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,893::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,895::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:24,897::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 13:52:25,038::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-03-01 13:52:25,039::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py bbaee923-6a72-4fc4-bed2-7f4a57f8630b 3911 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-03-01 13:52:25,249::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-03-01 13:52:25,249::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-03-01 13:52:25,249::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-03-01 13:52:25,249::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-03-01 13:52:25,250::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-03-01 13:52:25,250::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-03-01 13:52:25,252::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-03-01 13:52:27,046::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-03-01 13:52:27,057::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-03-01 13:52:27,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-03-01 13:52:27,298::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-03-01 13:52:27,298::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-03-01 13:52:27,301::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-03-01 13:52:27,301::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-03-01 13:52:27,302::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-03-01 13:52:27,318::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-03-01 13:52:27,319::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-03-01 13:52:27,319::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:27,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::DEBUG::2013-03-01 13:52:27,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-03-01 13:52:27,388::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-03-01 13:52:27,389::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-03-01 13:52:27,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-03-01 13:52:27,390::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-03-01 13:52:27,398::vmChannels::127::vds::(run) Starting VM channels listener thread. >KsmMonitor::DEBUG::2013-03-01 13:52:27,418::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-03-01 13:52:27,418::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-03-01 13:52:27,445::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 13:52:27,500::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 13:52:27,501::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:27,501::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:27,502::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-03-01 13:52:27,659::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 13:52:27,660::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:27,660::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-03-01 13:52:27,817::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 13:52:27,818::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-03-01 13:52:27,818::misc::1055::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-03-01 13:52:27,819::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-03-01 13:52:27,819::misc::1055::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-03-01 13:52:27,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-03-01 13:52:27,834::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-03-01 13:52:27,834::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:27,837::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-13::DEBUG::2013-03-01 13:52:28,756::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:28,841::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:28,845::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:28,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:28,851::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-13::DEBUG::2013-03-01 13:52:29,236::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-03-01 13:52:29,382::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-03-01 13:52:29,448::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-03-01 13:52:29,581::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-15::DEBUG::2013-03-01 13:52:29,611::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >Thread-16::DEBUG::2013-03-01 13:52:29,657::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-03-01 13:52:29,658::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:29,855::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 13:52:29,858::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-03-01 13:52:31,862::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-03-01 13:52:33,061::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 13:52:33,062::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:33,062::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:33,062::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:33,062::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:33,063::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:33,063::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 13:52:33,063::misc::1063::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-03-01 13:52:33,063::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-19::DEBUG::2013-03-01 13:52:33,733::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-19::DEBUG::2013-03-01 13:52:33,734::task::568::TaskManager.Task::(_updateState) Task=`44a96fb5-6987-4f3f-8936-5ead3a01cd76`::moving from state init -> state preparing >Thread-19::INFO::2013-03-01 13:52:33,734::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-19::INFO::2013-03-01 13:52:33,735::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-19::DEBUG::2013-03-01 13:52:33,735::task::1151::TaskManager.Task::(prepare) Task=`44a96fb5-6987-4f3f-8936-5ead3a01cd76`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-19::DEBUG::2013-03-01 13:52:33,735::task::568::TaskManager.Task::(_updateState) Task=`44a96fb5-6987-4f3f-8936-5ead3a01cd76`::moving from state preparing -> state finished >Thread-19::DEBUG::2013-03-01 13:52:33,735::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2013-03-01 13:52:33,736::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2013-03-01 13:52:33,736::task::957::TaskManager.Task::(_decref) Task=`44a96fb5-6987-4f3f-8936-5ead3a01cd76`::ref 0 aborting False >Thread-20::DEBUG::2013-03-01 13:52:33,802::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-20::DEBUG::2013-03-01 13:52:33,803::task::568::TaskManager.Task::(_updateState) Task=`ad794aa6-d2c8-4996-ba8f-007ce19af912`::moving from state init -> state preparing >Thread-20::INFO::2013-03-01 13:52:33,803::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-20::DEBUG::2013-03-01 13:52:33,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-20::INFO::2013-03-01 13:52:34,182::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-20::DEBUG::2013-03-01 13:52:34,182::task::1151::TaskManager.Task::(prepare) Task=`ad794aa6-d2c8-4996-ba8f-007ce19af912`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-20::DEBUG::2013-03-01 13:52:34,183::task::568::TaskManager.Task::(_updateState) Task=`ad794aa6-d2c8-4996-ba8f-007ce19af912`::moving from state preparing -> state finished >Thread-20::DEBUG::2013-03-01 13:52:34,183::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2013-03-01 13:52:34,183::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2013-03-01 13:52:34,184::task::957::TaskManager.Task::(_decref) Task=`ad794aa6-d2c8-4996-ba8f-007ce19af912`::ref 0 aborting False >Thread-21::DEBUG::2013-03-01 13:52:34,256::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-21::DEBUG::2013-03-01 13:52:34,256::task::568::TaskManager.Task::(_updateState) Task=`57d5aafc-40d2-4ce1-91a6-398dfcf2abf6`::moving from state init -> state preparing >Thread-21::INFO::2013-03-01 13:52:34,257::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', options=None) >Thread-21::DEBUG::2013-03-01 13:52:34,257::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-21::DEBUG::2013-03-01 13:52:34,257::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-21::DEBUG::2013-03-01 13:52:34,258::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-21::DEBUG::2013-03-01 13:52:34,258::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-21::DEBUG::2013-03-01 13:52:34,258::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-21::DEBUG::2013-03-01 13:52:34,273::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-21::DEBUG::2013-03-01 13:52:34,274::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:34,276::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:35,281::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:35,284::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:35,287::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:35,290::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:36,294::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-21::DEBUG::2013-03-01 13:52:37,298::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-23::DEBUG::2013-03-01 13:52:39,073::task::568::TaskManager.Task::(_updateState) Task=`e0c54edf-7eff-49e3-9458-149d442ff388`::moving from state init -> state preparing >Thread-23::INFO::2013-03-01 13:52:39,073::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-23::INFO::2013-03-01 13:52:39,074::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-23::DEBUG::2013-03-01 13:52:39,074::task::1151::TaskManager.Task::(prepare) Task=`e0c54edf-7eff-49e3-9458-149d442ff388`::finished: {} >Thread-23::DEBUG::2013-03-01 13:52:39,074::task::568::TaskManager.Task::(_updateState) Task=`e0c54edf-7eff-49e3-9458-149d442ff388`::moving from state preparing -> state finished >Thread-23::DEBUG::2013-03-01 13:52:39,074::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-23::DEBUG::2013-03-01 13:52:39,075::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-23::DEBUG::2013-03-01 13:52:39,075::task::957::TaskManager.Task::(_decref) Task=`e0c54edf-7eff-49e3-9458-149d442ff388`::ref 0 aborting False >Thread-21::DEBUG::2013-03-01 13:52:39,301::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-21::DEBUG::2013-03-01 13:52:40,388::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-21::DEBUG::2013-03-01 13:52:40,388::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,395::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,395::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,396::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,396::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,396::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,397::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-21::DEBUG::2013-03-01 13:52:40,397::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-21::DEBUG::2013-03-01 13:52:40,398::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-21::DEBUG::2013-03-01 13:52:40,599::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-21::DEBUG::2013-03-01 13:52:40,600::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-21::INFO::2013-03-01 13:52:40,935::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-21::DEBUG::2013-03-01 13:52:40,935::task::1151::TaskManager.Task::(prepare) Task=`57d5aafc-40d2-4ce1-91a6-398dfcf2abf6`::finished: {'domlist': []} >Thread-21::DEBUG::2013-03-01 13:52:40,936::task::568::TaskManager.Task::(_updateState) Task=`57d5aafc-40d2-4ce1-91a6-398dfcf2abf6`::moving from state preparing -> state finished >Thread-21::DEBUG::2013-03-01 13:52:40,936::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-21::DEBUG::2013-03-01 13:52:40,936::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-21::DEBUG::2013-03-01 13:52:40,937::task::957::TaskManager.Task::(_decref) Task=`57d5aafc-40d2-4ce1-91a6-398dfcf2abf6`::ref 0 aborting False >Thread-49::DEBUG::2013-03-01 13:52:41,105::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-49::DEBUG::2013-03-01 13:52:41,106::task::568::TaskManager.Task::(_updateState) Task=`6aeb6e14-2424-4716-92ca-315c660529c1`::moving from state init -> state preparing >Thread-49::INFO::2013-03-01 13:52:41,106::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', domainName='nfsStorageTest_data_domain_0', typeSpecificArg='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', domClass=1, domVersion='0', options=None) >Thread-49::DEBUG::2013-03-01 13:52:41,107::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-49::DEBUG::2013-03-01 13:52:41,108::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-49::DEBUG::2013-03-01 13:52:41,327::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-49::WARNING::2013-03-01 13:52:41,328::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-49::DEBUG::2013-03-01 13:52:41,330::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-49::INFO::2013-03-01 13:52:41,392::nfsSD::68::Storage.StorageDomain::(create) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c domainName=nfsStorageTest_data_domain_0 remotePath=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 domClass=1 >Thread-49::DEBUG::2013-03-01 13:52:41,755::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-49::DEBUG::2013-03-01 13:52:41,756::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-49::WARNING::2013-03-01 13:52:41,756::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-49::DEBUG::2013-03-01 13:52:41,756::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-49::DEBUG::2013-03-01 13:52:41,757::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-49::DEBUG::2013-03-01 13:52:41,757::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=989dddd4b583c25ee4dc9da9aeec78c2817fa0ca'] >Thread-49::DEBUG::2013-03-01 13:52:41,821::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-49::DEBUG::2013-03-01 13:52:41,833::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-49::DEBUG::2013-03-01 13:52:41,833::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-49::DEBUG::2013-03-01 13:52:41,838::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=989dddd4b583c25ee4dc9da9aeec78c2817fa0ca'] >Thread-49::DEBUG::2013-03-01 13:52:41,841::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-49::DEBUG::2013-03-01 13:52:41,842::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS' >Thread-49::DEBUG::2013-03-01 13:52:41,842::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS' >Thread-49::DEBUG::2013-03-01 13:52:41,843::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-49::DEBUG::2013-03-01 13:52:41,925::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-49::DEBUG::2013-03-01 13:52:41,926::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-49::INFO::2013-03-01 13:52:41,926::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-49::DEBUG::2013-03-01 13:52:41,926::task::1151::TaskManager.Task::(prepare) Task=`6aeb6e14-2424-4716-92ca-315c660529c1`::finished: None >Thread-49::DEBUG::2013-03-01 13:52:41,926::task::568::TaskManager.Task::(_updateState) Task=`6aeb6e14-2424-4716-92ca-315c660529c1`::moving from state preparing -> state finished >Thread-49::DEBUG::2013-03-01 13:52:41,927::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49::DEBUG::2013-03-01 13:52:41,927::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2013-03-01 13:52:41,927::task::957::TaskManager.Task::(_decref) Task=`6aeb6e14-2424-4716-92ca-315c660529c1`::ref 0 aborting False >Thread-74::DEBUG::2013-03-01 13:52:41,964::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-74::DEBUG::2013-03-01 13:52:41,965::task::568::TaskManager.Task::(_updateState) Task=`15f38916-cf3a-4f85-a441-c9f5a839cb62`::moving from state init -> state preparing >Thread-74::INFO::2013-03-01 13:52:41,965::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', options=None) >Thread-74::DEBUG::2013-03-01 13:52:41,966::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`1b3b66eb-88d0-45f0-a29e-095d703e6540`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-74::DEBUG::2013-03-01 13:52:41,966::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'shared' >Thread-74::DEBUG::2013-03-01 13:52:41,967::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'shared' (1 active user) >Thread-74::DEBUG::2013-03-01 13:52:41,967::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`1b3b66eb-88d0-45f0-a29e-095d703e6540`::Granted request >Thread-74::DEBUG::2013-03-01 13:52:41,967::task::794::TaskManager.Task::(resourceAcquired) Task=`15f38916-cf3a-4f85-a441-c9f5a839cb62`::_resourcesAcquired: Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (shared) >Thread-74::DEBUG::2013-03-01 13:52:41,968::task::957::TaskManager.Task::(_decref) Task=`15f38916-cf3a-4f85-a441-c9f5a839cb62`::ref 1 aborting False >Thread-74::INFO::2013-03-01 13:52:41,969::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942400339968', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-74::DEBUG::2013-03-01 13:52:41,970::task::1151::TaskManager.Task::(prepare) Task=`15f38916-cf3a-4f85-a441-c9f5a839cb62`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942400339968', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-74::DEBUG::2013-03-01 13:52:41,970::task::568::TaskManager.Task::(_updateState) Task=`15f38916-cf3a-4f85-a441-c9f5a839cb62`::moving from state preparing -> state finished >Thread-74::DEBUG::2013-03-01 13:52:41,970::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': < ResourceRef 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', isValid: 'True' obj: 'None'>} >Thread-74::DEBUG::2013-03-01 13:52:41,970::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2013-03-01 13:52:41,971::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >Thread-74::DEBUG::2013-03-01 13:52:41,971::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >Thread-74::DEBUG::2013-03-01 13:52:41,971::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >Thread-74::DEBUG::2013-03-01 13:52:41,972::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >Thread-74::DEBUG::2013-03-01 13:52:41,972::task::957::TaskManager.Task::(_decref) Task=`15f38916-cf3a-4f85-a441-c9f5a839cb62`::ref 0 aborting False >Thread-76::DEBUG::2013-03-01 13:52:43,567::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-76::DEBUG::2013-03-01 13:52:43,567::task::568::TaskManager.Task::(_updateState) Task=`45a7d3a7-87e1-41b7-a03c-1eaaa409afcf`::moving from state init -> state preparing >Thread-76::INFO::2013-03-01 13:52:43,568::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-76::INFO::2013-03-01 13:52:43,568::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-76::DEBUG::2013-03-01 13:52:43,568::task::1151::TaskManager.Task::(prepare) Task=`45a7d3a7-87e1-41b7-a03c-1eaaa409afcf`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-76::DEBUG::2013-03-01 13:52:43,568::task::568::TaskManager.Task::(_updateState) Task=`45a7d3a7-87e1-41b7-a03c-1eaaa409afcf`::moving from state preparing -> state finished >Thread-76::DEBUG::2013-03-01 13:52:43,569::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2013-03-01 13:52:43,569::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2013-03-01 13:52:43,569::task::957::TaskManager.Task::(_decref) Task=`45a7d3a7-87e1-41b7-a03c-1eaaa409afcf`::ref 0 aborting False >Thread-77::DEBUG::2013-03-01 13:52:43,619::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-77::DEBUG::2013-03-01 13:52:43,620::task::568::TaskManager.Task::(_updateState) Task=`e28130fc-df16-488a-8667-0f3c32034b9e`::moving from state init -> state preparing >Thread-77::INFO::2013-03-01 13:52:43,620::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-77::DEBUG::2013-03-01 13:52:43,623::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-77::INFO::2013-03-01 13:52:43,666::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-77::DEBUG::2013-03-01 13:52:43,666::task::1151::TaskManager.Task::(prepare) Task=`e28130fc-df16-488a-8667-0f3c32034b9e`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-77::DEBUG::2013-03-01 13:52:43,666::task::568::TaskManager.Task::(_updateState) Task=`e28130fc-df16-488a-8667-0f3c32034b9e`::moving from state preparing -> state finished >Thread-77::DEBUG::2013-03-01 13:52:43,667::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-77::DEBUG::2013-03-01 13:52:43,667::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-77::DEBUG::2013-03-01 13:52:43,667::task::957::TaskManager.Task::(_decref) Task=`e28130fc-df16-488a-8667-0f3c32034b9e`::ref 0 aborting False >Thread-78::DEBUG::2013-03-01 13:52:43,717::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-78::DEBUG::2013-03-01 13:52:43,718::task::568::TaskManager.Task::(_updateState) Task=`c3066ed2-816f-420c-a78b-40d5600472c8`::moving from state init -> state preparing >Thread-78::INFO::2013-03-01 13:52:43,718::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', options=None) >Thread-78::DEBUG::2013-03-01 13:52:43,719::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-78::DEBUG::2013-03-01 13:52:43,719::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-78::DEBUG::2013-03-01 13:52:43,719::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-78::DEBUG::2013-03-01 13:52:43,719::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-78::DEBUG::2013-03-01 13:52:43,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-78::DEBUG::2013-03-01 13:52:43,735::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-78::DEBUG::2013-03-01 13:52:43,735::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:43,738::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:44,742::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:44,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:45,749::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:45,752::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:45,755::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-78::DEBUG::2013-03-01 13:52:45,758::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-78::DEBUG::2013-03-01 13:52:47,761::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-78::DEBUG::2013-03-01 13:52:48,845::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-78::DEBUG::2013-03-01 13:52:48,845::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,846::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,846::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,846::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,847::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,847::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,847::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-78::DEBUG::2013-03-01 13:52:48,848::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-78::DEBUG::2013-03-01 13:52:48,849::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-78::DEBUG::2013-03-01 13:52:49,064::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-78::DEBUG::2013-03-01 13:52:49,065::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-78::INFO::2013-03-01 13:52:49,165::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-78::DEBUG::2013-03-01 13:52:49,166::task::1151::TaskManager.Task::(prepare) Task=`c3066ed2-816f-420c-a78b-40d5600472c8`::finished: {'domlist': []} >Thread-78::DEBUG::2013-03-01 13:52:49,166::task::568::TaskManager.Task::(_updateState) Task=`c3066ed2-816f-420c-a78b-40d5600472c8`::moving from state preparing -> state finished >Thread-78::DEBUG::2013-03-01 13:52:49,166::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2013-03-01 13:52:49,166::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2013-03-01 13:52:49,167::task::957::TaskManager.Task::(_decref) Task=`c3066ed2-816f-420c-a78b-40d5600472c8`::ref 0 aborting False >Thread-106::DEBUG::2013-03-01 13:52:49,269::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-106::DEBUG::2013-03-01 13:52:49,269::task::568::TaskManager.Task::(_updateState) Task=`7855bb0e-1306-42f4-afa4-1e66f1a1cf4d`::moving from state init -> state preparing >Thread-106::INFO::2013-03-01 13:52:49,270::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', domainName='nfsStorageTest_data_domain_1', typeSpecificArg='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', domClass=1, domVersion='0', options=None) >Thread-106::DEBUG::2013-03-01 13:52:49,270::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-106::DEBUG::2013-03-01 13:52:49,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-106::DEBUG::2013-03-01 13:52:49,472::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-106::WARNING::2013-03-01 13:52:49,473::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-106::DEBUG::2013-03-01 13:52:49,473::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-106::INFO::2013-03-01 13:52:49,526::nfsSD::68::Storage.StorageDomain::(create) sdUUID=352c3a1d-5473-41a5-9693-3da8286df38d domainName=nfsStorageTest_data_domain_1 remotePath=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 domClass=1 >Thread-106::DEBUG::2013-03-01 13:52:49,830::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-106::DEBUG::2013-03-01 13:52:49,831::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-106::WARNING::2013-03-01 13:52:49,832::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-106::DEBUG::2013-03-01 13:52:49,832::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-106::DEBUG::2013-03-01 13:52:49,832::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-106::DEBUG::2013-03-01 13:52:49,833::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=1eafe57e246e79478c53922451cb56e77d15e8f8'] >Thread-106::DEBUG::2013-03-01 13:52:49,888::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-106::DEBUG::2013-03-01 13:52:49,905::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-106::DEBUG::2013-03-01 13:52:49,905::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-106::DEBUG::2013-03-01 13:52:49,910::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=1eafe57e246e79478c53922451cb56e77d15e8f8'] >Thread-106::DEBUG::2013-03-01 13:52:49,913::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-106::DEBUG::2013-03-01 13:52:49,914::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '352c3a1d-5473-41a5-9693-3da8286df38d_imageNS' >Thread-106::DEBUG::2013-03-01 13:52:49,914::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS' >Thread-106::DEBUG::2013-03-01 13:52:49,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-106::DEBUG::2013-03-01 13:52:49,953::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-106::DEBUG::2013-03-01 13:52:49,953::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-106::INFO::2013-03-01 13:52:49,954::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-106::DEBUG::2013-03-01 13:52:49,954::task::1151::TaskManager.Task::(prepare) Task=`7855bb0e-1306-42f4-afa4-1e66f1a1cf4d`::finished: None >Thread-106::DEBUG::2013-03-01 13:52:49,954::task::568::TaskManager.Task::(_updateState) Task=`7855bb0e-1306-42f4-afa4-1e66f1a1cf4d`::moving from state preparing -> state finished >Thread-106::DEBUG::2013-03-01 13:52:49,955::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-106::DEBUG::2013-03-01 13:52:49,955::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-106::DEBUG::2013-03-01 13:52:49,955::task::957::TaskManager.Task::(_decref) Task=`7855bb0e-1306-42f4-afa4-1e66f1a1cf4d`::ref 0 aborting False >Thread-132::DEBUG::2013-03-01 13:52:49,987::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-132::DEBUG::2013-03-01 13:52:49,987::task::568::TaskManager.Task::(_updateState) Task=`0090316d-cb97-4d02-8df3-43b5db8a4998`::moving from state init -> state preparing >Thread-132::INFO::2013-03-01 13:52:49,988::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', options=None) >Thread-132::DEBUG::2013-03-01 13:52:49,988::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`bdcb0f02-e5f9-496b-8033-490ca9c2b536`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-132::DEBUG::2013-03-01 13:52:49,988::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' for lock type 'shared' >Thread-132::DEBUG::2013-03-01 13:52:49,989::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free. Now locking as 'shared' (1 active user) >Thread-132::DEBUG::2013-03-01 13:52:49,989::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`bdcb0f02-e5f9-496b-8033-490ca9c2b536`::Granted request >Thread-132::DEBUG::2013-03-01 13:52:49,990::task::794::TaskManager.Task::(resourceAcquired) Task=`0090316d-cb97-4d02-8df3-43b5db8a4998`::_resourcesAcquired: Storage.352c3a1d-5473-41a5-9693-3da8286df38d (shared) >Thread-132::DEBUG::2013-03-01 13:52:49,990::task::957::TaskManager.Task::(_decref) Task=`0090316d-cb97-4d02-8df3-43b5db8a4998`::ref 1 aborting False >Thread-132::INFO::2013-03-01 13:52:49,992::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942131904512', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-132::DEBUG::2013-03-01 13:52:49,992::task::1151::TaskManager.Task::(prepare) Task=`0090316d-cb97-4d02-8df3-43b5db8a4998`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942131904512', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-132::DEBUG::2013-03-01 13:52:49,992::task::568::TaskManager.Task::(_updateState) Task=`0090316d-cb97-4d02-8df3-43b5db8a4998`::moving from state preparing -> state finished >Thread-132::DEBUG::2013-03-01 13:52:49,993::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.352c3a1d-5473-41a5-9693-3da8286df38d': < ResourceRef 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', isValid: 'True' obj: 'None'>} >Thread-132::DEBUG::2013-03-01 13:52:49,993::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2013-03-01 13:52:49,993::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' >Thread-132::DEBUG::2013-03-01 13:52:49,994::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' (0 active users) >Thread-132::DEBUG::2013-03-01 13:52:49,994::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free, finding out if anyone is waiting for it. >Thread-132::DEBUG::2013-03-01 13:52:49,994::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', Clearing records. >Thread-132::DEBUG::2013-03-01 13:52:49,994::task::957::TaskManager.Task::(_decref) Task=`0090316d-cb97-4d02-8df3-43b5db8a4998`::ref 0 aborting False >Thread-134::DEBUG::2013-03-01 13:52:51,383::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-134::DEBUG::2013-03-01 13:52:51,383::task::568::TaskManager.Task::(_updateState) Task=`6b4aa941-a93d-4950-9e77-10e56156d191`::moving from state init -> state preparing >Thread-134::INFO::2013-03-01 13:52:51,384::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-134::INFO::2013-03-01 13:52:51,384::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-134::DEBUG::2013-03-01 13:52:51,384::task::1151::TaskManager.Task::(prepare) Task=`6b4aa941-a93d-4950-9e77-10e56156d191`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-134::DEBUG::2013-03-01 13:52:51,384::task::568::TaskManager.Task::(_updateState) Task=`6b4aa941-a93d-4950-9e77-10e56156d191`::moving from state preparing -> state finished >Thread-134::DEBUG::2013-03-01 13:52:51,385::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134::DEBUG::2013-03-01 13:52:51,385::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134::DEBUG::2013-03-01 13:52:51,385::task::957::TaskManager.Task::(_decref) Task=`6b4aa941-a93d-4950-9e77-10e56156d191`::ref 0 aborting False >Thread-135::DEBUG::2013-03-01 13:52:51,432::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-135::DEBUG::2013-03-01 13:52:51,432::task::568::TaskManager.Task::(_updateState) Task=`5ea3f0b5-1bb9-4b20-9c9c-f99cba79ebc3`::moving from state init -> state preparing >Thread-135::INFO::2013-03-01 13:52:51,432::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-135::DEBUG::2013-03-01 13:52:51,437::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-135::INFO::2013-03-01 13:52:51,475::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-135::DEBUG::2013-03-01 13:52:51,475::task::1151::TaskManager.Task::(prepare) Task=`5ea3f0b5-1bb9-4b20-9c9c-f99cba79ebc3`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-135::DEBUG::2013-03-01 13:52:51,476::task::568::TaskManager.Task::(_updateState) Task=`5ea3f0b5-1bb9-4b20-9c9c-f99cba79ebc3`::moving from state preparing -> state finished >Thread-135::DEBUG::2013-03-01 13:52:51,476::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135::DEBUG::2013-03-01 13:52:51,476::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135::DEBUG::2013-03-01 13:52:51,477::task::957::TaskManager.Task::(_decref) Task=`5ea3f0b5-1bb9-4b20-9c9c-f99cba79ebc3`::ref 0 aborting False >Thread-136::DEBUG::2013-03-01 13:52:51,520::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-136::DEBUG::2013-03-01 13:52:51,520::task::568::TaskManager.Task::(_updateState) Task=`728859bf-dc2d-44a9-ba1e-1db7570ebeac`::moving from state init -> state preparing >Thread-136::INFO::2013-03-01 13:52:51,521::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', options=None) >Thread-136::DEBUG::2013-03-01 13:52:51,521::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136::DEBUG::2013-03-01 13:52:51,521::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-136::DEBUG::2013-03-01 13:52:51,522::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136::DEBUG::2013-03-01 13:52:51,522::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-136::DEBUG::2013-03-01 13:52:51,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-136::DEBUG::2013-03-01 13:52:51,537::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-136::DEBUG::2013-03-01 13:52:51,538::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:51,540::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:52,545::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:53,549::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:53,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:53,555::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-137::DEBUG::2013-03-01 13:52:54,480::task::568::TaskManager.Task::(_updateState) Task=`9f6ea9fe-602c-4d9f-903f-0943973763ad`::moving from state init -> state preparing >Thread-137::INFO::2013-03-01 13:52:54,486::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137::INFO::2013-03-01 13:52:54,488::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-137::DEBUG::2013-03-01 13:52:54,491::task::1151::TaskManager.Task::(prepare) Task=`9f6ea9fe-602c-4d9f-903f-0943973763ad`::finished: {} >Thread-137::DEBUG::2013-03-01 13:52:54,493::task::568::TaskManager.Task::(_updateState) Task=`9f6ea9fe-602c-4d9f-903f-0943973763ad`::moving from state preparing -> state finished >Thread-137::DEBUG::2013-03-01 13:52:54,496::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137::DEBUG::2013-03-01 13:52:54,498::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137::DEBUG::2013-03-01 13:52:54,501::task::957::TaskManager.Task::(_decref) Task=`9f6ea9fe-602c-4d9f-903f-0943973763ad`::ref 0 aborting False >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:54,561::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-136::DEBUG::2013-03-01 13:52:54,596::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-136::DEBUG::2013-03-01 13:52:56,602::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-136::DEBUG::2013-03-01 13:52:57,673::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-136::DEBUG::2013-03-01 13:52:57,674::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,674::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,674::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,675::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,675::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,675::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,676::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-136::DEBUG::2013-03-01 13:52:57,676::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-136::DEBUG::2013-03-01 13:52:57,677::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-136::DEBUG::2013-03-01 13:52:57,885::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-136::DEBUG::2013-03-01 13:52:57,885::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-136::INFO::2013-03-01 13:52:57,997::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-136::DEBUG::2013-03-01 13:52:57,998::task::1151::TaskManager.Task::(prepare) Task=`728859bf-dc2d-44a9-ba1e-1db7570ebeac`::finished: {'domlist': []} >Thread-136::DEBUG::2013-03-01 13:52:57,998::task::568::TaskManager.Task::(_updateState) Task=`728859bf-dc2d-44a9-ba1e-1db7570ebeac`::moving from state preparing -> state finished >Thread-136::DEBUG::2013-03-01 13:52:57,998::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2013-03-01 13:52:57,998::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2013-03-01 13:52:57,999::task::957::TaskManager.Task::(_decref) Task=`728859bf-dc2d-44a9-ba1e-1db7570ebeac`::ref 0 aborting False >Thread-166::DEBUG::2013-03-01 13:52:58,141::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-166::DEBUG::2013-03-01 13:52:58,141::task::568::TaskManager.Task::(_updateState) Task=`7c6f8b0d-21c0-44fe-9657-493800332761`::moving from state init -> state preparing >Thread-166::INFO::2013-03-01 13:52:58,142::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', domainName='nfsStorageTest_ISO', typeSpecificArg='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', domClass=2, domVersion='0', options=None) >Thread-166::DEBUG::2013-03-01 13:52:58,142::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-166::DEBUG::2013-03-01 13:52:58,143::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-166::DEBUG::2013-03-01 13:52:58,364::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-166::WARNING::2013-03-01 13:52:58,365::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-166::DEBUG::2013-03-01 13:52:58,365::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-166::INFO::2013-03-01 13:52:58,423::nfsSD::68::Storage.StorageDomain::(create) sdUUID=28973299-9d17-4683-a64e-9a5cec830fcd domainName=nfsStorageTest_ISO remotePath=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 domClass=2 >Thread-166::DEBUG::2013-03-01 13:52:58,694::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-166::DEBUG::2013-03-01 13:52:58,695::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-166::WARNING::2013-03-01 13:52:58,695::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-166::DEBUG::2013-03-01 13:52:58,696::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-166::DEBUG::2013-03-01 13:52:58,696::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-166::DEBUG::2013-03-01 13:52:58,696::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=f51aa52977d36c6c764a09ecbfa3ea10cd05243b'] >Thread-166::DEBUG::2013-03-01 13:52:58,744::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-166::DEBUG::2013-03-01 13:52:58,769::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-166::DEBUG::2013-03-01 13:52:58,769::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-166::DEBUG::2013-03-01 13:52:58,774::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=f51aa52977d36c6c764a09ecbfa3ea10cd05243b'] >Thread-166::DEBUG::2013-03-01 13:52:58,777::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-166::DEBUG::2013-03-01 13:52:58,778::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '28973299-9d17-4683-a64e-9a5cec830fcd_imageNS' >Thread-166::DEBUG::2013-03-01 13:52:58,778::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS' >Thread-166::DEBUG::2013-03-01 13:52:58,779::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-166::DEBUG::2013-03-01 13:52:58,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-166::DEBUG::2013-03-01 13:52:58,820::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-166::INFO::2013-03-01 13:52:58,821::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-166::DEBUG::2013-03-01 13:52:58,821::task::1151::TaskManager.Task::(prepare) Task=`7c6f8b0d-21c0-44fe-9657-493800332761`::finished: None >Thread-166::DEBUG::2013-03-01 13:52:58,821::task::568::TaskManager.Task::(_updateState) Task=`7c6f8b0d-21c0-44fe-9657-493800332761`::moving from state preparing -> state finished >Thread-166::DEBUG::2013-03-01 13:52:58,822::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-166::DEBUG::2013-03-01 13:52:58,822::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-166::DEBUG::2013-03-01 13:52:58,822::task::957::TaskManager.Task::(_decref) Task=`7c6f8b0d-21c0-44fe-9657-493800332761`::ref 0 aborting False >Thread-193::DEBUG::2013-03-01 13:52:58,871::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-193::DEBUG::2013-03-01 13:52:58,871::task::568::TaskManager.Task::(_updateState) Task=`c404d306-007a-46d0-8aa5-b518c891828f`::moving from state init -> state preparing >Thread-193::INFO::2013-03-01 13:52:58,922::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', options=None) >Thread-193::DEBUG::2013-03-01 13:52:58,923::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`c795ad48-5ab7-4f40-9b40-854bf7580ef3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-193::DEBUG::2013-03-01 13:52:58,923::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' for lock type 'shared' >Thread-193::DEBUG::2013-03-01 13:52:58,924::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free. Now locking as 'shared' (1 active user) >Thread-193::DEBUG::2013-03-01 13:52:58,924::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`c795ad48-5ab7-4f40-9b40-854bf7580ef3`::Granted request >Thread-193::DEBUG::2013-03-01 13:52:58,924::task::794::TaskManager.Task::(resourceAcquired) Task=`c404d306-007a-46d0-8aa5-b518c891828f`::_resourcesAcquired: Storage.28973299-9d17-4683-a64e-9a5cec830fcd (shared) >Thread-193::DEBUG::2013-03-01 13:52:58,925::task::957::TaskManager.Task::(_decref) Task=`c404d306-007a-46d0-8aa5-b518c891828f`::ref 1 aborting False >Thread-193::INFO::2013-03-01 13:52:58,926::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942131904512', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-193::DEBUG::2013-03-01 13:52:58,927::task::1151::TaskManager.Task::(prepare) Task=`c404d306-007a-46d0-8aa5-b518c891828f`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942131904512', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-193::DEBUG::2013-03-01 13:52:58,927::task::568::TaskManager.Task::(_updateState) Task=`c404d306-007a-46d0-8aa5-b518c891828f`::moving from state preparing -> state finished >Thread-193::DEBUG::2013-03-01 13:52:58,927::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.28973299-9d17-4683-a64e-9a5cec830fcd': < ResourceRef 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', isValid: 'True' obj: 'None'>} >Thread-193::DEBUG::2013-03-01 13:52:58,927::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-193::DEBUG::2013-03-01 13:52:58,928::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' >Thread-193::DEBUG::2013-03-01 13:52:58,928::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' (0 active users) >Thread-193::DEBUG::2013-03-01 13:52:58,928::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free, finding out if anyone is waiting for it. >Thread-193::DEBUG::2013-03-01 13:52:58,929::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', Clearing records. >Thread-193::DEBUG::2013-03-01 13:52:58,929::task::957::TaskManager.Task::(_decref) Task=`c404d306-007a-46d0-8aa5-b518c891828f`::ref 0 aborting False >Thread-194::DEBUG::2013-03-01 13:53:00,324::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-194::DEBUG::2013-03-01 13:53:00,325::task::568::TaskManager.Task::(_updateState) Task=`71e4b487-0150-42a3-93f9-629335dbd821`::moving from state init -> state preparing >Thread-194::INFO::2013-03-01 13:53:00,325::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-194::INFO::2013-03-01 13:53:00,325::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-194::DEBUG::2013-03-01 13:53:00,326::task::1151::TaskManager.Task::(prepare) Task=`71e4b487-0150-42a3-93f9-629335dbd821`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-194::DEBUG::2013-03-01 13:53:00,326::task::568::TaskManager.Task::(_updateState) Task=`71e4b487-0150-42a3-93f9-629335dbd821`::moving from state preparing -> state finished >Thread-194::DEBUG::2013-03-01 13:53:00,326::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-194::DEBUG::2013-03-01 13:53:00,326::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-194::DEBUG::2013-03-01 13:53:00,327::task::957::TaskManager.Task::(_decref) Task=`71e4b487-0150-42a3-93f9-629335dbd821`::ref 0 aborting False >Thread-195::DEBUG::2013-03-01 13:53:00,367::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-195::DEBUG::2013-03-01 13:53:00,367::task::568::TaskManager.Task::(_updateState) Task=`9c3f3654-d2ae-4cc6-8706-69946af7dca7`::moving from state init -> state preparing >Thread-195::INFO::2013-03-01 13:53:00,368::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-195::INFO::2013-03-01 13:53:00,371::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-195::DEBUG::2013-03-01 13:53:00,371::task::1151::TaskManager.Task::(prepare) Task=`9c3f3654-d2ae-4cc6-8706-69946af7dca7`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-195::DEBUG::2013-03-01 13:53:00,372::task::568::TaskManager.Task::(_updateState) Task=`9c3f3654-d2ae-4cc6-8706-69946af7dca7`::moving from state preparing -> state finished >Thread-195::DEBUG::2013-03-01 13:53:00,372::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-195::DEBUG::2013-03-01 13:53:00,372::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-195::DEBUG::2013-03-01 13:53:00,373::task::957::TaskManager.Task::(_decref) Task=`9c3f3654-d2ae-4cc6-8706-69946af7dca7`::ref 0 aborting False >Thread-196::DEBUG::2013-03-01 13:53:00,425::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-196::DEBUG::2013-03-01 13:53:00,426::task::568::TaskManager.Task::(_updateState) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::moving from state init -> state preparing >Thread-196::INFO::2013-03-01 13:53:00,426::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', poolName='nfsStorageTest', masterDom='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', domList=['ea6b50ab-6bf1-46b8-bdd7-c762d569c49c'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-196::INFO::2013-03-01 13:53:00,427::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::DEBUG::2013-03-01 13:53:00,431::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=989dddd4b583c25ee4dc9da9aeec78c2817fa0ca'] >Thread-196::DEBUG::2013-03-01 13:53:00,432::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`f7a47ede-a23c-4f45-84a4-f789be76f6ad`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-196::DEBUG::2013-03-01 13:53:00,432::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-196::DEBUG::2013-03-01 13:53:00,432::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-196::DEBUG::2013-03-01 13:53:00,433::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`f7a47ede-a23c-4f45-84a4-f789be76f6ad`::Granted request >Thread-196::DEBUG::2013-03-01 13:53:00,433::task::794::TaskManager.Task::(resourceAcquired) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-196::DEBUG::2013-03-01 13:53:00,434::task::957::TaskManager.Task::(_decref) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::ref 1 aborting False >Thread-196::DEBUG::2013-03-01 13:53:00,434::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`de9ac30d-b661-4e30-b1f8-5aae26c4d63f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-196::DEBUG::2013-03-01 13:53:00,434::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >Thread-196::DEBUG::2013-03-01 13:53:00,435::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >Thread-196::DEBUG::2013-03-01 13:53:00,435::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`de9ac30d-b661-4e30-b1f8-5aae26c4d63f`::Granted request >Thread-196::DEBUG::2013-03-01 13:53:00,435::task::794::TaskManager.Task::(resourceAcquired) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::_resourcesAcquired: Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (exclusive) >Thread-196::DEBUG::2013-03-01 13:53:00,436::task::957::TaskManager.Task::(_decref) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::ref 1 aborting False >Thread-196::INFO::2013-03-01 13:53:00,436::sp::543::Storage.StoragePool::(create) spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 poolName=nfsStorageTest master_sd=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c domList=['ea6b50ab-6bf1-46b8-bdd7-c762d569c49c'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-196::INFO::2013-03-01 13:53:00,437::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::DEBUG::2013-03-01 13:53:00,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=989dddd4b583c25ee4dc9da9aeec78c2817fa0ca'] >Thread-196::DEBUG::2013-03-01 13:53:00,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=989dddd4b583c25ee4dc9da9aeec78c2817fa0ca'] >Thread-196::DEBUG::2013-03-01 13:53:00,445::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-196::DEBUG::2013-03-01 13:53:00,445::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-196::DEBUG::2013-03-01 13:53:00,445::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=83e63722153582473b0931bf4784a8f6739d1bc1'] >Thread-196::DEBUG::2013-03-01 13:53:00,508::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-196::DEBUG::2013-03-01 13:53:00,508::clusterlock::81::SafeLease::(acquireHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1000) >Thread-196::DEBUG::2013-03-01 13:53:00,509::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::DEBUG::2013-03-01 13:53:00,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start ea6b50ab-6bf1-46b8-bdd7-c762d569c49c 1000 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-200::DEBUG::2013-03-01 13:53:09,881::task::568::TaskManager.Task::(_updateState) Task=`27bd3d6f-dfb5-4196-a5a3-b6a1c236eb64`::moving from state init -> state preparing >Thread-200::INFO::2013-03-01 13:53:09,881::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-200::INFO::2013-03-01 13:53:09,882::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-200::DEBUG::2013-03-01 13:53:09,882::task::1151::TaskManager.Task::(prepare) Task=`27bd3d6f-dfb5-4196-a5a3-b6a1c236eb64`::finished: {} >Thread-200::DEBUG::2013-03-01 13:53:09,882::task::568::TaskManager.Task::(_updateState) Task=`27bd3d6f-dfb5-4196-a5a3-b6a1c236eb64`::moving from state preparing -> state finished >Thread-200::DEBUG::2013-03-01 13:53:09,882::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-200::DEBUG::2013-03-01 13:53:09,882::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-200::DEBUG::2013-03-01 13:53:09,883::task::957::TaskManager.Task::(_decref) Task=`27bd3d6f-dfb5-4196-a5a3-b6a1c236eb64`::ref 0 aborting False >Thread-196::DEBUG::2013-03-01 13:53:20,826::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-196::DEBUG::2013-03-01 13:53:20,834::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-196::INFO::2013-03-01 13:53:20,839::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 56be65b1-c08c-4688-bc80-a72136fefb12 on sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::DEBUG::2013-03-01 13:53:20,843::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-196::DEBUG::2013-03-01 13:53:20,849::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-196::DEBUG::2013-03-01 13:53:20,892::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=83e63722153582473b0931bf4784a8f6739d1bc1'] >Thread-196::DEBUG::2013-03-01 13:53:20,898::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-196::DEBUG::2013-03-01 13:53:20,901::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-196::DEBUG::2013-03-01 13:53:20,905::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-196::DEBUG::2013-03-01 13:53:20,907::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-196::DEBUG::2013-03-01 13:53:20,912::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >Thread-196::DEBUG::2013-03-01 13:53:21,018::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-196::DEBUG::2013-03-01 13:53:21,024::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-196::DEBUG::2013-03-01 13:53:21,026::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-196::DEBUG::2013-03-01 13:53:21,029::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-196::DEBUG::2013-03-01 13:53:21,063::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >Thread-196::DEBUG::2013-03-01 13:53:21,076::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` started monitoring domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >Thread-205::DEBUG::2013-03-01 13:53:21,077::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::DEBUG::2013-03-01 13:53:21,087::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-196::WARNING::2013-03-01 13:53:21,104::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-196::DEBUG::2013-03-01 13:53:21,210::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-196::DEBUG::2013-03-01 13:53:21,292::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-196::DEBUG::2013-03-01 13:53:22,878::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-196::DEBUG::2013-03-01 13:53:22,879::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-196::INFO::2013-03-01 13:53:22,937::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::INFO::2013-03-01 13:53:22,938::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-196::INFO::2013-03-01 13:53:22,939::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-196::DEBUG::2013-03-01 13:53:22,939::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd /usr/libexec/vdsm) >Thread-196::DEBUG::2013-03-01 13:53:23,999::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-196::DEBUG::2013-03-01 13:53:24,000::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-196::DEBUG::2013-03-01 13:53:24,000::clusterlock::85::SafeLease::(releaseHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c released successfully (id: 1000) >Thread-205::DEBUG::2013-03-01 13:53:24,000::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-205::DEBUG::2013-03-01 13:53:24,001::clusterlock::85::SafeLease::(releaseHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c released successfully (id: 1000) >Thread-196::INFO::2013-03-01 13:53:24,001::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-196::DEBUG::2013-03-01 13:53:24,002::task::1151::TaskManager.Task::(prepare) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::finished: True >Thread-196::DEBUG::2013-03-01 13:53:24,002::task::568::TaskManager.Task::(_updateState) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::moving from state preparing -> state finished >Thread-196::DEBUG::2013-03-01 13:53:24,002::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': < ResourceRef 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', isValid: 'True' obj: 'None'>} >Thread-196::DEBUG::2013-03-01 13:53:24,002::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-196::DEBUG::2013-03-01 13:53:24,003::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-196::DEBUG::2013-03-01 13:53:24,003::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-196::DEBUG::2013-03-01 13:53:24,004::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-196::DEBUG::2013-03-01 13:53:24,004::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-196::DEBUG::2013-03-01 13:53:24,004::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >Thread-196::DEBUG::2013-03-01 13:53:24,005::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >Thread-196::DEBUG::2013-03-01 13:53:24,005::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >Thread-196::DEBUG::2013-03-01 13:53:24,005::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >Thread-196::DEBUG::2013-03-01 13:53:24,005::task::957::TaskManager.Task::(_decref) Task=`a46b5dff-db6d-4c42-bdbf-c80eec43c7e0`::ref 0 aborting False >Thread-233::DEBUG::2013-03-01 13:53:24,100::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-233::DEBUG::2013-03-01 13:53:24,101::task::568::TaskManager.Task::(_updateState) Task=`ce137596-1616-4afc-8c3a-2afc643d9360`::moving from state init -> state preparing >Thread-233::INFO::2013-03-01 13:53:24,101::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-233::INFO::2013-03-01 13:53:24,101::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-233::DEBUG::2013-03-01 13:53:24,102::task::1151::TaskManager.Task::(prepare) Task=`ce137596-1616-4afc-8c3a-2afc643d9360`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-233::DEBUG::2013-03-01 13:53:24,102::task::568::TaskManager.Task::(_updateState) Task=`ce137596-1616-4afc-8c3a-2afc643d9360`::moving from state preparing -> state finished >Thread-233::DEBUG::2013-03-01 13:53:24,102::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-233::DEBUG::2013-03-01 13:53:24,102::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-233::DEBUG::2013-03-01 13:53:24,103::task::957::TaskManager.Task::(_decref) Task=`ce137596-1616-4afc-8c3a-2afc643d9360`::ref 0 aborting False >Thread-234::DEBUG::2013-03-01 13:53:24,145::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-234::DEBUG::2013-03-01 13:53:24,146::task::568::TaskManager.Task::(_updateState) Task=`cbc20de3-005a-4e95-84f4-6f3e62bf81c4`::moving from state init -> state preparing >Thread-234::INFO::2013-03-01 13:53:24,146::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-234::INFO::2013-03-01 13:53:24,149::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-234::DEBUG::2013-03-01 13:53:24,150::task::1151::TaskManager.Task::(prepare) Task=`cbc20de3-005a-4e95-84f4-6f3e62bf81c4`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-234::DEBUG::2013-03-01 13:53:24,150::task::568::TaskManager.Task::(_updateState) Task=`cbc20de3-005a-4e95-84f4-6f3e62bf81c4`::moving from state preparing -> state finished >Thread-234::DEBUG::2013-03-01 13:53:24,150::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-234::DEBUG::2013-03-01 13:53:24,150::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-234::DEBUG::2013-03-01 13:53:24,151::task::957::TaskManager.Task::(_decref) Task=`cbc20de3-005a-4e95-84f4-6f3e62bf81c4`::ref 0 aborting False >Thread-235::DEBUG::2013-03-01 13:53:24,234::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-235::DEBUG::2013-03-01 13:53:24,234::task::568::TaskManager.Task::(_updateState) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::moving from state init -> state preparing >Thread-235::INFO::2013-03-01 13:53:24,235::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-235::ERROR::2013-03-01 13:53:24,235::task::833::TaskManager.Task::(_setError) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 603, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 313, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('56be65b1-c08c-4688-bc80-a72136fefb12',) >Thread-235::DEBUG::2013-03-01 13:53:24,237::task::852::TaskManager.Task::(_run) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::Task._run: 4c0cc797-be66-4339-bd49-831ef57cb71a ('56be65b1-c08c-4688-bc80-a72136fefb12',) {} failed - stopping task >Thread-235::DEBUG::2013-03-01 13:53:24,238::task::1177::TaskManager.Task::(stop) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::stopping in state preparing (force False) >Thread-235::DEBUG::2013-03-01 13:53:24,238::task::957::TaskManager.Task::(_decref) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::ref 1 aborting True >Thread-235::INFO::2013-03-01 13:53:24,238::task::1134::TaskManager.Task::(prepare) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-235::DEBUG::2013-03-01 13:53:24,238::task::1139::TaskManager.Task::(prepare) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::Prepare: aborted: Unknown pool id, pool not connected >Thread-235::DEBUG::2013-03-01 13:53:24,239::task::957::TaskManager.Task::(_decref) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::ref 0 aborting True >Thread-235::DEBUG::2013-03-01 13:53:24,239::task::892::TaskManager.Task::(_doAbort) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::Task._doAbort: force False >Thread-235::DEBUG::2013-03-01 13:53:24,239::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-235::DEBUG::2013-03-01 13:53:24,240::task::568::TaskManager.Task::(_updateState) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::moving from state preparing -> state aborting >Thread-235::DEBUG::2013-03-01 13:53:24,240::task::523::TaskManager.Task::(__state_aborting) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::_aborting: recover policy none >Thread-235::DEBUG::2013-03-01 13:53:24,240::task::568::TaskManager.Task::(_updateState) Task=`4c0cc797-be66-4339-bd49-831ef57cb71a`::moving from state aborting -> state failed >Thread-235::DEBUG::2013-03-01 13:53:24,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-235::DEBUG::2013-03-01 13:53:24,241::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-235::ERROR::2013-03-01 13:53:24,241::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('56be65b1-c08c-4688-bc80-a72136fefb12',)", 'code': 309}} >Thread-236::DEBUG::2013-03-01 13:53:24,319::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-236::DEBUG::2013-03-01 13:53:24,320::task::568::TaskManager.Task::(_updateState) Task=`82b8cd3c-0d67-4d7a-9174-69c4816edea9`::moving from state init -> state preparing >Thread-236::INFO::2013-03-01 13:53:24,320::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', hostID=1, scsiKey='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-236::DEBUG::2013-03-01 13:53:24,321::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`1bd417a7-10a8-42ea-95ac-4b2ee45573b6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-236::DEBUG::2013-03-01 13:53:24,321::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-236::DEBUG::2013-03-01 13:53:24,322::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-236::DEBUG::2013-03-01 13:53:24,322::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`1bd417a7-10a8-42ea-95ac-4b2ee45573b6`::Granted request >Thread-236::INFO::2013-03-01 13:53:24,322::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 56be65b1-c08c-4688-bc80-a72136fefb12 with master domain: ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (ver = 1) >Thread-236::DEBUG::2013-03-01 13:53:24,323::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:24,323::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:24,324::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:24,324::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:24,324::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:24,325::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:24,325::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-236::DEBUG::2013-03-01 13:53:24,325::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-236::DEBUG::2013-03-01 13:53:24,326::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-236::DEBUG::2013-03-01 13:53:24,326::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-236::DEBUG::2013-03-01 13:53:24,326::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-236::DEBUG::2013-03-01 13:53:24,341::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-236::DEBUG::2013-03-01 13:53:24,341::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:24,345::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-237::DEBUG::2013-03-01 13:53:25,311::task::568::TaskManager.Task::(_updateState) Task=`884c6939-b831-453a-a973-9f8937e2e7f1`::moving from state init -> state preparing >Thread-237::INFO::2013-03-01 13:53:25,311::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-237::INFO::2013-03-01 13:53:25,311::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-237::DEBUG::2013-03-01 13:53:25,311::task::1151::TaskManager.Task::(prepare) Task=`884c6939-b831-453a-a973-9f8937e2e7f1`::finished: {} >Thread-237::DEBUG::2013-03-01 13:53:25,312::task::568::TaskManager.Task::(_updateState) Task=`884c6939-b831-453a-a973-9f8937e2e7f1`::moving from state preparing -> state finished >Thread-237::DEBUG::2013-03-01 13:53:25,312::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-237::DEBUG::2013-03-01 13:53:25,312::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-237::DEBUG::2013-03-01 13:53:25,312::task::957::TaskManager.Task::(_decref) Task=`884c6939-b831-453a-a973-9f8937e2e7f1`::ref 0 aborting False >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:25,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:26,354::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:27,358::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:28,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:29,367::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-236::DEBUG::2013-03-01 13:53:30,371::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-236::DEBUG::2013-03-01 13:53:32,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-236::DEBUG::2013-03-01 13:53:33,474::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-236::DEBUG::2013-03-01 13:53:33,475::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,475::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,476::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,476::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,476::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,477::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,477::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-236::DEBUG::2013-03-01 13:53:33,477::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,479::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-236::DEBUG::2013-03-01 13:53:33,657::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-236::WARNING::2013-03-01 13:53:33,658::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-236::DEBUG::2013-03-01 13:53:33,659::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,709::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-236::DEBUG::2013-03-01 13:53:33,709::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-236::DEBUG::2013-03-01 13:53:33,717::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >Thread-236::DEBUG::2013-03-01 13:53:33,719::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-236::WARNING::2013-03-01 13:53:33,719::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-236::WARNING::2013-03-01 13:53:33,720::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-236::DEBUG::2013-03-01 13:53:33,720::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-236::DEBUG::2013-03-01 13:53:33,720::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-236::DEBUG::2013-03-01 13:53:33,721::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-236::DEBUG::2013-03-01 13:53:33,724::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >Thread-236::DEBUG::2013-03-01 13:53:33,725::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` started monitoring domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >Thread-259::DEBUG::2013-03-01 13:53:33,725::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-236::DEBUG::2013-03-01 13:53:33,726::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-236::WARNING::2013-03-01 13:53:33,727::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-236::DEBUG::2013-03-01 13:53:33,730::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-236::DEBUG::2013-03-01 13:53:33,734::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-236::DEBUG::2013-03-01 13:53:33,943::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-236::DEBUG::2013-03-01 13:53:33,943::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-236::INFO::2013-03-01 13:53:34,004::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-236::INFO::2013-03-01 13:53:34,004::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-236::DEBUG::2013-03-01 13:53:34,005::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-236::DEBUG::2013-03-01 13:53:34,005::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-236::DEBUG::2013-03-01 13:53:34,006::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2013-03-01 13:53:34,006::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-236::INFO::2013-03-01 13:53:34,006::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-236::DEBUG::2013-03-01 13:53:34,006::task::1151::TaskManager.Task::(prepare) Task=`82b8cd3c-0d67-4d7a-9174-69c4816edea9`::finished: True >Thread-236::DEBUG::2013-03-01 13:53:34,007::task::568::TaskManager.Task::(_updateState) Task=`82b8cd3c-0d67-4d7a-9174-69c4816edea9`::moving from state preparing -> state finished >Thread-236::DEBUG::2013-03-01 13:53:34,007::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-236::DEBUG::2013-03-01 13:53:34,007::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2013-03-01 13:53:34,008::task::957::TaskManager.Task::(_decref) Task=`82b8cd3c-0d67-4d7a-9174-69c4816edea9`::ref 0 aborting False >Thread-286::DEBUG::2013-03-01 13:53:34,044::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-286::DEBUG::2013-03-01 13:53:34,044::task::568::TaskManager.Task::(_updateState) Task=`3740e95e-8c26-4733-b7e3-f1042df02e07`::moving from state init -> state preparing >Thread-286::INFO::2013-03-01 13:53:34,045::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-286::INFO::2013-03-01 13:53:34,045::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-286::DEBUG::2013-03-01 13:53:34,045::task::1151::TaskManager.Task::(prepare) Task=`3740e95e-8c26-4733-b7e3-f1042df02e07`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-286::DEBUG::2013-03-01 13:53:34,046::task::568::TaskManager.Task::(_updateState) Task=`3740e95e-8c26-4733-b7e3-f1042df02e07`::moving from state preparing -> state finished >Thread-286::DEBUG::2013-03-01 13:53:34,046::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286::DEBUG::2013-03-01 13:53:34,046::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286::DEBUG::2013-03-01 13:53:34,046::task::957::TaskManager.Task::(_decref) Task=`3740e95e-8c26-4733-b7e3-f1042df02e07`::ref 0 aborting False >Thread-287::DEBUG::2013-03-01 13:53:34,107::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-287::DEBUG::2013-03-01 13:53:34,108::task::568::TaskManager.Task::(_updateState) Task=`5851c941-31b5-4300-93df-0a457e738480`::moving from state init -> state preparing >Thread-287::INFO::2013-03-01 13:53:34,108::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-287::DEBUG::2013-03-01 13:53:34,109::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`81cb93b7-f507-48a4-8b98-8d66c479f783`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-287::DEBUG::2013-03-01 13:53:34,109::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-287::DEBUG::2013-03-01 13:53:34,110::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-287::DEBUG::2013-03-01 13:53:34,110::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`81cb93b7-f507-48a4-8b98-8d66c479f783`::Granted request >Thread-287::DEBUG::2013-03-01 13:53:34,110::task::794::TaskManager.Task::(resourceAcquired) Task=`5851c941-31b5-4300-93df-0a457e738480`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-287::DEBUG::2013-03-01 13:53:34,111::task::957::TaskManager.Task::(_decref) Task=`5851c941-31b5-4300-93df-0a457e738480`::ref 1 aborting False >Thread-287::INFO::2013-03-01 13:53:34,111::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-287::DEBUG::2013-03-01 13:53:34,111::task::1146::TaskManager.Task::(prepare) Task=`5851c941-31b5-4300-93df-0a457e738480`::Prepare: 1 jobs exist, move to acquiring >Thread-287::DEBUG::2013-03-01 13:53:34,112::task::568::TaskManager.Task::(_updateState) Task=`5851c941-31b5-4300-93df-0a457e738480`::moving from state preparing -> state acquiring >Thread-287::DEBUG::2013-03-01 13:53:34,112::task::568::TaskManager.Task::(_updateState) Task=`5851c941-31b5-4300-93df-0a457e738480`::moving from state acquiring -> state queued >Thread-287::DEBUG::2013-03-01 13:53:34,112::taskManager::50::TaskManager::(_queueTask) queuing task: 5851c941-31b5-4300-93df-0a457e738480 >Thread-287::DEBUG::2013-03-01 13:53:34,112::taskManager::56::TaskManager::(_queueTask) task queued: 5851c941-31b5-4300-93df-0a457e738480 >Thread-7::DEBUG::2013-03-01 13:53:34,113::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-287::DEBUG::2013-03-01 13:53:34,114::task::1148::TaskManager.Task::(prepare) Task=`5851c941-31b5-4300-93df-0a457e738480`::returning >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,115::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 5851c941-31b5-4300-93df-0a457e738480 running: <bound method Task.commit of <storage.task.Task instance at 0x7fbb6814abd8>> with: None >Thread-287::DEBUG::2013-03-01 13:53:34,116::task::957::TaskManager.Task::(_decref) Task=`5851c941-31b5-4300-93df-0a457e738480`::ref 0 aborting False >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,117::task::1159::TaskManager.Task::(commit) Task=`5851c941-31b5-4300-93df-0a457e738480`::committing task: 5851c941-31b5-4300-93df-0a457e738480 >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,119::task::568::TaskManager.Task::(_updateState) Task=`5851c941-31b5-4300-93df-0a457e738480`::moving from state queued -> state running >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,121::task::872::TaskManager.Task::(_runJobs) Task=`5851c941-31b5-4300-93df-0a457e738480`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x1460f50>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,121::task::304::TaskManager.Task::(run) Task=`5851c941-31b5-4300-93df-0a457e738480`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x1460f50>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,122::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,122::misc::1055::SamplingMethod::(__call__) Got in to sampling method >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,126::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,126::misc::1063::SamplingMethod::(__call__) Returning last result >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,130::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,131::clusterlock::81::SafeLease::(acquireHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,131::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:34,132::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start ea6b50ab-6bf1-46b8-bdd7-c762d569c49c 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-289::DEBUG::2013-03-01 13:53:35,155::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-289::DEBUG::2013-03-01 13:53:35,156::task::568::TaskManager.Task::(_updateState) Task=`4bc3a5e1-e795-471c-9db2-30b42e26962f`::moving from state init -> state preparing >Thread-289::INFO::2013-03-01 13:53:35,157::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-289::DEBUG::2013-03-01 13:53:35,157::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-289::DEBUG::2013-03-01 13:53:35,157::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-289::INFO::2013-03-01 13:53:35,157::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-289::DEBUG::2013-03-01 13:53:35,158::task::1151::TaskManager.Task::(prepare) Task=`4bc3a5e1-e795-471c-9db2-30b42e26962f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-289::DEBUG::2013-03-01 13:53:35,158::task::568::TaskManager.Task::(_updateState) Task=`4bc3a5e1-e795-471c-9db2-30b42e26962f`::moving from state preparing -> state finished >Thread-289::DEBUG::2013-03-01 13:53:35,158::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-289::DEBUG::2013-03-01 13:53:35,158::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-289::DEBUG::2013-03-01 13:53:35,159::task::957::TaskManager.Task::(_decref) Task=`4bc3a5e1-e795-471c-9db2-30b42e26962f`::ref 0 aborting False >Thread-290::DEBUG::2013-03-01 13:53:36,260::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-290::DEBUG::2013-03-01 13:53:36,265::task::568::TaskManager.Task::(_updateState) Task=`9e097d7d-eece-4705-8c42-2a4b4784a251`::moving from state init -> state preparing >Thread-290::INFO::2013-03-01 13:53:36,268::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-290::DEBUG::2013-03-01 13:53:36,271::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-290::DEBUG::2013-03-01 13:53:36,274::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-290::INFO::2013-03-01 13:53:36,277::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-290::DEBUG::2013-03-01 13:53:36,279::task::1151::TaskManager.Task::(prepare) Task=`9e097d7d-eece-4705-8c42-2a4b4784a251`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-290::DEBUG::2013-03-01 13:53:36,282::task::568::TaskManager.Task::(_updateState) Task=`9e097d7d-eece-4705-8c42-2a4b4784a251`::moving from state preparing -> state finished >Thread-290::DEBUG::2013-03-01 13:53:36,286::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-290::DEBUG::2013-03-01 13:53:36,288::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-290::DEBUG::2013-03-01 13:53:36,291::task::957::TaskManager.Task::(_decref) Task=`9e097d7d-eece-4705-8c42-2a4b4784a251`::ref 0 aborting False >Thread-291::DEBUG::2013-03-01 13:53:37,397::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-291::DEBUG::2013-03-01 13:53:37,402::task::568::TaskManager.Task::(_updateState) Task=`21c7e06c-a7e3-4926-8616-11323ee1d2d6`::moving from state init -> state preparing >Thread-291::INFO::2013-03-01 13:53:37,405::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-291::DEBUG::2013-03-01 13:53:37,407::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-291::DEBUG::2013-03-01 13:53:37,410::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-291::INFO::2013-03-01 13:53:37,413::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-291::DEBUG::2013-03-01 13:53:37,415::task::1151::TaskManager.Task::(prepare) Task=`21c7e06c-a7e3-4926-8616-11323ee1d2d6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-291::DEBUG::2013-03-01 13:53:37,418::task::568::TaskManager.Task::(_updateState) Task=`21c7e06c-a7e3-4926-8616-11323ee1d2d6`::moving from state preparing -> state finished >Thread-291::DEBUG::2013-03-01 13:53:37,421::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-291::DEBUG::2013-03-01 13:53:37,423::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-291::DEBUG::2013-03-01 13:53:37,426::task::957::TaskManager.Task::(_decref) Task=`21c7e06c-a7e3-4926-8616-11323ee1d2d6`::ref 0 aborting False >Thread-293::DEBUG::2013-03-01 13:53:38,477::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-293::DEBUG::2013-03-01 13:53:38,477::task::568::TaskManager.Task::(_updateState) Task=`132b14d8-9e3b-452e-9fe2-d73cb2400bde`::moving from state init -> state preparing >Thread-293::INFO::2013-03-01 13:53:38,478::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-293::DEBUG::2013-03-01 13:53:38,478::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-293::DEBUG::2013-03-01 13:53:38,478::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-293::INFO::2013-03-01 13:53:38,478::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-293::DEBUG::2013-03-01 13:53:38,478::task::1151::TaskManager.Task::(prepare) Task=`132b14d8-9e3b-452e-9fe2-d73cb2400bde`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-293::DEBUG::2013-03-01 13:53:38,479::task::568::TaskManager.Task::(_updateState) Task=`132b14d8-9e3b-452e-9fe2-d73cb2400bde`::moving from state preparing -> state finished >Thread-293::DEBUG::2013-03-01 13:53:38,479::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-293::DEBUG::2013-03-01 13:53:38,479::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-293::DEBUG::2013-03-01 13:53:38,479::task::957::TaskManager.Task::(_decref) Task=`132b14d8-9e3b-452e-9fe2-d73cb2400bde`::ref 0 aborting False >Thread-294::DEBUG::2013-03-01 13:53:39,509::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-294::DEBUG::2013-03-01 13:53:39,509::task::568::TaskManager.Task::(_updateState) Task=`25ad03f4-01b9-4957-860f-a4f7452702c8`::moving from state init -> state preparing >Thread-294::INFO::2013-03-01 13:53:39,510::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-294::DEBUG::2013-03-01 13:53:39,510::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-294::DEBUG::2013-03-01 13:53:39,510::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-294::INFO::2013-03-01 13:53:39,510::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-294::DEBUG::2013-03-01 13:53:39,511::task::1151::TaskManager.Task::(prepare) Task=`25ad03f4-01b9-4957-860f-a4f7452702c8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-294::DEBUG::2013-03-01 13:53:39,511::task::568::TaskManager.Task::(_updateState) Task=`25ad03f4-01b9-4957-860f-a4f7452702c8`::moving from state preparing -> state finished >Thread-294::DEBUG::2013-03-01 13:53:39,511::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-294::DEBUG::2013-03-01 13:53:39,511::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-294::DEBUG::2013-03-01 13:53:39,512::task::957::TaskManager.Task::(_decref) Task=`25ad03f4-01b9-4957-860f-a4f7452702c8`::ref 0 aborting False >Thread-295::DEBUG::2013-03-01 13:53:40,541::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-295::DEBUG::2013-03-01 13:53:40,542::task::568::TaskManager.Task::(_updateState) Task=`59d8d018-be0c-4603-a54c-4ea9b652f495`::moving from state init -> state preparing >Thread-295::INFO::2013-03-01 13:53:40,564::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-295::DEBUG::2013-03-01 13:53:40,564::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-295::DEBUG::2013-03-01 13:53:40,565::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-295::INFO::2013-03-01 13:53:40,565::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-295::DEBUG::2013-03-01 13:53:40,565::task::1151::TaskManager.Task::(prepare) Task=`59d8d018-be0c-4603-a54c-4ea9b652f495`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-295::DEBUG::2013-03-01 13:53:40,565::task::568::TaskManager.Task::(_updateState) Task=`59d8d018-be0c-4603-a54c-4ea9b652f495`::moving from state preparing -> state finished >Thread-295::DEBUG::2013-03-01 13:53:40,566::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-295::DEBUG::2013-03-01 13:53:40,566::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-295::DEBUG::2013-03-01 13:53:40,566::task::957::TaskManager.Task::(_decref) Task=`59d8d018-be0c-4603-a54c-4ea9b652f495`::ref 0 aborting False >Thread-296::DEBUG::2013-03-01 13:53:40,700::task::568::TaskManager.Task::(_updateState) Task=`9bec4ea9-4acc-4633-833f-0df46a2bd8e8`::moving from state init -> state preparing >Thread-296::INFO::2013-03-01 13:53:40,701::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-296::INFO::2013-03-01 13:53:40,701::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00272512435913', 'lastCheck': '7.0', 'code': 0, 'valid': True}} >Thread-296::DEBUG::2013-03-01 13:53:40,701::task::1151::TaskManager.Task::(prepare) Task=`9bec4ea9-4acc-4633-833f-0df46a2bd8e8`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00272512435913', 'lastCheck': '7.0', 'code': 0, 'valid': True}} >Thread-296::DEBUG::2013-03-01 13:53:40,701::task::568::TaskManager.Task::(_updateState) Task=`9bec4ea9-4acc-4633-833f-0df46a2bd8e8`::moving from state preparing -> state finished >Thread-296::DEBUG::2013-03-01 13:53:40,702::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-296::DEBUG::2013-03-01 13:53:40,702::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-296::DEBUG::2013-03-01 13:53:40,702::task::957::TaskManager.Task::(_decref) Task=`9bec4ea9-4acc-4633-833f-0df46a2bd8e8`::ref 0 aborting False >Thread-298::DEBUG::2013-03-01 13:53:41,596::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-298::DEBUG::2013-03-01 13:53:41,596::task::568::TaskManager.Task::(_updateState) Task=`cbdf3265-c7fb-42c3-bf7b-b8f8b799bf3b`::moving from state init -> state preparing >Thread-298::INFO::2013-03-01 13:53:41,596::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-298::DEBUG::2013-03-01 13:53:41,597::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-298::DEBUG::2013-03-01 13:53:41,597::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-298::INFO::2013-03-01 13:53:41,597::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-298::DEBUG::2013-03-01 13:53:41,597::task::1151::TaskManager.Task::(prepare) Task=`cbdf3265-c7fb-42c3-bf7b-b8f8b799bf3b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-298::DEBUG::2013-03-01 13:53:41,598::task::568::TaskManager.Task::(_updateState) Task=`cbdf3265-c7fb-42c3-bf7b-b8f8b799bf3b`::moving from state preparing -> state finished >Thread-298::DEBUG::2013-03-01 13:53:41,598::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-298::DEBUG::2013-03-01 13:53:41,598::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-298::DEBUG::2013-03-01 13:53:41,598::task::957::TaskManager.Task::(_decref) Task=`cbdf3265-c7fb-42c3-bf7b-b8f8b799bf3b`::ref 0 aborting False >Thread-299::DEBUG::2013-03-01 13:53:42,630::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-299::DEBUG::2013-03-01 13:53:42,631::task::568::TaskManager.Task::(_updateState) Task=`352f202a-98c5-4499-83f1-e84c6876b8cb`::moving from state init -> state preparing >Thread-299::INFO::2013-03-01 13:53:42,631::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-299::DEBUG::2013-03-01 13:53:42,631::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-299::DEBUG::2013-03-01 13:53:42,631::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-299::INFO::2013-03-01 13:53:42,632::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-299::DEBUG::2013-03-01 13:53:42,632::task::1151::TaskManager.Task::(prepare) Task=`352f202a-98c5-4499-83f1-e84c6876b8cb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-299::DEBUG::2013-03-01 13:53:42,632::task::568::TaskManager.Task::(_updateState) Task=`352f202a-98c5-4499-83f1-e84c6876b8cb`::moving from state preparing -> state finished >Thread-299::DEBUG::2013-03-01 13:53:42,632::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-299::DEBUG::2013-03-01 13:53:42,632::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-299::DEBUG::2013-03-01 13:53:42,633::task::957::TaskManager.Task::(_decref) Task=`352f202a-98c5-4499-83f1-e84c6876b8cb`::ref 0 aborting False >Thread-300::DEBUG::2013-03-01 13:53:43,666::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-300::DEBUG::2013-03-01 13:53:43,666::task::568::TaskManager.Task::(_updateState) Task=`4fa50b91-ef8a-4d15-897f-0e5c1e81b9e0`::moving from state init -> state preparing >Thread-300::INFO::2013-03-01 13:53:43,666::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-300::DEBUG::2013-03-01 13:53:43,666::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-300::DEBUG::2013-03-01 13:53:43,667::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-300::INFO::2013-03-01 13:53:43,667::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-300::DEBUG::2013-03-01 13:53:43,667::task::1151::TaskManager.Task::(prepare) Task=`4fa50b91-ef8a-4d15-897f-0e5c1e81b9e0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-300::DEBUG::2013-03-01 13:53:43,667::task::568::TaskManager.Task::(_updateState) Task=`4fa50b91-ef8a-4d15-897f-0e5c1e81b9e0`::moving from state preparing -> state finished >Thread-300::DEBUG::2013-03-01 13:53:43,668::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2013-03-01 13:53:43,668::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2013-03-01 13:53:43,668::task::957::TaskManager.Task::(_decref) Task=`4fa50b91-ef8a-4d15-897f-0e5c1e81b9e0`::ref 0 aborting False >Thread-302::DEBUG::2013-03-01 13:53:44,701::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-302::DEBUG::2013-03-01 13:53:44,702::task::568::TaskManager.Task::(_updateState) Task=`1c238738-99a0-4e6c-a191-93a61a5ed484`::moving from state init -> state preparing >Thread-302::INFO::2013-03-01 13:53:44,702::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-302::DEBUG::2013-03-01 13:53:44,702::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-302::DEBUG::2013-03-01 13:53:44,702::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-302::INFO::2013-03-01 13:53:44,703::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-302::DEBUG::2013-03-01 13:53:44,703::task::1151::TaskManager.Task::(prepare) Task=`1c238738-99a0-4e6c-a191-93a61a5ed484`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-302::DEBUG::2013-03-01 13:53:44,703::task::568::TaskManager.Task::(_updateState) Task=`1c238738-99a0-4e6c-a191-93a61a5ed484`::moving from state preparing -> state finished >Thread-302::DEBUG::2013-03-01 13:53:44,703::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-302::DEBUG::2013-03-01 13:53:44,704::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-302::DEBUG::2013-03-01 13:53:44,704::task::957::TaskManager.Task::(_decref) Task=`1c238738-99a0-4e6c-a191-93a61a5ed484`::ref 0 aborting False >Thread-303::DEBUG::2013-03-01 13:53:45,740::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-303::DEBUG::2013-03-01 13:53:45,740::task::568::TaskManager.Task::(_updateState) Task=`bbed982f-cc7e-4e3a-b4df-59701eb3e641`::moving from state init -> state preparing >Thread-303::INFO::2013-03-01 13:53:45,762::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-303::DEBUG::2013-03-01 13:53:45,762::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-303::DEBUG::2013-03-01 13:53:45,762::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-303::INFO::2013-03-01 13:53:45,763::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-303::DEBUG::2013-03-01 13:53:45,763::task::1151::TaskManager.Task::(prepare) Task=`bbed982f-cc7e-4e3a-b4df-59701eb3e641`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-303::DEBUG::2013-03-01 13:53:45,763::task::568::TaskManager.Task::(_updateState) Task=`bbed982f-cc7e-4e3a-b4df-59701eb3e641`::moving from state preparing -> state finished >Thread-303::DEBUG::2013-03-01 13:53:45,763::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-303::DEBUG::2013-03-01 13:53:45,764::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-303::DEBUG::2013-03-01 13:53:45,764::task::957::TaskManager.Task::(_decref) Task=`bbed982f-cc7e-4e3a-b4df-59701eb3e641`::ref 0 aborting False >Thread-304::DEBUG::2013-03-01 13:53:46,807::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-304::DEBUG::2013-03-01 13:53:46,808::task::568::TaskManager.Task::(_updateState) Task=`bae5917c-9d0c-4e90-ac87-172fd8f14885`::moving from state init -> state preparing >Thread-304::INFO::2013-03-01 13:53:46,808::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-304::DEBUG::2013-03-01 13:53:46,808::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-304::DEBUG::2013-03-01 13:53:46,809::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-304::INFO::2013-03-01 13:53:46,809::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-304::DEBUG::2013-03-01 13:53:46,809::task::1151::TaskManager.Task::(prepare) Task=`bae5917c-9d0c-4e90-ac87-172fd8f14885`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-304::DEBUG::2013-03-01 13:53:46,809::task::568::TaskManager.Task::(_updateState) Task=`bae5917c-9d0c-4e90-ac87-172fd8f14885`::moving from state preparing -> state finished >Thread-304::DEBUG::2013-03-01 13:53:46,809::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-304::DEBUG::2013-03-01 13:53:46,810::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-304::DEBUG::2013-03-01 13:53:46,810::task::957::TaskManager.Task::(_decref) Task=`bae5917c-9d0c-4e90-ac87-172fd8f14885`::ref 0 aborting False >Thread-306::DEBUG::2013-03-01 13:53:47,844::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-306::DEBUG::2013-03-01 13:53:47,844::task::568::TaskManager.Task::(_updateState) Task=`b19dd0da-e387-4f4a-98af-e3d099fb6ad3`::moving from state init -> state preparing >Thread-306::INFO::2013-03-01 13:53:47,844::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-306::DEBUG::2013-03-01 13:53:47,845::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-306::DEBUG::2013-03-01 13:53:47,845::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-306::INFO::2013-03-01 13:53:47,845::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-306::DEBUG::2013-03-01 13:53:47,845::task::1151::TaskManager.Task::(prepare) Task=`b19dd0da-e387-4f4a-98af-e3d099fb6ad3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-306::DEBUG::2013-03-01 13:53:47,846::task::568::TaskManager.Task::(_updateState) Task=`b19dd0da-e387-4f4a-98af-e3d099fb6ad3`::moving from state preparing -> state finished >Thread-306::DEBUG::2013-03-01 13:53:47,846::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2013-03-01 13:53:47,846::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2013-03-01 13:53:47,846::task::957::TaskManager.Task::(_decref) Task=`b19dd0da-e387-4f4a-98af-e3d099fb6ad3`::ref 0 aborting False >Thread-307::DEBUG::2013-03-01 13:53:48,879::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-307::DEBUG::2013-03-01 13:53:48,879::task::568::TaskManager.Task::(_updateState) Task=`5a699b98-70d1-43d2-9c76-82a22c555c02`::moving from state init -> state preparing >Thread-307::INFO::2013-03-01 13:53:48,879::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-307::DEBUG::2013-03-01 13:53:48,880::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-307::DEBUG::2013-03-01 13:53:48,880::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-307::INFO::2013-03-01 13:53:48,880::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-307::DEBUG::2013-03-01 13:53:48,880::task::1151::TaskManager.Task::(prepare) Task=`5a699b98-70d1-43d2-9c76-82a22c555c02`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-307::DEBUG::2013-03-01 13:53:48,880::task::568::TaskManager.Task::(_updateState) Task=`5a699b98-70d1-43d2-9c76-82a22c555c02`::moving from state preparing -> state finished >Thread-307::DEBUG::2013-03-01 13:53:48,881::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-307::DEBUG::2013-03-01 13:53:48,881::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2013-03-01 13:53:48,881::task::957::TaskManager.Task::(_decref) Task=`5a699b98-70d1-43d2-9c76-82a22c555c02`::ref 0 aborting False >Thread-309::DEBUG::2013-03-01 13:53:49,917::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-309::DEBUG::2013-03-01 13:53:49,917::task::568::TaskManager.Task::(_updateState) Task=`4b5c7bb9-e38a-4990-8398-1bc6d312537e`::moving from state init -> state preparing >Thread-309::INFO::2013-03-01 13:53:49,917::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-309::DEBUG::2013-03-01 13:53:49,918::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-309::DEBUG::2013-03-01 13:53:49,918::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-309::INFO::2013-03-01 13:53:49,918::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-309::DEBUG::2013-03-01 13:53:49,918::task::1151::TaskManager.Task::(prepare) Task=`4b5c7bb9-e38a-4990-8398-1bc6d312537e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-309::DEBUG::2013-03-01 13:53:49,918::task::568::TaskManager.Task::(_updateState) Task=`4b5c7bb9-e38a-4990-8398-1bc6d312537e`::moving from state preparing -> state finished >Thread-309::DEBUG::2013-03-01 13:53:49,919::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-309::DEBUG::2013-03-01 13:53:49,919::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-309::DEBUG::2013-03-01 13:53:49,919::task::957::TaskManager.Task::(_decref) Task=`4b5c7bb9-e38a-4990-8398-1bc6d312537e`::ref 0 aborting False >Thread-310::DEBUG::2013-03-01 13:53:50,955::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-310::DEBUG::2013-03-01 13:53:50,956::task::568::TaskManager.Task::(_updateState) Task=`d71e2283-511a-479d-9d4c-d6ff81af5067`::moving from state init -> state preparing >Thread-310::INFO::2013-03-01 13:53:50,987::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-310::DEBUG::2013-03-01 13:53:50,987::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-310::DEBUG::2013-03-01 13:53:50,987::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-310::INFO::2013-03-01 13:53:50,987::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-310::DEBUG::2013-03-01 13:53:50,987::task::1151::TaskManager.Task::(prepare) Task=`d71e2283-511a-479d-9d4c-d6ff81af5067`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-310::DEBUG::2013-03-01 13:53:50,988::task::568::TaskManager.Task::(_updateState) Task=`d71e2283-511a-479d-9d4c-d6ff81af5067`::moving from state preparing -> state finished >Thread-310::DEBUG::2013-03-01 13:53:50,988::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-310::DEBUG::2013-03-01 13:53:50,988::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2013-03-01 13:53:50,988::task::957::TaskManager.Task::(_decref) Task=`d71e2283-511a-479d-9d4c-d6ff81af5067`::ref 0 aborting False >Thread-311::DEBUG::2013-03-01 13:53:52,018::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-311::DEBUG::2013-03-01 13:53:52,018::task::568::TaskManager.Task::(_updateState) Task=`500e55ba-00b5-40ca-a144-413fa3e089ac`::moving from state init -> state preparing >Thread-311::INFO::2013-03-01 13:53:52,018::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-311::DEBUG::2013-03-01 13:53:52,019::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-311::DEBUG::2013-03-01 13:53:52,019::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-311::INFO::2013-03-01 13:53:52,019::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-311::DEBUG::2013-03-01 13:53:52,019::task::1151::TaskManager.Task::(prepare) Task=`500e55ba-00b5-40ca-a144-413fa3e089ac`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-311::DEBUG::2013-03-01 13:53:52,019::task::568::TaskManager.Task::(_updateState) Task=`500e55ba-00b5-40ca-a144-413fa3e089ac`::moving from state preparing -> state finished >Thread-311::DEBUG::2013-03-01 13:53:52,020::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-311::DEBUG::2013-03-01 13:53:52,020::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-311::DEBUG::2013-03-01 13:53:52,020::task::957::TaskManager.Task::(_decref) Task=`500e55ba-00b5-40ca-a144-413fa3e089ac`::ref 0 aborting False >Thread-313::DEBUG::2013-03-01 13:53:53,049::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-313::DEBUG::2013-03-01 13:53:53,050::task::568::TaskManager.Task::(_updateState) Task=`42dee207-f9c8-4e1d-934b-0a9cb55edf2c`::moving from state init -> state preparing >Thread-313::INFO::2013-03-01 13:53:53,050::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-313::DEBUG::2013-03-01 13:53:53,050::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-313::DEBUG::2013-03-01 13:53:53,051::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-313::INFO::2013-03-01 13:53:53,051::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-313::DEBUG::2013-03-01 13:53:53,051::task::1151::TaskManager.Task::(prepare) Task=`42dee207-f9c8-4e1d-934b-0a9cb55edf2c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-313::DEBUG::2013-03-01 13:53:53,051::task::568::TaskManager.Task::(_updateState) Task=`42dee207-f9c8-4e1d-934b-0a9cb55edf2c`::moving from state preparing -> state finished >Thread-313::DEBUG::2013-03-01 13:53:53,051::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-313::DEBUG::2013-03-01 13:53:53,052::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-313::DEBUG::2013-03-01 13:53:53,052::task::957::TaskManager.Task::(_decref) Task=`42dee207-f9c8-4e1d-934b-0a9cb55edf2c`::ref 0 aborting False >Thread-314::DEBUG::2013-03-01 13:53:54,084::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-314::DEBUG::2013-03-01 13:53:54,085::task::568::TaskManager.Task::(_updateState) Task=`a0d26160-0c37-4d78-a22e-6185748e8a3a`::moving from state init -> state preparing >Thread-314::INFO::2013-03-01 13:53:54,085::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-314::DEBUG::2013-03-01 13:53:54,085::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-314::DEBUG::2013-03-01 13:53:54,086::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-314::INFO::2013-03-01 13:53:54,086::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-314::DEBUG::2013-03-01 13:53:54,086::task::1151::TaskManager.Task::(prepare) Task=`a0d26160-0c37-4d78-a22e-6185748e8a3a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-314::DEBUG::2013-03-01 13:53:54,086::task::568::TaskManager.Task::(_updateState) Task=`a0d26160-0c37-4d78-a22e-6185748e8a3a`::moving from state preparing -> state finished >Thread-314::DEBUG::2013-03-01 13:53:54,086::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-314::DEBUG::2013-03-01 13:53:54,087::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-314::DEBUG::2013-03-01 13:53:54,087::task::957::TaskManager.Task::(_decref) Task=`a0d26160-0c37-4d78-a22e-6185748e8a3a`::ref 0 aborting False >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,228::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,228::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,228::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,233::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a73e7630897639f99dbbe202714b1dfc66d08d8d'] >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,233::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,234::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,234::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=60a9fe0dbaeff4880d11ae70af5ac871c393f47d'] >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,316::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,316::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`f38b7f98-507a-40b9-ac80-68959f097da0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,317::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,317::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,317::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`f38b7f98-507a-40b9-ac80-68959f097da0`::Granted request >5851c941-31b5-4300-93df-0a457e738480::INFO::2013-03-01 13:53:54,318::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,318::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`5c7c4844-be38-4fef-94f0-7fb49c25c3eb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,319::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,319::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,319::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`5c7c4844-be38-4fef-94f0-7fb49c25c3eb`::Granted request >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,320::formatConverter::98::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c from version 0 to version 3 >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,320::formatConverter::118::Storage.v3DomainConverter::(v3DomainConverter) Setting permissions for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,376::formatConverter::121::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,377::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:53:54,706::formatConverter::125::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::INFO::2013-03-01 13:53:54,706::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >Thread-315::DEBUG::2013-03-01 13:53:55,127::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-315::DEBUG::2013-03-01 13:53:55,128::task::568::TaskManager.Task::(_updateState) Task=`f66be24e-7344-4fcb-b545-8114d43e389b`::moving from state init -> state preparing >Thread-315::INFO::2013-03-01 13:53:55,128::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-315::DEBUG::2013-03-01 13:53:55,128::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-315::DEBUG::2013-03-01 13:53:55,128::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-315::INFO::2013-03-01 13:53:55,129::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-315::DEBUG::2013-03-01 13:53:55,129::task::1151::TaskManager.Task::(prepare) Task=`f66be24e-7344-4fcb-b545-8114d43e389b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-315::DEBUG::2013-03-01 13:53:55,129::task::568::TaskManager.Task::(_updateState) Task=`f66be24e-7344-4fcb-b545-8114d43e389b`::moving from state preparing -> state finished >Thread-315::DEBUG::2013-03-01 13:53:55,129::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-315::DEBUG::2013-03-01 13:53:55,130::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-315::DEBUG::2013-03-01 13:53:55,130::task::957::TaskManager.Task::(_decref) Task=`f66be24e-7344-4fcb-b545-8114d43e389b`::ref 0 aborting False >Thread-316::DEBUG::2013-03-01 13:53:55,940::task::568::TaskManager.Task::(_updateState) Task=`e5a3b1c7-c474-469e-9850-8d75c67f4a6d`::moving from state init -> state preparing >Thread-316::INFO::2013-03-01 13:53:55,940::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-316::INFO::2013-03-01 13:53:55,941::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00401306152344', 'lastCheck': '2.2', 'code': 0, 'valid': True}} >Thread-316::DEBUG::2013-03-01 13:53:55,941::task::1151::TaskManager.Task::(prepare) Task=`e5a3b1c7-c474-469e-9850-8d75c67f4a6d`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00401306152344', 'lastCheck': '2.2', 'code': 0, 'valid': True}} >Thread-316::DEBUG::2013-03-01 13:53:55,941::task::568::TaskManager.Task::(_updateState) Task=`e5a3b1c7-c474-469e-9850-8d75c67f4a6d`::moving from state preparing -> state finished >Thread-316::DEBUG::2013-03-01 13:53:55,941::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-316::DEBUG::2013-03-01 13:53:55,942::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2013-03-01 13:53:55,942::task::957::TaskManager.Task::(_decref) Task=`e5a3b1c7-c474-469e-9850-8d75c67f4a6d`::ref 0 aborting False >Thread-318::DEBUG::2013-03-01 13:53:56,159::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-318::DEBUG::2013-03-01 13:53:56,159::task::568::TaskManager.Task::(_updateState) Task=`64e039c6-2c01-4a51-b1f7-408d3cdcfaf2`::moving from state init -> state preparing >Thread-318::INFO::2013-03-01 13:53:56,160::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-318::DEBUG::2013-03-01 13:53:56,160::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-318::DEBUG::2013-03-01 13:53:56,160::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-318::INFO::2013-03-01 13:53:56,160::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-318::DEBUG::2013-03-01 13:53:56,161::task::1151::TaskManager.Task::(prepare) Task=`64e039c6-2c01-4a51-b1f7-408d3cdcfaf2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-318::DEBUG::2013-03-01 13:53:56,161::task::568::TaskManager.Task::(_updateState) Task=`64e039c6-2c01-4a51-b1f7-408d3cdcfaf2`::moving from state preparing -> state finished >Thread-318::DEBUG::2013-03-01 13:53:56,161::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-318::DEBUG::2013-03-01 13:53:56,161::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-318::DEBUG::2013-03-01 13:53:56,162::task::957::TaskManager.Task::(_decref) Task=`64e039c6-2c01-4a51-b1f7-408d3cdcfaf2`::ref 0 aborting False >Thread-319::DEBUG::2013-03-01 13:53:57,204::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-319::DEBUG::2013-03-01 13:53:57,204::task::568::TaskManager.Task::(_updateState) Task=`1bb10425-d30c-44cc-9cf1-aba996884c70`::moving from state init -> state preparing >Thread-319::INFO::2013-03-01 13:53:57,205::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-319::DEBUG::2013-03-01 13:53:57,205::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-319::DEBUG::2013-03-01 13:53:57,205::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-319::INFO::2013-03-01 13:53:57,205::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-319::DEBUG::2013-03-01 13:53:57,205::task::1151::TaskManager.Task::(prepare) Task=`1bb10425-d30c-44cc-9cf1-aba996884c70`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-319::DEBUG::2013-03-01 13:53:57,206::task::568::TaskManager.Task::(_updateState) Task=`1bb10425-d30c-44cc-9cf1-aba996884c70`::moving from state preparing -> state finished >Thread-319::DEBUG::2013-03-01 13:53:57,206::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-319::DEBUG::2013-03-01 13:53:57,206::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-319::DEBUG::2013-03-01 13:53:57,206::task::957::TaskManager.Task::(_decref) Task=`1bb10425-d30c-44cc-9cf1-aba996884c70`::ref 0 aborting False >Thread-320::DEBUG::2013-03-01 13:53:58,238::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-320::DEBUG::2013-03-01 13:53:58,239::task::568::TaskManager.Task::(_updateState) Task=`6d4eb3e1-bf3a-402a-ae1b-ec7a40fcd4ed`::moving from state init -> state preparing >Thread-320::INFO::2013-03-01 13:53:58,239::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-320::DEBUG::2013-03-01 13:53:58,239::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-320::DEBUG::2013-03-01 13:53:58,239::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-320::INFO::2013-03-01 13:53:58,240::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-320::DEBUG::2013-03-01 13:53:58,240::task::1151::TaskManager.Task::(prepare) Task=`6d4eb3e1-bf3a-402a-ae1b-ec7a40fcd4ed`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-320::DEBUG::2013-03-01 13:53:58,240::task::568::TaskManager.Task::(_updateState) Task=`6d4eb3e1-bf3a-402a-ae1b-ec7a40fcd4ed`::moving from state preparing -> state finished >Thread-320::DEBUG::2013-03-01 13:53:58,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-320::DEBUG::2013-03-01 13:53:58,241::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-320::DEBUG::2013-03-01 13:53:58,241::task::957::TaskManager.Task::(_decref) Task=`6d4eb3e1-bf3a-402a-ae1b-ec7a40fcd4ed`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 13:53:59,270::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-322::DEBUG::2013-03-01 13:53:59,270::task::568::TaskManager.Task::(_updateState) Task=`fd260a23-eb66-433a-9d51-3ada9fabe3dd`::moving from state init -> state preparing >Thread-322::INFO::2013-03-01 13:53:59,270::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-322::DEBUG::2013-03-01 13:53:59,271::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-322::DEBUG::2013-03-01 13:53:59,271::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-322::INFO::2013-03-01 13:53:59,271::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-322::DEBUG::2013-03-01 13:53:59,271::task::1151::TaskManager.Task::(prepare) Task=`fd260a23-eb66-433a-9d51-3ada9fabe3dd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-322::DEBUG::2013-03-01 13:53:59,272::task::568::TaskManager.Task::(_updateState) Task=`fd260a23-eb66-433a-9d51-3ada9fabe3dd`::moving from state preparing -> state finished >Thread-322::DEBUG::2013-03-01 13:53:59,272::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-322::DEBUG::2013-03-01 13:53:59,272::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-322::DEBUG::2013-03-01 13:53:59,272::task::957::TaskManager.Task::(_decref) Task=`fd260a23-eb66-433a-9d51-3ada9fabe3dd`::ref 0 aborting False >Thread-323::DEBUG::2013-03-01 13:54:00,301::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-323::DEBUG::2013-03-01 13:54:00,302::task::568::TaskManager.Task::(_updateState) Task=`18e59f8d-73ed-44fe-882b-45bb64d5f031`::moving from state init -> state preparing >Thread-323::INFO::2013-03-01 13:54:00,302::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-323::DEBUG::2013-03-01 13:54:00,302::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-323::DEBUG::2013-03-01 13:54:00,302::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-323::INFO::2013-03-01 13:54:00,303::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-323::DEBUG::2013-03-01 13:54:00,303::task::1151::TaskManager.Task::(prepare) Task=`18e59f8d-73ed-44fe-882b-45bb64d5f031`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-323::DEBUG::2013-03-01 13:54:00,303::task::568::TaskManager.Task::(_updateState) Task=`18e59f8d-73ed-44fe-882b-45bb64d5f031`::moving from state preparing -> state finished >Thread-323::DEBUG::2013-03-01 13:54:00,303::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2013-03-01 13:54:00,304::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2013-03-01 13:54:00,304::task::957::TaskManager.Task::(_decref) Task=`18e59f8d-73ed-44fe-882b-45bb64d5f031`::ref 0 aborting False >Thread-324::DEBUG::2013-03-01 13:54:01,332::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-324::DEBUG::2013-03-01 13:54:01,333::task::568::TaskManager.Task::(_updateState) Task=`e805589d-1288-4d9f-bb07-fd527e9c93fe`::moving from state init -> state preparing >Thread-324::INFO::2013-03-01 13:54:01,366::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-324::DEBUG::2013-03-01 13:54:01,366::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-324::DEBUG::2013-03-01 13:54:01,367::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-324::INFO::2013-03-01 13:54:01,367::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-324::DEBUG::2013-03-01 13:54:01,367::task::1151::TaskManager.Task::(prepare) Task=`e805589d-1288-4d9f-bb07-fd527e9c93fe`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-324::DEBUG::2013-03-01 13:54:01,367::task::568::TaskManager.Task::(_updateState) Task=`e805589d-1288-4d9f-bb07-fd527e9c93fe`::moving from state preparing -> state finished >Thread-324::DEBUG::2013-03-01 13:54:01,367::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-324::DEBUG::2013-03-01 13:54:01,368::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-324::DEBUG::2013-03-01 13:54:01,368::task::957::TaskManager.Task::(_decref) Task=`e805589d-1288-4d9f-bb07-fd527e9c93fe`::ref 0 aborting False >Thread-326::DEBUG::2013-03-01 13:54:02,400::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-326::DEBUG::2013-03-01 13:54:02,400::task::568::TaskManager.Task::(_updateState) Task=`cef580b9-8bd8-4b59-9d5c-6057f82af4a2`::moving from state init -> state preparing >Thread-326::INFO::2013-03-01 13:54:02,401::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-326::DEBUG::2013-03-01 13:54:02,401::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-326::DEBUG::2013-03-01 13:54:02,401::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-326::INFO::2013-03-01 13:54:02,401::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-326::DEBUG::2013-03-01 13:54:02,402::task::1151::TaskManager.Task::(prepare) Task=`cef580b9-8bd8-4b59-9d5c-6057f82af4a2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-326::DEBUG::2013-03-01 13:54:02,402::task::568::TaskManager.Task::(_updateState) Task=`cef580b9-8bd8-4b59-9d5c-6057f82af4a2`::moving from state preparing -> state finished >Thread-326::DEBUG::2013-03-01 13:54:02,402::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-326::DEBUG::2013-03-01 13:54:02,402::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-326::DEBUG::2013-03-01 13:54:02,403::task::957::TaskManager.Task::(_decref) Task=`cef580b9-8bd8-4b59-9d5c-6057f82af4a2`::ref 0 aborting False >Thread-327::DEBUG::2013-03-01 13:54:03,431::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-327::DEBUG::2013-03-01 13:54:03,432::task::568::TaskManager.Task::(_updateState) Task=`44609e6a-6c1a-4719-9d46-7dae11ef8e32`::moving from state init -> state preparing >Thread-327::INFO::2013-03-01 13:54:03,432::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-327::DEBUG::2013-03-01 13:54:03,432::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-327::DEBUG::2013-03-01 13:54:03,432::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-327::INFO::2013-03-01 13:54:03,433::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-327::DEBUG::2013-03-01 13:54:03,433::task::1151::TaskManager.Task::(prepare) Task=`44609e6a-6c1a-4719-9d46-7dae11ef8e32`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-327::DEBUG::2013-03-01 13:54:03,433::task::568::TaskManager.Task::(_updateState) Task=`44609e6a-6c1a-4719-9d46-7dae11ef8e32`::moving from state preparing -> state finished >Thread-327::DEBUG::2013-03-01 13:54:03,433::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-327::DEBUG::2013-03-01 13:54:03,434::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-327::DEBUG::2013-03-01 13:54:03,434::task::957::TaskManager.Task::(_decref) Task=`44609e6a-6c1a-4719-9d46-7dae11ef8e32`::ref 0 aborting False >Thread-328::DEBUG::2013-03-01 13:54:04,463::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-328::DEBUG::2013-03-01 13:54:04,469::task::568::TaskManager.Task::(_updateState) Task=`59fb374d-57a0-4004-80bf-21f2afe098fe`::moving from state init -> state preparing >Thread-328::INFO::2013-03-01 13:54:04,470::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-328::DEBUG::2013-03-01 13:54:04,470::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-328::DEBUG::2013-03-01 13:54:04,470::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-328::INFO::2013-03-01 13:54:04,470::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-328::DEBUG::2013-03-01 13:54:04,470::task::1151::TaskManager.Task::(prepare) Task=`59fb374d-57a0-4004-80bf-21f2afe098fe`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-328::DEBUG::2013-03-01 13:54:04,471::task::568::TaskManager.Task::(_updateState) Task=`59fb374d-57a0-4004-80bf-21f2afe098fe`::moving from state preparing -> state finished >Thread-328::DEBUG::2013-03-01 13:54:04,471::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-328::DEBUG::2013-03-01 13:54:04,471::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-328::DEBUG::2013-03-01 13:54:04,471::task::957::TaskManager.Task::(_decref) Task=`59fb374d-57a0-4004-80bf-21f2afe098fe`::ref 0 aborting False >Thread-330::DEBUG::2013-03-01 13:54:05,501::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-330::DEBUG::2013-03-01 13:54:05,502::task::568::TaskManager.Task::(_updateState) Task=`00faf7de-68fe-41c3-8966-49eecad65903`::moving from state init -> state preparing >Thread-330::INFO::2013-03-01 13:54:05,502::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-330::DEBUG::2013-03-01 13:54:05,502::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-330::DEBUG::2013-03-01 13:54:05,502::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-330::INFO::2013-03-01 13:54:05,503::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-330::DEBUG::2013-03-01 13:54:05,503::task::1151::TaskManager.Task::(prepare) Task=`00faf7de-68fe-41c3-8966-49eecad65903`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-330::DEBUG::2013-03-01 13:54:05,503::task::568::TaskManager.Task::(_updateState) Task=`00faf7de-68fe-41c3-8966-49eecad65903`::moving from state preparing -> state finished >Thread-330::DEBUG::2013-03-01 13:54:05,503::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-330::DEBUG::2013-03-01 13:54:05,504::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-330::DEBUG::2013-03-01 13:54:05,504::task::957::TaskManager.Task::(_decref) Task=`00faf7de-68fe-41c3-8966-49eecad65903`::ref 0 aborting False >Thread-331::DEBUG::2013-03-01 13:54:06,535::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-331::DEBUG::2013-03-01 13:54:06,535::task::568::TaskManager.Task::(_updateState) Task=`8609f710-364b-4a2d-9944-4f5e9ee60e58`::moving from state init -> state preparing >Thread-331::INFO::2013-03-01 13:54:06,536::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-331::DEBUG::2013-03-01 13:54:06,536::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-331::DEBUG::2013-03-01 13:54:06,536::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-331::INFO::2013-03-01 13:54:06,536::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-331::DEBUG::2013-03-01 13:54:06,536::task::1151::TaskManager.Task::(prepare) Task=`8609f710-364b-4a2d-9944-4f5e9ee60e58`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-331::DEBUG::2013-03-01 13:54:06,537::task::568::TaskManager.Task::(_updateState) Task=`8609f710-364b-4a2d-9944-4f5e9ee60e58`::moving from state preparing -> state finished >Thread-331::DEBUG::2013-03-01 13:54:06,537::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-331::DEBUG::2013-03-01 13:54:06,537::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-331::DEBUG::2013-03-01 13:54:06,537::task::957::TaskManager.Task::(_decref) Task=`8609f710-364b-4a2d-9944-4f5e9ee60e58`::ref 0 aborting False >Thread-332::DEBUG::2013-03-01 13:54:07,566::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-332::DEBUG::2013-03-01 13:54:07,586::task::568::TaskManager.Task::(_updateState) Task=`44c073fe-8048-41fd-8755-d4436766a0cd`::moving from state init -> state preparing >Thread-332::INFO::2013-03-01 13:54:07,586::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-332::DEBUG::2013-03-01 13:54:07,586::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-332::DEBUG::2013-03-01 13:54:07,587::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-332::INFO::2013-03-01 13:54:07,587::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-332::DEBUG::2013-03-01 13:54:07,587::task::1151::TaskManager.Task::(prepare) Task=`44c073fe-8048-41fd-8755-d4436766a0cd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-332::DEBUG::2013-03-01 13:54:07,587::task::568::TaskManager.Task::(_updateState) Task=`44c073fe-8048-41fd-8755-d4436766a0cd`::moving from state preparing -> state finished >Thread-332::DEBUG::2013-03-01 13:54:07,587::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-332::DEBUG::2013-03-01 13:54:07,587::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-332::DEBUG::2013-03-01 13:54:07,587::task::957::TaskManager.Task::(_decref) Task=`44c073fe-8048-41fd-8755-d4436766a0cd`::ref 0 aborting False >Thread-334::DEBUG::2013-03-01 13:54:08,616::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-334::DEBUG::2013-03-01 13:54:08,617::task::568::TaskManager.Task::(_updateState) Task=`6a895b54-b8a2-440b-b9ca-984292cbe3cd`::moving from state init -> state preparing >Thread-334::INFO::2013-03-01 13:54:08,617::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-334::DEBUG::2013-03-01 13:54:08,617::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-334::DEBUG::2013-03-01 13:54:08,617::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-334::INFO::2013-03-01 13:54:08,618::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-334::DEBUG::2013-03-01 13:54:08,618::task::1151::TaskManager.Task::(prepare) Task=`6a895b54-b8a2-440b-b9ca-984292cbe3cd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-334::DEBUG::2013-03-01 13:54:08,618::task::568::TaskManager.Task::(_updateState) Task=`6a895b54-b8a2-440b-b9ca-984292cbe3cd`::moving from state preparing -> state finished >Thread-334::DEBUG::2013-03-01 13:54:08,618::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-334::DEBUG::2013-03-01 13:54:08,619::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-334::DEBUG::2013-03-01 13:54:08,619::task::957::TaskManager.Task::(_decref) Task=`6a895b54-b8a2-440b-b9ca-984292cbe3cd`::ref 0 aborting False >Thread-335::DEBUG::2013-03-01 13:54:09,651::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-335::DEBUG::2013-03-01 13:54:09,651::task::568::TaskManager.Task::(_updateState) Task=`d610f55d-d55a-4ac3-a992-885787d0fb6d`::moving from state init -> state preparing >Thread-335::INFO::2013-03-01 13:54:09,651::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-335::DEBUG::2013-03-01 13:54:09,652::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-335::DEBUG::2013-03-01 13:54:09,652::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-335::INFO::2013-03-01 13:54:09,652::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-335::DEBUG::2013-03-01 13:54:09,652::task::1151::TaskManager.Task::(prepare) Task=`d610f55d-d55a-4ac3-a992-885787d0fb6d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-335::DEBUG::2013-03-01 13:54:09,652::task::568::TaskManager.Task::(_updateState) Task=`d610f55d-d55a-4ac3-a992-885787d0fb6d`::moving from state preparing -> state finished >Thread-335::DEBUG::2013-03-01 13:54:09,653::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-335::DEBUG::2013-03-01 13:54:09,653::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-335::DEBUG::2013-03-01 13:54:09,653::task::957::TaskManager.Task::(_decref) Task=`d610f55d-d55a-4ac3-a992-885787d0fb6d`::ref 0 aborting False >Thread-336::DEBUG::2013-03-01 13:54:10,683::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-336::DEBUG::2013-03-01 13:54:10,683::task::568::TaskManager.Task::(_updateState) Task=`36a68983-e9af-405b-9981-e565161ee453`::moving from state init -> state preparing >Thread-336::INFO::2013-03-01 13:54:10,683::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-336::DEBUG::2013-03-01 13:54:10,684::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-336::DEBUG::2013-03-01 13:54:10,684::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-336::INFO::2013-03-01 13:54:10,684::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-336::DEBUG::2013-03-01 13:54:10,684::task::1151::TaskManager.Task::(prepare) Task=`36a68983-e9af-405b-9981-e565161ee453`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-336::DEBUG::2013-03-01 13:54:10,685::task::568::TaskManager.Task::(_updateState) Task=`36a68983-e9af-405b-9981-e565161ee453`::moving from state preparing -> state finished >Thread-336::DEBUG::2013-03-01 13:54:10,685::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-336::DEBUG::2013-03-01 13:54:10,685::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-336::DEBUG::2013-03-01 13:54:10,685::task::957::TaskManager.Task::(_decref) Task=`36a68983-e9af-405b-9981-e565161ee453`::ref 0 aborting False >Thread-337::DEBUG::2013-03-01 13:54:11,196::task::568::TaskManager.Task::(_updateState) Task=`2d792ab5-bca1-479b-b0c1-e3faf6f0d064`::moving from state init -> state preparing >Thread-337::INFO::2013-03-01 13:54:11,197::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-337::INFO::2013-03-01 13:54:11,197::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '1.57276201248', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-337::DEBUG::2013-03-01 13:54:11,197::task::1151::TaskManager.Task::(prepare) Task=`2d792ab5-bca1-479b-b0c1-e3faf6f0d064`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '1.57276201248', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-337::DEBUG::2013-03-01 13:54:11,197::task::568::TaskManager.Task::(_updateState) Task=`2d792ab5-bca1-479b-b0c1-e3faf6f0d064`::moving from state preparing -> state finished >Thread-337::DEBUG::2013-03-01 13:54:11,198::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-337::DEBUG::2013-03-01 13:54:11,198::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-337::DEBUG::2013-03-01 13:54:11,198::task::957::TaskManager.Task::(_decref) Task=`2d792ab5-bca1-479b-b0c1-e3faf6f0d064`::ref 0 aborting False >Thread-339::DEBUG::2013-03-01 13:54:11,715::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-339::DEBUG::2013-03-01 13:54:11,715::task::568::TaskManager.Task::(_updateState) Task=`e76f9a9f-551f-4911-bbd2-65e6e5d0872a`::moving from state init -> state preparing >Thread-339::INFO::2013-03-01 13:54:11,716::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-339::DEBUG::2013-03-01 13:54:11,716::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-339::DEBUG::2013-03-01 13:54:11,716::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-339::INFO::2013-03-01 13:54:11,716::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-339::DEBUG::2013-03-01 13:54:11,717::task::1151::TaskManager.Task::(prepare) Task=`e76f9a9f-551f-4911-bbd2-65e6e5d0872a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-339::DEBUG::2013-03-01 13:54:11,717::task::568::TaskManager.Task::(_updateState) Task=`e76f9a9f-551f-4911-bbd2-65e6e5d0872a`::moving from state preparing -> state finished >Thread-339::DEBUG::2013-03-01 13:54:11,717::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-339::DEBUG::2013-03-01 13:54:11,717::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-339::DEBUG::2013-03-01 13:54:11,718::task::957::TaskManager.Task::(_decref) Task=`e76f9a9f-551f-4911-bbd2-65e6e5d0872a`::ref 0 aborting False >Thread-340::DEBUG::2013-03-01 13:54:12,747::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-340::DEBUG::2013-03-01 13:54:12,747::task::568::TaskManager.Task::(_updateState) Task=`2e2749f2-0589-4bb6-8f48-8c27bd42f5b1`::moving from state init -> state preparing >Thread-340::INFO::2013-03-01 13:54:12,747::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-340::DEBUG::2013-03-01 13:54:12,748::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-340::DEBUG::2013-03-01 13:54:12,748::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-340::INFO::2013-03-01 13:54:12,748::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-340::DEBUG::2013-03-01 13:54:12,748::task::1151::TaskManager.Task::(prepare) Task=`2e2749f2-0589-4bb6-8f48-8c27bd42f5b1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-340::DEBUG::2013-03-01 13:54:12,749::task::568::TaskManager.Task::(_updateState) Task=`2e2749f2-0589-4bb6-8f48-8c27bd42f5b1`::moving from state preparing -> state finished >Thread-340::DEBUG::2013-03-01 13:54:12,749::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-340::DEBUG::2013-03-01 13:54:12,749::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2013-03-01 13:54:12,749::task::957::TaskManager.Task::(_decref) Task=`2e2749f2-0589-4bb6-8f48-8c27bd42f5b1`::ref 0 aborting False >Thread-341::DEBUG::2013-03-01 13:54:13,779::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-341::DEBUG::2013-03-01 13:54:13,779::task::568::TaskManager.Task::(_updateState) Task=`7f1c4163-aa52-4c9d-9a78-2ad5af501a7c`::moving from state init -> state preparing >Thread-341::INFO::2013-03-01 13:54:13,779::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-341::DEBUG::2013-03-01 13:54:13,780::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-341::DEBUG::2013-03-01 13:54:13,780::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-341::INFO::2013-03-01 13:54:13,780::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-341::DEBUG::2013-03-01 13:54:13,780::task::1151::TaskManager.Task::(prepare) Task=`7f1c4163-aa52-4c9d-9a78-2ad5af501a7c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-341::DEBUG::2013-03-01 13:54:13,781::task::568::TaskManager.Task::(_updateState) Task=`7f1c4163-aa52-4c9d-9a78-2ad5af501a7c`::moving from state preparing -> state finished >Thread-341::DEBUG::2013-03-01 13:54:13,781::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-341::DEBUG::2013-03-01 13:54:13,781::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-341::DEBUG::2013-03-01 13:54:13,781::task::957::TaskManager.Task::(_decref) Task=`7f1c4163-aa52-4c9d-9a78-2ad5af501a7c`::ref 0 aborting False >Thread-343::DEBUG::2013-03-01 13:54:14,810::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-343::DEBUG::2013-03-01 13:54:14,811::task::568::TaskManager.Task::(_updateState) Task=`baf410ae-64e4-46d4-8555-878a3f610475`::moving from state init -> state preparing >Thread-343::INFO::2013-03-01 13:54:14,811::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-343::DEBUG::2013-03-01 13:54:14,811::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-343::DEBUG::2013-03-01 13:54:14,811::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-343::INFO::2013-03-01 13:54:14,812::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-343::DEBUG::2013-03-01 13:54:14,812::task::1151::TaskManager.Task::(prepare) Task=`baf410ae-64e4-46d4-8555-878a3f610475`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-343::DEBUG::2013-03-01 13:54:14,812::task::568::TaskManager.Task::(_updateState) Task=`baf410ae-64e4-46d4-8555-878a3f610475`::moving from state preparing -> state finished >Thread-343::DEBUG::2013-03-01 13:54:14,812::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-343::DEBUG::2013-03-01 13:54:14,812::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-343::DEBUG::2013-03-01 13:54:14,813::task::957::TaskManager.Task::(_decref) Task=`baf410ae-64e4-46d4-8555-878a3f610475`::ref 0 aborting False >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,711::clusterlock::191::SANLock::(acquireHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,711::formatConverter::202::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c with host id: 1 >5851c941-31b5-4300-93df-0a457e738480::INFO::2013-03-01 13:54:15,711::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,837::clusterlock::248::SANLock::(acquire) Cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,839::formatConverter::160::Storage.v3DomainConverter::(v3ReallocateMetadataSlot) The metadata reallocation check is not needed for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,839::formatConverter::298::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 0 to version 3 for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,840::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,840::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,840::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4973f9aab1aae0d91b34fe6d8baf9997f772dfd9'] >Thread-344::DEBUG::2013-03-01 13:54:15,848::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-344::DEBUG::2013-03-01 13:54:15,848::task::568::TaskManager.Task::(_updateState) Task=`b06833ac-6564-4ad1-a8c7-72b83c247bf2`::moving from state init -> state preparing >Thread-344::INFO::2013-03-01 13:54:15,848::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-344::DEBUG::2013-03-01 13:54:15,849::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-344::DEBUG::2013-03-01 13:54:15,849::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-344::INFO::2013-03-01 13:54:15,849::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-344::DEBUG::2013-03-01 13:54:15,849::task::1151::TaskManager.Task::(prepare) Task=`b06833ac-6564-4ad1-a8c7-72b83c247bf2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-344::DEBUG::2013-03-01 13:54:15,850::task::568::TaskManager.Task::(_updateState) Task=`b06833ac-6564-4ad1-a8c7-72b83c247bf2`::moving from state preparing -> state finished >Thread-344::DEBUG::2013-03-01 13:54:15,850::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-344::DEBUG::2013-03-01 13:54:15,850::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-344::DEBUG::2013-03-01 13:54:15,850::task::957::TaskManager.Task::(_decref) Task=`b06833ac-6564-4ad1-a8c7-72b83c247bf2`::ref 0 aborting False >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,890::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >5851c941-31b5-4300-93df-0a457e738480::INFO::2013-03-01 13:54:15,890::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:15,891::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd /usr/libexec/vdsm) >Thread-345::DEBUG::2013-03-01 13:54:16,886::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-345::DEBUG::2013-03-01 13:54:16,887::task::568::TaskManager.Task::(_updateState) Task=`af070675-e807-4515-8012-f444bca24453`::moving from state init -> state preparing >Thread-345::INFO::2013-03-01 13:54:16,887::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-345::DEBUG::2013-03-01 13:54:16,888::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-345::DEBUG::2013-03-01 13:54:16,888::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-345::INFO::2013-03-01 13:54:16,888::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-345::DEBUG::2013-03-01 13:54:16,888::task::1151::TaskManager.Task::(prepare) Task=`af070675-e807-4515-8012-f444bca24453`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-345::DEBUG::2013-03-01 13:54:16,889::task::568::TaskManager.Task::(_updateState) Task=`af070675-e807-4515-8012-f444bca24453`::moving from state preparing -> state finished >Thread-345::DEBUG::2013-03-01 13:54:16,889::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-345::DEBUG::2013-03-01 13:54:16,889::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-345::DEBUG::2013-03-01 13:54:16,889::task::957::TaskManager.Task::(_decref) Task=`af070675-e807-4515-8012-f444bca24453`::ref 0 aborting False >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:16,931::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:16,932::clusterlock::129::SafeLease::(release) Cluster lock released successfully >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:16,932::formatConverter::336::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:16,933::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:16,934::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,207::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >5851c941-31b5-4300-93df-0a457e738480::WARNING::2013-03-01 13:54:17,208::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,210::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,257::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,258::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,263::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4973f9aab1aae0d91b34fe6d8baf9997f772dfd9'] >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,265::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >5851c941-31b5-4300-93df-0a457e738480::WARNING::2013-03-01 13:54:17,265::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >5851c941-31b5-4300-93df-0a457e738480::WARNING::2013-03-01 13:54:17,265::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,266::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,266::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,266::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,267::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,267::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,267::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,268::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,268::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,268::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,268::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,269::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >5851c941-31b5-4300-93df-0a457e738480::WARNING::2013-03-01 13:54:17,287::sd::600::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c/master/vms) >5851c941-31b5-4300-93df-0a457e738480::WARNING::2013-03-01 13:54:17,307::sd::605::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c/master/tasks) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,316::sp::309::Storage.StoragePool::(startSpm) ended. >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,317::task::568::TaskManager.Task::(_updateState) Task=`5851c941-31b5-4300-93df-0a457e738480`::moving from state running -> state finished >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,317::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,317::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,318::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,318::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,318::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,318::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,319::task::880::TaskManager.Task::(_runJobs) Task=`5851c941-31b5-4300-93df-0a457e738480`::Task.run: exit - success: result >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,319::task::957::TaskManager.Task::(_decref) Task=`5851c941-31b5-4300-93df-0a457e738480`::ref 0 aborting False >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:54:17,319::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-365::DEBUG::2013-03-01 13:54:17,919::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-365::DEBUG::2013-03-01 13:54:17,919::task::568::TaskManager.Task::(_updateState) Task=`99d255d0-d2a4-43c0-b338-51cd92ee2f68`::moving from state init -> state preparing >Thread-365::INFO::2013-03-01 13:54:17,919::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-365::DEBUG::2013-03-01 13:54:17,920::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-365::DEBUG::2013-03-01 13:54:17,920::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'} >Thread-365::INFO::2013-03-01 13:54:17,920::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-365::DEBUG::2013-03-01 13:54:17,921::task::1151::TaskManager.Task::(prepare) Task=`99d255d0-d2a4-43c0-b338-51cd92ee2f68`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5851c941-31b5-4300-93df-0a457e738480'}} >Thread-365::DEBUG::2013-03-01 13:54:17,921::task::568::TaskManager.Task::(_updateState) Task=`99d255d0-d2a4-43c0-b338-51cd92ee2f68`::moving from state preparing -> state finished >Thread-365::DEBUG::2013-03-01 13:54:17,921::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-365::DEBUG::2013-03-01 13:54:17,921::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-365::DEBUG::2013-03-01 13:54:17,922::task::957::TaskManager.Task::(_decref) Task=`99d255d0-d2a4-43c0-b338-51cd92ee2f68`::ref 0 aborting False >Thread-366::DEBUG::2013-03-01 13:54:17,949::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-366::DEBUG::2013-03-01 13:54:17,950::task::568::TaskManager.Task::(_updateState) Task=`17d0cb20-b529-4dd0-96ab-8190fad69b6a`::moving from state init -> state preparing >Thread-366::INFO::2013-03-01 13:54:17,950::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-366::INFO::2013-03-01 13:54:17,950::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-366::DEBUG::2013-03-01 13:54:17,951::task::1151::TaskManager.Task::(prepare) Task=`17d0cb20-b529-4dd0-96ab-8190fad69b6a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-366::DEBUG::2013-03-01 13:54:17,951::task::568::TaskManager.Task::(_updateState) Task=`17d0cb20-b529-4dd0-96ab-8190fad69b6a`::moving from state preparing -> state finished >Thread-366::DEBUG::2013-03-01 13:54:17,951::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-366::DEBUG::2013-03-01 13:54:17,952::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-366::DEBUG::2013-03-01 13:54:17,952::task::957::TaskManager.Task::(_decref) Task=`17d0cb20-b529-4dd0-96ab-8190fad69b6a`::ref 0 aborting False >Thread-367::DEBUG::2013-03-01 13:54:17,990::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-367::DEBUG::2013-03-01 13:54:17,990::task::568::TaskManager.Task::(_updateState) Task=`1e0d407e-207b-49d2-9188-94fa10575e7f`::moving from state init -> state preparing >Thread-367::INFO::2013-03-01 13:54:17,991::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='5851c941-31b5-4300-93df-0a457e738480', spUUID=None, options=None) >Thread-367::DEBUG::2013-03-01 13:54:17,991::taskManager::161::TaskManager::(clearTask) Entry. taskID: 5851c941-31b5-4300-93df-0a457e738480 >Thread-367::DEBUG::2013-03-01 13:54:17,991::taskManager::166::TaskManager::(clearTask) Return. >Thread-367::INFO::2013-03-01 13:54:17,991::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-367::DEBUG::2013-03-01 13:54:17,992::task::1151::TaskManager.Task::(prepare) Task=`1e0d407e-207b-49d2-9188-94fa10575e7f`::finished: None >Thread-367::DEBUG::2013-03-01 13:54:17,992::task::568::TaskManager.Task::(_updateState) Task=`1e0d407e-207b-49d2-9188-94fa10575e7f`::moving from state preparing -> state finished >Thread-367::DEBUG::2013-03-01 13:54:17,992::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-367::DEBUG::2013-03-01 13:54:17,992::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-367::DEBUG::2013-03-01 13:54:17,993::task::957::TaskManager.Task::(_decref) Task=`1e0d407e-207b-49d2-9188-94fa10575e7f`::ref 0 aborting False >Thread-368::DEBUG::2013-03-01 13:54:18,051::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-368::DEBUG::2013-03-01 13:54:18,051::task::568::TaskManager.Task::(_updateState) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::moving from state init -> state preparing >Thread-368::INFO::2013-03-01 13:54:18,051::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-368::DEBUG::2013-03-01 13:54:18,052::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ba50399d-f96d-495a-ba27-d1e78d3d2a34`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-368::DEBUG::2013-03-01 13:54:18,052::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-368::DEBUG::2013-03-01 13:54:18,053::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-368::DEBUG::2013-03-01 13:54:18,053::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ba50399d-f96d-495a-ba27-d1e78d3d2a34`::Granted request >Thread-368::DEBUG::2013-03-01 13:54:18,053::task::794::TaskManager.Task::(resourceAcquired) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-368::DEBUG::2013-03-01 13:54:18,054::task::957::TaskManager.Task::(_decref) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::ref 1 aborting False >Thread-368::DEBUG::2013-03-01 13:54:18,054::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`7867553a-40b9-4c4c-a229-bb05261018db`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-368::DEBUG::2013-03-01 13:54:18,055::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >Thread-368::DEBUG::2013-03-01 13:54:18,055::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >Thread-368::DEBUG::2013-03-01 13:54:18,055::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`7867553a-40b9-4c4c-a229-bb05261018db`::Granted request >Thread-368::DEBUG::2013-03-01 13:54:18,056::task::794::TaskManager.Task::(resourceAcquired) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::_resourcesAcquired: Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (exclusive) >Thread-368::DEBUG::2013-03-01 13:54:18,056::task::957::TaskManager.Task::(_decref) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::ref 1 aborting False >Thread-368::INFO::2013-03-01 13:54:18,056::sp::1045::Storage.StoragePool::(activateSD) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-368::INFO::2013-03-01 13:54:18,057::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-368::DEBUG::2013-03-01 13:54:18,057::task::1151::TaskManager.Task::(prepare) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::finished: None >Thread-368::DEBUG::2013-03-01 13:54:18,057::task::568::TaskManager.Task::(_updateState) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::moving from state preparing -> state finished >Thread-368::DEBUG::2013-03-01 13:54:18,057::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': < ResourceRef 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', isValid: 'True' obj: 'None'>} >Thread-368::DEBUG::2013-03-01 13:54:18,058::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-368::DEBUG::2013-03-01 13:54:18,058::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-368::DEBUG::2013-03-01 13:54:18,058::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-368::DEBUG::2013-03-01 13:54:18,059::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-368::DEBUG::2013-03-01 13:54:18,059::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-368::DEBUG::2013-03-01 13:54:18,059::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >Thread-368::DEBUG::2013-03-01 13:54:18,060::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >Thread-368::DEBUG::2013-03-01 13:54:18,060::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >Thread-368::DEBUG::2013-03-01 13:54:18,060::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >Thread-368::DEBUG::2013-03-01 13:54:18,061::task::957::TaskManager.Task::(_decref) Task=`878f6802-1a57-4821-b708-a528d8dfa724`::ref 0 aborting False >Thread-369::DEBUG::2013-03-01 13:54:18,102::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-369::DEBUG::2013-03-01 13:54:18,103::task::568::TaskManager.Task::(_updateState) Task=`168249ed-6aa3-4f0c-912c-eb0ae65a2bab`::moving from state init -> state preparing >Thread-369::INFO::2013-03-01 13:54:18,103::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', hostID=1, scsiKey='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-369::DEBUG::2013-03-01 13:54:18,104::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`19ed4a5e-eef7-459f-b5c0-77021ff9c7f8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-369::DEBUG::2013-03-01 13:54:18,104::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-369::DEBUG::2013-03-01 13:54:18,104::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-369::DEBUG::2013-03-01 13:54:18,105::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`19ed4a5e-eef7-459f-b5c0-77021ff9c7f8`::Granted request >Thread-369::DEBUG::2013-03-01 13:54:18,105::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-369::DEBUG::2013-03-01 13:54:18,106::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-369::DEBUG::2013-03-01 13:54:18,106::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-369::DEBUG::2013-03-01 13:54:18,106::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-369::DEBUG::2013-03-01 13:54:18,106::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-369::INFO::2013-03-01 13:54:18,107::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-369::DEBUG::2013-03-01 13:54:18,107::task::1151::TaskManager.Task::(prepare) Task=`168249ed-6aa3-4f0c-912c-eb0ae65a2bab`::finished: None >Thread-369::DEBUG::2013-03-01 13:54:18,107::task::568::TaskManager.Task::(_updateState) Task=`168249ed-6aa3-4f0c-912c-eb0ae65a2bab`::moving from state preparing -> state finished >Thread-369::DEBUG::2013-03-01 13:54:18,108::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-369::DEBUG::2013-03-01 13:54:18,108::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-369::DEBUG::2013-03-01 13:54:18,108::task::957::TaskManager.Task::(_decref) Task=`168249ed-6aa3-4f0c-912c-eb0ae65a2bab`::ref 0 aborting False >Thread-370::DEBUG::2013-03-01 13:54:19,391::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-370::DEBUG::2013-03-01 13:54:19,392::task::568::TaskManager.Task::(_updateState) Task=`43fefc4d-1e2b-4205-9e28-1b0bf1ad5fcc`::moving from state init -> state preparing >Thread-370::INFO::2013-03-01 13:54:19,392::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-370::INFO::2013-03-01 13:54:19,392::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-370::DEBUG::2013-03-01 13:54:19,393::task::1151::TaskManager.Task::(prepare) Task=`43fefc4d-1e2b-4205-9e28-1b0bf1ad5fcc`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-370::DEBUG::2013-03-01 13:54:19,393::task::568::TaskManager.Task::(_updateState) Task=`43fefc4d-1e2b-4205-9e28-1b0bf1ad5fcc`::moving from state preparing -> state finished >Thread-370::DEBUG::2013-03-01 13:54:19,393::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-370::DEBUG::2013-03-01 13:54:19,393::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-370::DEBUG::2013-03-01 13:54:19,394::task::957::TaskManager.Task::(_decref) Task=`43fefc4d-1e2b-4205-9e28-1b0bf1ad5fcc`::ref 0 aborting False >Thread-371::DEBUG::2013-03-01 13:54:19,441::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-371::DEBUG::2013-03-01 13:54:19,441::task::568::TaskManager.Task::(_updateState) Task=`d7dd7048-ec97-4511-832e-a758a9f43a86`::moving from state init -> state preparing >Thread-371::INFO::2013-03-01 13:54:19,442::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-371::INFO::2013-03-01 13:54:19,444::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-371::DEBUG::2013-03-01 13:54:19,445::task::1151::TaskManager.Task::(prepare) Task=`d7dd7048-ec97-4511-832e-a758a9f43a86`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-371::DEBUG::2013-03-01 13:54:19,445::task::568::TaskManager.Task::(_updateState) Task=`d7dd7048-ec97-4511-832e-a758a9f43a86`::moving from state preparing -> state finished >Thread-371::DEBUG::2013-03-01 13:54:19,445::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-371::DEBUG::2013-03-01 13:54:19,445::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-371::DEBUG::2013-03-01 13:54:19,446::task::957::TaskManager.Task::(_decref) Task=`d7dd7048-ec97-4511-832e-a758a9f43a86`::ref 0 aborting False >Thread-372::DEBUG::2013-03-01 13:54:19,475::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-372::DEBUG::2013-03-01 13:54:19,475::task::568::TaskManager.Task::(_updateState) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::moving from state init -> state preparing >Thread-372::INFO::2013-03-01 13:54:19,475::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-372::DEBUG::2013-03-01 13:54:19,476::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`e75ea4a7-77fd-4342-bc53-40478f9a0d6f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-372::DEBUG::2013-03-01 13:54:19,476::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-372::DEBUG::2013-03-01 13:54:19,476::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-372::DEBUG::2013-03-01 13:54:19,477::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`e75ea4a7-77fd-4342-bc53-40478f9a0d6f`::Granted request >Thread-372::DEBUG::2013-03-01 13:54:19,477::task::794::TaskManager.Task::(resourceAcquired) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-372::DEBUG::2013-03-01 13:54:19,477::task::957::TaskManager.Task::(_decref) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::ref 1 aborting False >Thread-372::DEBUG::2013-03-01 13:54:19,478::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`4ac72e72-06c3-4f62-9fd4-3793291c13b9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-372::DEBUG::2013-03-01 13:54:19,478::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' for lock type 'exclusive' >Thread-372::DEBUG::2013-03-01 13:54:19,478::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free. Now locking as 'exclusive' (1 active user) >Thread-372::DEBUG::2013-03-01 13:54:19,479::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`4ac72e72-06c3-4f62-9fd4-3793291c13b9`::Granted request >Thread-372::DEBUG::2013-03-01 13:54:19,479::task::794::TaskManager.Task::(resourceAcquired) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::_resourcesAcquired: Storage.352c3a1d-5473-41a5-9693-3da8286df38d (exclusive) >Thread-372::DEBUG::2013-03-01 13:54:19,479::task::957::TaskManager.Task::(_decref) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::ref 1 aborting False >Thread-372::INFO::2013-03-01 13:54:19,479::sp::918::Storage.StoragePool::(attachSD) sdUUID=352c3a1d-5473-41a5-9693-3da8286df38d spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-372::DEBUG::2013-03-01 13:54:19,482::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-372::DEBUG::2013-03-01 13:54:19,482::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2013-03-01 13:54:19,483::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-372::DEBUG::2013-03-01 13:54:19,483::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2013-03-01 13:54:19,483::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-372::DEBUG::2013-03-01 13:54:19,499::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-372::DEBUG::2013-03-01 13:54:19,499::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:19,503::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:20,507::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:21,512::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:22,516::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:23,520::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:24,525::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2013-03-01 13:54:24,528::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-375::DEBUG::2013-03-01 13:54:26,469::task::568::TaskManager.Task::(_updateState) Task=`0a0c42cf-a70f-44c6-81c2-97bf9a4dda05`::moving from state init -> state preparing >Thread-375::INFO::2013-03-01 13:54:26,469::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-375::INFO::2013-03-01 13:54:26,470::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00445199012756', 'lastCheck': '1.1', 'code': 0, 'valid': True}} >Thread-375::DEBUG::2013-03-01 13:54:26,470::task::1151::TaskManager.Task::(prepare) Task=`0a0c42cf-a70f-44c6-81c2-97bf9a4dda05`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00445199012756', 'lastCheck': '1.1', 'code': 0, 'valid': True}} >Thread-375::DEBUG::2013-03-01 13:54:26,470::task::568::TaskManager.Task::(_updateState) Task=`0a0c42cf-a70f-44c6-81c2-97bf9a4dda05`::moving from state preparing -> state finished >Thread-375::DEBUG::2013-03-01 13:54:26,470::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-375::DEBUG::2013-03-01 13:54:26,471::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-375::DEBUG::2013-03-01 13:54:26,471::task::957::TaskManager.Task::(_decref) Task=`0a0c42cf-a70f-44c6-81c2-97bf9a4dda05`::ref 0 aborting False >Thread-372::DEBUG::2013-03-01 13:54:26,531::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-372::DEBUG::2013-03-01 13:54:27,694::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2013-03-01 13:54:27,695::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,696::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,696::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,697::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,697::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,698::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,699::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-372::DEBUG::2013-03-01 13:54:27,699::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-372::DEBUG::2013-03-01 13:54:27,934::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-372::WARNING::2013-03-01 13:54:27,935::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-372::DEBUG::2013-03-01 13:54:27,936::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-372::DEBUG::2013-03-01 13:54:27,970::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-372::DEBUG::2013-03-01 13:54:27,970::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-372::DEBUG::2013-03-01 13:54:27,976::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=1eafe57e246e79478c53922451cb56e77d15e8f8'] >Thread-372::DEBUG::2013-03-01 13:54:27,979::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-372::WARNING::2013-03-01 13:54:27,979::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-372::WARNING::2013-03-01 13:54:27,979::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-372::DEBUG::2013-03-01 13:54:27,980::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 352c3a1d-5473-41a5-9693-3da8286df38d successfully acquired (id: 1) >Thread-372::DEBUG::2013-03-01 13:54:27,980::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-372::DEBUG::2013-03-01 13:54:27,981::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 352c3a1d-5473-41a5-9693-3da8286df38d 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-372::DEBUG::2013-03-01 13:54:30,117::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2013-03-01 13:54:30,124::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-372::DEBUG::2013-03-01 13:54:30,167::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=1eafe57e246e79478c53922451cb56e77d15e8f8'] >Thread-372::DEBUG::2013-03-01 13:54:30,175::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-372::DEBUG::2013-03-01 13:54:30,180::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-372::DEBUG::2013-03-01 13:54:30,184::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=f4b0dc928daa0d1a14ccbfc67cff831eb7336e2d'] >Thread-372::DEBUG::2013-03-01 13:54:30,251::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-372::DEBUG::2013-03-01 13:54:30,256::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-372::DEBUG::2013-03-01 13:54:30,261::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-372::DEBUG::2013-03-01 13:54:30,265::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b2bf4d1e7a78adcd62af7488881ba5f0fb6162a6'] >Thread-372::DEBUG::2013-03-01 13:54:30,337::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-372::INFO::2013-03-01 13:54:30,341::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-372::DEBUG::2013-03-01 13:54:30,349::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-372::DEBUG::2013-03-01 13:54:30,354::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-372::DEBUG::2013-03-01 13:54:30,357::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-372::DEBUG::2013-03-01 13:54:30,359::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-372::DEBUG::2013-03-01 13:54:30,364::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9225b5505326349b648251bfd0eb10f87b60ec84'] >Thread-372::DEBUG::2013-03-01 13:54:30,439::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-372::INFO::2013-03-01 13:54:30,442::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-372::DEBUG::2013-03-01 13:54:30,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd /usr/libexec/vdsm) >Thread-372::DEBUG::2013-03-01 13:54:32,208::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2013-03-01 13:54:32,217::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-372::DEBUG::2013-03-01 13:54:32,221::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 352c3a1d-5473-41a5-9693-3da8286df38d released successfully (id: 1) >Thread-372::DEBUG::2013-03-01 13:54:32,225::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-372::DEBUG::2013-03-01 13:54:32,228::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2013-03-01 13:54:32,235::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-372::INFO::2013-03-01 13:54:32,239::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-372::DEBUG::2013-03-01 13:54:32,243::task::1151::TaskManager.Task::(prepare) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::finished: None >Thread-372::DEBUG::2013-03-01 13:54:32,246::task::568::TaskManager.Task::(_updateState) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::moving from state preparing -> state finished >Thread-372::DEBUG::2013-03-01 13:54:32,250::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d': < ResourceRef 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', isValid: 'True' obj: 'None'>} >Thread-372::DEBUG::2013-03-01 13:54:32,254::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-372::DEBUG::2013-03-01 13:54:32,260::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-372::DEBUG::2013-03-01 13:54:32,265::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-372::DEBUG::2013-03-01 13:54:32,268::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-372::DEBUG::2013-03-01 13:54:32,271::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-372::DEBUG::2013-03-01 13:54:32,277::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' >Thread-372::DEBUG::2013-03-01 13:54:32,281::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' (0 active users) >Thread-372::DEBUG::2013-03-01 13:54:32,284::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free, finding out if anyone is waiting for it. >Thread-372::DEBUG::2013-03-01 13:54:32,287::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', Clearing records. >Thread-372::DEBUG::2013-03-01 13:54:32,292::task::957::TaskManager.Task::(_decref) Task=`3941be8f-feae-4f2c-ae6b-8f0d9632d3e8`::ref 0 aborting False >Thread-390::DEBUG::2013-03-01 13:54:32,381::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-390::DEBUG::2013-03-01 13:54:32,381::task::568::TaskManager.Task::(_updateState) Task=`4ec16410-2801-4147-a08e-0fdb6fd8de08`::moving from state init -> state preparing >Thread-390::INFO::2013-03-01 13:54:32,381::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-390::INFO::2013-03-01 13:54:32,382::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-390::DEBUG::2013-03-01 13:54:32,382::task::1151::TaskManager.Task::(prepare) Task=`4ec16410-2801-4147-a08e-0fdb6fd8de08`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-390::DEBUG::2013-03-01 13:54:32,382::task::568::TaskManager.Task::(_updateState) Task=`4ec16410-2801-4147-a08e-0fdb6fd8de08`::moving from state preparing -> state finished >Thread-390::DEBUG::2013-03-01 13:54:32,382::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-390::DEBUG::2013-03-01 13:54:32,382::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-390::DEBUG::2013-03-01 13:54:32,382::task::957::TaskManager.Task::(_decref) Task=`4ec16410-2801-4147-a08e-0fdb6fd8de08`::ref 0 aborting False >Thread-391::DEBUG::2013-03-01 13:54:32,414::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-391::DEBUG::2013-03-01 13:54:32,414::task::568::TaskManager.Task::(_updateState) Task=`4de3ff1c-7d2f-43bb-87d2-f78c170e7591`::moving from state init -> state preparing >Thread-391::INFO::2013-03-01 13:54:32,415::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-391::DEBUG::2013-03-01 13:54:32,415::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`33481f70-0e9b-4e7c-bfd4-cc109ab785d6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-391::DEBUG::2013-03-01 13:54:32,416::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-391::DEBUG::2013-03-01 13:54:32,416::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-391::DEBUG::2013-03-01 13:54:32,416::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`33481f70-0e9b-4e7c-bfd4-cc109ab785d6`::Granted request >Thread-391::DEBUG::2013-03-01 13:54:32,417::task::794::TaskManager.Task::(resourceAcquired) Task=`4de3ff1c-7d2f-43bb-87d2-f78c170e7591`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-391::DEBUG::2013-03-01 13:54:32,417::task::957::TaskManager.Task::(_decref) Task=`4de3ff1c-7d2f-43bb-87d2-f78c170e7591`::ref 1 aborting False >Thread-391::INFO::2013-03-01 13:54:32,421::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '942052212736', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-391::DEBUG::2013-03-01 13:54:32,421::task::1151::TaskManager.Task::(prepare) Task=`4de3ff1c-7d2f-43bb-87d2-f78c170e7591`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '942052212736', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-391::DEBUG::2013-03-01 13:54:32,422::task::568::TaskManager.Task::(_updateState) Task=`4de3ff1c-7d2f-43bb-87d2-f78c170e7591`::moving from state preparing -> state finished >Thread-391::DEBUG::2013-03-01 13:54:32,422::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-391::DEBUG::2013-03-01 13:54:32,422::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-391::DEBUG::2013-03-01 13:54:32,423::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-391::DEBUG::2013-03-01 13:54:32,423::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-391::DEBUG::2013-03-01 13:54:32,423::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-391::DEBUG::2013-03-01 13:54:32,423::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-391::DEBUG::2013-03-01 13:54:32,424::task::957::TaskManager.Task::(_decref) Task=`4de3ff1c-7d2f-43bb-87d2-f78c170e7591`::ref 0 aborting False >Thread-393::DEBUG::2013-03-01 13:54:33,622::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-393::DEBUG::2013-03-01 13:54:33,623::task::568::TaskManager.Task::(_updateState) Task=`3c3eb312-8458-4ded-a268-d75f7455e89f`::moving from state init -> state preparing >Thread-393::INFO::2013-03-01 13:54:33,623::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-393::INFO::2013-03-01 13:54:33,623::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-393::DEBUG::2013-03-01 13:54:33,623::task::1151::TaskManager.Task::(prepare) Task=`3c3eb312-8458-4ded-a268-d75f7455e89f`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-393::DEBUG::2013-03-01 13:54:33,624::task::568::TaskManager.Task::(_updateState) Task=`3c3eb312-8458-4ded-a268-d75f7455e89f`::moving from state preparing -> state finished >Thread-393::DEBUG::2013-03-01 13:54:33,624::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-393::DEBUG::2013-03-01 13:54:33,624::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-393::DEBUG::2013-03-01 13:54:33,624::task::957::TaskManager.Task::(_decref) Task=`3c3eb312-8458-4ded-a268-d75f7455e89f`::ref 0 aborting False >Thread-394::DEBUG::2013-03-01 13:54:33,670::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-394::DEBUG::2013-03-01 13:54:33,671::task::568::TaskManager.Task::(_updateState) Task=`c0d3caa7-e26b-42a1-96bb-f6b03324289c`::moving from state init -> state preparing >Thread-394::INFO::2013-03-01 13:54:33,671::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-394::INFO::2013-03-01 13:54:33,674::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-394::DEBUG::2013-03-01 13:54:33,674::task::1151::TaskManager.Task::(prepare) Task=`c0d3caa7-e26b-42a1-96bb-f6b03324289c`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-394::DEBUG::2013-03-01 13:54:33,674::task::568::TaskManager.Task::(_updateState) Task=`c0d3caa7-e26b-42a1-96bb-f6b03324289c`::moving from state preparing -> state finished >Thread-394::DEBUG::2013-03-01 13:54:33,675::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-394::DEBUG::2013-03-01 13:54:33,675::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-394::DEBUG::2013-03-01 13:54:33,675::task::957::TaskManager.Task::(_decref) Task=`c0d3caa7-e26b-42a1-96bb-f6b03324289c`::ref 0 aborting False >Thread-395::DEBUG::2013-03-01 13:54:33,703::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-395::DEBUG::2013-03-01 13:54:33,703::task::568::TaskManager.Task::(_updateState) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::moving from state init -> state preparing >Thread-395::INFO::2013-03-01 13:54:33,704::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-395::DEBUG::2013-03-01 13:54:33,704::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`d136f45a-f0f1-49bc-920e-54344d98a73c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-395::DEBUG::2013-03-01 13:54:33,704::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-395::DEBUG::2013-03-01 13:54:33,705::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-395::DEBUG::2013-03-01 13:54:33,705::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`d136f45a-f0f1-49bc-920e-54344d98a73c`::Granted request >Thread-395::DEBUG::2013-03-01 13:54:33,705::task::794::TaskManager.Task::(resourceAcquired) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-395::DEBUG::2013-03-01 13:54:33,706::task::957::TaskManager.Task::(_decref) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::ref 1 aborting False >Thread-395::DEBUG::2013-03-01 13:54:33,706::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`48314359-9e3b-42bb-af81-9373b3e42889`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-395::DEBUG::2013-03-01 13:54:33,706::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' for lock type 'exclusive' >Thread-395::DEBUG::2013-03-01 13:54:33,707::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free. Now locking as 'exclusive' (1 active user) >Thread-395::DEBUG::2013-03-01 13:54:33,707::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`48314359-9e3b-42bb-af81-9373b3e42889`::Granted request >Thread-395::DEBUG::2013-03-01 13:54:33,707::task::794::TaskManager.Task::(resourceAcquired) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::_resourcesAcquired: Storage.28973299-9d17-4683-a64e-9a5cec830fcd (exclusive) >Thread-395::DEBUG::2013-03-01 13:54:33,708::task::957::TaskManager.Task::(_decref) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::ref 1 aborting False >Thread-395::INFO::2013-03-01 13:54:33,708::sp::918::Storage.StoragePool::(attachSD) sdUUID=28973299-9d17-4683-a64e-9a5cec830fcd spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-395::DEBUG::2013-03-01 13:54:33,711::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-395::DEBUG::2013-03-01 13:54:33,711::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-395::DEBUG::2013-03-01 13:54:33,711::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-395::DEBUG::2013-03-01 13:54:33,711::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-395::DEBUG::2013-03-01 13:54:33,712::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-395::DEBUG::2013-03-01 13:54:33,727::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-395::DEBUG::2013-03-01 13:54:33,728::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:33,730::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:34,735::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:35,739::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:35,742::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:35,745::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:35,748::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-395::DEBUG::2013-03-01 13:54:36,752::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-395::DEBUG::2013-03-01 13:54:38,776::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-395::DEBUG::2013-03-01 13:54:41,275::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-395::DEBUG::2013-03-01 13:54:41,276::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,276::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,277::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,277::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,277::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,278::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,278::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-395::DEBUG::2013-03-01 13:54:41,278::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,280::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-395::DEBUG::2013-03-01 13:54:41,502::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-395::WARNING::2013-03-01 13:54:41,503::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-395::DEBUG::2013-03-01 13:54:41,503::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-395::DEBUG::2013-03-01 13:54:41,550::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-395::DEBUG::2013-03-01 13:54:41,550::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-395::DEBUG::2013-03-01 13:54:41,555::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=f51aa52977d36c6c764a09ecbfa3ea10cd05243b'] >Thread-395::DEBUG::2013-03-01 13:54:41,557::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-395::WARNING::2013-03-01 13:54:41,557::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_imageNS already registered >Thread-395::WARNING::2013-03-01 13:54:41,558::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS already registered >Thread-395::DEBUG::2013-03-01 13:54:41,558::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 28973299-9d17-4683-a64e-9a5cec830fcd successfully acquired (id: 1) >Thread-395::DEBUG::2013-03-01 13:54:41,558::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-395::DEBUG::2013-03-01 13:54:41,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 28973299-9d17-4683-a64e-9a5cec830fcd 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-415::DEBUG::2013-03-01 13:54:41,962::task::568::TaskManager.Task::(_updateState) Task=`2f86e95c-b68e-4d6c-81b6-40b243135691`::moving from state init -> state preparing >Thread-415::INFO::2013-03-01 13:54:41,963::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-415::INFO::2013-03-01 13:54:41,963::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00392389297485', 'lastCheck': '6.6', 'code': 0, 'valid': True}} >Thread-415::DEBUG::2013-03-01 13:54:41,964::task::1151::TaskManager.Task::(prepare) Task=`2f86e95c-b68e-4d6c-81b6-40b243135691`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00392389297485', 'lastCheck': '6.6', 'code': 0, 'valid': True}} >Thread-415::DEBUG::2013-03-01 13:54:41,964::task::568::TaskManager.Task::(_updateState) Task=`2f86e95c-b68e-4d6c-81b6-40b243135691`::moving from state preparing -> state finished >Thread-415::DEBUG::2013-03-01 13:54:41,964::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-415::DEBUG::2013-03-01 13:54:41,964::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-415::DEBUG::2013-03-01 13:54:41,965::task::957::TaskManager.Task::(_decref) Task=`2f86e95c-b68e-4d6c-81b6-40b243135691`::ref 0 aborting False >Thread-395::DEBUG::2013-03-01 13:54:43,650::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-395::DEBUG::2013-03-01 13:54:43,651::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-395::DEBUG::2013-03-01 13:54:43,655::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=f51aa52977d36c6c764a09ecbfa3ea10cd05243b'] >Thread-395::DEBUG::2013-03-01 13:54:43,656::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-395::DEBUG::2013-03-01 13:54:43,656::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-395::DEBUG::2013-03-01 13:54:43,657::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=86b34b0a31d9b1998fa7f56977f057a177bc0eef'] >Thread-395::DEBUG::2013-03-01 13:54:43,705::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-395::DEBUG::2013-03-01 13:54:43,705::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-395::DEBUG::2013-03-01 13:54:43,705::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-395::DEBUG::2013-03-01 13:54:43,706::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d87fa6579f7c785ab481723840aaea7a1eddb3'] >Thread-395::DEBUG::2013-03-01 13:54:43,750::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-395::INFO::2013-03-01 13:54:43,750::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-395::DEBUG::2013-03-01 13:54:43,751::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-395::DEBUG::2013-03-01 13:54:43,751::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-395::DEBUG::2013-03-01 13:54:43,752::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-395::DEBUG::2013-03-01 13:54:43,752::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-395::DEBUG::2013-03-01 13:54:43,752::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=07af507e788ea8cb7a7d473c20ac802fe704b985'] >Thread-395::DEBUG::2013-03-01 13:54:43,803::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-395::INFO::2013-03-01 13:54:43,805::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-395::DEBUG::2013-03-01 13:54:43,806::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd /usr/libexec/vdsm) >Thread-395::DEBUG::2013-03-01 13:54:44,862::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-395::DEBUG::2013-03-01 13:54:44,862::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-395::DEBUG::2013-03-01 13:54:44,862::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 28973299-9d17-4683-a64e-9a5cec830fcd released successfully (id: 1) >Thread-395::DEBUG::2013-03-01 13:54:44,863::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-395::DEBUG::2013-03-01 13:54:44,863::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-395::DEBUG::2013-03-01 13:54:44,863::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-395::INFO::2013-03-01 13:54:44,864::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-395::DEBUG::2013-03-01 13:54:44,864::task::1151::TaskManager.Task::(prepare) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::finished: None >Thread-395::DEBUG::2013-03-01 13:54:44,864::task::568::TaskManager.Task::(_updateState) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::moving from state preparing -> state finished >Thread-395::DEBUG::2013-03-01 13:54:44,865::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd': < ResourceRef 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', isValid: 'True' obj: 'None'>} >Thread-395::DEBUG::2013-03-01 13:54:44,865::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-395::DEBUG::2013-03-01 13:54:44,865::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-395::DEBUG::2013-03-01 13:54:44,866::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-395::DEBUG::2013-03-01 13:54:44,866::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-395::DEBUG::2013-03-01 13:54:44,866::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-395::DEBUG::2013-03-01 13:54:44,867::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' >Thread-395::DEBUG::2013-03-01 13:54:44,867::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' (0 active users) >Thread-395::DEBUG::2013-03-01 13:54:44,867::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free, finding out if anyone is waiting for it. >Thread-395::DEBUG::2013-03-01 13:54:44,868::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', Clearing records. >Thread-395::DEBUG::2013-03-01 13:54:44,868::task::957::TaskManager.Task::(_decref) Task=`ebaac78f-f4b1-4f7b-8ac1-ac816e6c3b8a`::ref 0 aborting False >Thread-417::DEBUG::2013-03-01 13:54:44,904::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-417::DEBUG::2013-03-01 13:54:44,904::task::568::TaskManager.Task::(_updateState) Task=`561906b7-2817-462c-be90-f9ccd3d31ef6`::moving from state init -> state preparing >Thread-417::INFO::2013-03-01 13:54:44,905::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-417::INFO::2013-03-01 13:54:44,905::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-417::DEBUG::2013-03-01 13:54:44,905::task::1151::TaskManager.Task::(prepare) Task=`561906b7-2817-462c-be90-f9ccd3d31ef6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-417::DEBUG::2013-03-01 13:54:44,906::task::568::TaskManager.Task::(_updateState) Task=`561906b7-2817-462c-be90-f9ccd3d31ef6`::moving from state preparing -> state finished >Thread-417::DEBUG::2013-03-01 13:54:44,906::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-417::DEBUG::2013-03-01 13:54:44,906::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-417::DEBUG::2013-03-01 13:54:44,906::task::957::TaskManager.Task::(_decref) Task=`561906b7-2817-462c-be90-f9ccd3d31ef6`::ref 0 aborting False >Thread-418::DEBUG::2013-03-01 13:54:44,932::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-418::DEBUG::2013-03-01 13:54:44,933::task::568::TaskManager.Task::(_updateState) Task=`28fcd49c-85b2-4bdd-adfc-69ea58c12a31`::moving from state init -> state preparing >Thread-418::INFO::2013-03-01 13:54:44,933::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-418::DEBUG::2013-03-01 13:54:44,933::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ea5cc69f-ee27-4978-955b-f6e7f3c1eea4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-418::DEBUG::2013-03-01 13:54:44,934::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-418::DEBUG::2013-03-01 13:54:44,934::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-418::DEBUG::2013-03-01 13:54:44,934::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ea5cc69f-ee27-4978-955b-f6e7f3c1eea4`::Granted request >Thread-418::DEBUG::2013-03-01 13:54:44,935::task::794::TaskManager.Task::(resourceAcquired) Task=`28fcd49c-85b2-4bdd-adfc-69ea58c12a31`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-418::DEBUG::2013-03-01 13:54:44,935::task::957::TaskManager.Task::(_decref) Task=`28fcd49c-85b2-4bdd-adfc-69ea58c12a31`::ref 1 aborting False >Thread-418::INFO::2013-03-01 13:54:44,940::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '941940015104', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-418::DEBUG::2013-03-01 13:54:44,940::task::1151::TaskManager.Task::(prepare) Task=`28fcd49c-85b2-4bdd-adfc-69ea58c12a31`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '941940015104', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-418::DEBUG::2013-03-01 13:54:44,940::task::568::TaskManager.Task::(_updateState) Task=`28fcd49c-85b2-4bdd-adfc-69ea58c12a31`::moving from state preparing -> state finished >Thread-418::DEBUG::2013-03-01 13:54:44,940::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-418::DEBUG::2013-03-01 13:54:44,941::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-418::DEBUG::2013-03-01 13:54:44,941::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-418::DEBUG::2013-03-01 13:54:44,941::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-418::DEBUG::2013-03-01 13:54:44,942::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-418::DEBUG::2013-03-01 13:54:44,942::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-418::DEBUG::2013-03-01 13:54:44,942::task::957::TaskManager.Task::(_decref) Task=`28fcd49c-85b2-4bdd-adfc-69ea58c12a31`::ref 0 aborting False >Thread-420::DEBUG::2013-03-01 13:54:46,763::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-420::DEBUG::2013-03-01 13:54:46,763::task::568::TaskManager.Task::(_updateState) Task=`9869cd31-3ff8-4850-8063-6570daaf590c`::moving from state init -> state preparing >Thread-420::INFO::2013-03-01 13:54:46,763::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-420::INFO::2013-03-01 13:54:46,764::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-420::DEBUG::2013-03-01 13:54:46,764::task::1151::TaskManager.Task::(prepare) Task=`9869cd31-3ff8-4850-8063-6570daaf590c`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-420::DEBUG::2013-03-01 13:54:46,764::task::568::TaskManager.Task::(_updateState) Task=`9869cd31-3ff8-4850-8063-6570daaf590c`::moving from state preparing -> state finished >Thread-420::DEBUG::2013-03-01 13:54:46,764::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-420::DEBUG::2013-03-01 13:54:46,765::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-420::DEBUG::2013-03-01 13:54:46,765::task::957::TaskManager.Task::(_decref) Task=`9869cd31-3ff8-4850-8063-6570daaf590c`::ref 0 aborting False >Thread-421::DEBUG::2013-03-01 13:54:46,803::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-421::DEBUG::2013-03-01 13:54:46,803::task::568::TaskManager.Task::(_updateState) Task=`97228233-3616-4394-9a2b-fcd441631e47`::moving from state init -> state preparing >Thread-421::INFO::2013-03-01 13:54:46,804::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-421::INFO::2013-03-01 13:54:46,806::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-421::DEBUG::2013-03-01 13:54:46,806::task::1151::TaskManager.Task::(prepare) Task=`97228233-3616-4394-9a2b-fcd441631e47`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-421::DEBUG::2013-03-01 13:54:46,807::task::568::TaskManager.Task::(_updateState) Task=`97228233-3616-4394-9a2b-fcd441631e47`::moving from state preparing -> state finished >Thread-421::DEBUG::2013-03-01 13:54:46,807::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-421::DEBUG::2013-03-01 13:54:46,807::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-421::DEBUG::2013-03-01 13:54:46,807::task::957::TaskManager.Task::(_decref) Task=`97228233-3616-4394-9a2b-fcd441631e47`::ref 0 aborting False >Thread-422::DEBUG::2013-03-01 13:54:46,838::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-422::DEBUG::2013-03-01 13:54:46,838::task::568::TaskManager.Task::(_updateState) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::moving from state init -> state preparing >Thread-422::INFO::2013-03-01 13:54:46,838::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-422::DEBUG::2013-03-01 13:54:46,839::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`30b048eb-6e9c-4a62-8146-35873133c8a0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-422::DEBUG::2013-03-01 13:54:46,839::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-422::DEBUG::2013-03-01 13:54:46,839::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-422::DEBUG::2013-03-01 13:54:46,840::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`30b048eb-6e9c-4a62-8146-35873133c8a0`::Granted request >Thread-422::DEBUG::2013-03-01 13:54:46,840::task::794::TaskManager.Task::(resourceAcquired) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-422::DEBUG::2013-03-01 13:54:46,840::task::957::TaskManager.Task::(_decref) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::ref 1 aborting False >Thread-422::DEBUG::2013-03-01 13:54:46,841::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`63738682-9726-487f-bed0-8ab3cfbff5ab`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-422::DEBUG::2013-03-01 13:54:46,841::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' for lock type 'exclusive' >Thread-422::DEBUG::2013-03-01 13:54:46,841::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free. Now locking as 'exclusive' (1 active user) >Thread-422::DEBUG::2013-03-01 13:54:46,842::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`63738682-9726-487f-bed0-8ab3cfbff5ab`::Granted request >Thread-422::DEBUG::2013-03-01 13:54:46,842::task::794::TaskManager.Task::(resourceAcquired) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::_resourcesAcquired: Storage.352c3a1d-5473-41a5-9693-3da8286df38d (exclusive) >Thread-422::DEBUG::2013-03-01 13:54:46,842::task::957::TaskManager.Task::(_decref) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::ref 1 aborting False >Thread-422::INFO::2013-03-01 13:54:46,842::sp::1045::Storage.StoragePool::(activateSD) sdUUID=352c3a1d-5473-41a5-9693-3da8286df38d spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-422::DEBUG::2013-03-01 13:54:46,843::formatConverter::98::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain 352c3a1d-5473-41a5-9693-3da8286df38d from version 0 to version 3 >Thread-422::DEBUG::2013-03-01 13:54:46,843::formatConverter::118::Storage.v3DomainConverter::(v3DomainConverter) Setting permissions for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:54:47,344::formatConverter::121::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:54:47,344::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:54:47,444::formatConverter::125::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::INFO::2013-03-01 13:54:47,444::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 352c3a1d-5473-41a5-9693-3da8286df38d (id: 1) >Thread-426::DEBUG::2013-03-01 13:54:57,364::task::568::TaskManager.Task::(_updateState) Task=`6122add6-8bc5-44eb-b60a-0a2f0194c3f0`::moving from state init -> state preparing >Thread-426::INFO::2013-03-01 13:54:57,365::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-426::INFO::2013-03-01 13:54:57,365::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00362110137939', 'lastCheck': '2.0', 'code': 0, 'valid': True}} >Thread-426::DEBUG::2013-03-01 13:54:57,365::task::1151::TaskManager.Task::(prepare) Task=`6122add6-8bc5-44eb-b60a-0a2f0194c3f0`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00362110137939', 'lastCheck': '2.0', 'code': 0, 'valid': True}} >Thread-426::DEBUG::2013-03-01 13:54:57,365::task::568::TaskManager.Task::(_updateState) Task=`6122add6-8bc5-44eb-b60a-0a2f0194c3f0`::moving from state preparing -> state finished >Thread-426::DEBUG::2013-03-01 13:54:57,366::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-426::DEBUG::2013-03-01 13:54:57,366::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-426::DEBUG::2013-03-01 13:54:57,366::task::957::TaskManager.Task::(_decref) Task=`6122add6-8bc5-44eb-b60a-0a2f0194c3f0`::ref 0 aborting False >Thread-422::DEBUG::2013-03-01 13:55:08,447::clusterlock::191::SANLock::(acquireHostId) Host id for domain 352c3a1d-5473-41a5-9693-3da8286df38d successfully acquired (id: 1) >Thread-422::DEBUG::2013-03-01 13:55:08,448::formatConverter::160::Storage.v3DomainConverter::(v3ReallocateMetadataSlot) The metadata reallocation check is not needed for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:55:08,449::formatConverter::298::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 0 to version 3 for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:55:08,449::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-422::DEBUG::2013-03-01 13:55:08,449::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-422::DEBUG::2013-03-01 13:55:08,449::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-422::DEBUG::2013-03-01 13:55:08,580::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-422::DEBUG::2013-03-01 13:55:08,581::formatConverter::336::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:55:08,581::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-422::DEBUG::2013-03-01 13:55:08,581::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-422::DEBUG::2013-03-01 13:55:08,581::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-422::DEBUG::2013-03-01 13:55:08,582::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-422::DEBUG::2013-03-01 13:55:08,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-422::DEBUG::2013-03-01 13:55:08,604::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-422::DEBUG::2013-03-01 13:55:08,604::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:08,607::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:09,611::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:09,614::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:10,618::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:10,621::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:10,624::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-422::DEBUG::2013-03-01 13:55:11,628::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-432::DEBUG::2013-03-01 13:55:12,606::task::568::TaskManager.Task::(_updateState) Task=`03bec217-62c3-4464-8a9c-fb4aae9c5c97`::moving from state init -> state preparing >Thread-432::INFO::2013-03-01 13:55:12,607::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-432::INFO::2013-03-01 13:55:12,607::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00316691398621', 'lastCheck': '7.2', 'code': 0, 'valid': True}} >Thread-432::DEBUG::2013-03-01 13:55:12,607::task::1151::TaskManager.Task::(prepare) Task=`03bec217-62c3-4464-8a9c-fb4aae9c5c97`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00316691398621', 'lastCheck': '7.2', 'code': 0, 'valid': True}} >Thread-432::DEBUG::2013-03-01 13:55:12,608::task::568::TaskManager.Task::(_updateState) Task=`03bec217-62c3-4464-8a9c-fb4aae9c5c97`::moving from state preparing -> state finished >Thread-432::DEBUG::2013-03-01 13:55:12,608::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-432::DEBUG::2013-03-01 13:55:12,608::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-432::DEBUG::2013-03-01 13:55:12,608::task::957::TaskManager.Task::(_decref) Task=`03bec217-62c3-4464-8a9c-fb4aae9c5c97`::ref 0 aborting False >Thread-422::DEBUG::2013-03-01 13:55:13,631::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-422::DEBUG::2013-03-01 13:55:14,715::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-422::DEBUG::2013-03-01 13:55:14,716::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,716::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,717::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,717::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,718::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,718::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,718::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-422::DEBUG::2013-03-01 13:55:14,719::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-422::DEBUG::2013-03-01 13:55:14,956::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-422::WARNING::2013-03-01 13:55:14,957::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-422::DEBUG::2013-03-01 13:55:14,958::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-422::DEBUG::2013-03-01 13:55:14,994::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:55:14,995::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-422::DEBUG::2013-03-01 13:55:14,999::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-422::DEBUG::2013-03-01 13:55:15,001::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-422::WARNING::2013-03-01 13:55:15,001::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-422::WARNING::2013-03-01 13:55:15,002::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-422::DEBUG::2013-03-01 13:55:15,002::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-422::DEBUG::2013-03-01 13:55:15,003::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-422::DEBUG::2013-03-01 13:55:15,003::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a8c4664dfdb8adad46bc7b07c275d31f691da8e5'] >Thread-422::DEBUG::2013-03-01 13:55:15,091::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-422::INFO::2013-03-01 13:55:15,091::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:55:15,092::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-422::DEBUG::2013-03-01 13:55:15,092::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-422::DEBUG::2013-03-01 13:55:15,093::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-422::DEBUG::2013-03-01 13:55:15,093::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-422::DEBUG::2013-03-01 13:55:15,093::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-422::DEBUG::2013-03-01 13:55:15,093::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-422::DEBUG::2013-03-01 13:55:15,094::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` started monitoring domain `352c3a1d-5473-41a5-9693-3da8286df38d` >Thread-447::DEBUG::2013-03-01 13:55:15,094::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-422::DEBUG::2013-03-01 13:55:15,095::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-422::INFO::2013-03-01 13:55:15,096::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-422::DEBUG::2013-03-01 13:55:15,097::task::1151::TaskManager.Task::(prepare) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::finished: None >Thread-422::DEBUG::2013-03-01 13:55:15,098::task::568::TaskManager.Task::(_updateState) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::moving from state preparing -> state finished >Thread-422::DEBUG::2013-03-01 13:55:15,099::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d': < ResourceRef 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', isValid: 'True' obj: 'None'>} >Thread-422::DEBUG::2013-03-01 13:55:15,101::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-422::DEBUG::2013-03-01 13:55:15,103::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-422::DEBUG::2013-03-01 13:55:15,106::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-422::DEBUG::2013-03-01 13:55:15,107::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-422::DEBUG::2013-03-01 13:55:15,108::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-422::DEBUG::2013-03-01 13:55:15,110::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' >Thread-422::DEBUG::2013-03-01 13:55:15,112::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' (0 active users) >Thread-422::DEBUG::2013-03-01 13:55:15,112::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free, finding out if anyone is waiting for it. >Thread-422::DEBUG::2013-03-01 13:55:15,112::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', Clearing records. >Thread-422::DEBUG::2013-03-01 13:55:15,113::task::957::TaskManager.Task::(_decref) Task=`f5495e8f-2043-4956-8d67-a941c7074d36`::ref 0 aborting False >Thread-448::DEBUG::2013-03-01 13:55:15,149::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-448::DEBUG::2013-03-01 13:55:15,150::task::568::TaskManager.Task::(_updateState) Task=`dfc44fb8-4cda-4019-b0f8-3f14b9d208dd`::moving from state init -> state preparing >Thread-448::INFO::2013-03-01 13:55:15,150::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-448::INFO::2013-03-01 13:55:15,150::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-448::DEBUG::2013-03-01 13:55:15,151::task::1151::TaskManager.Task::(prepare) Task=`dfc44fb8-4cda-4019-b0f8-3f14b9d208dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-448::DEBUG::2013-03-01 13:55:15,151::task::568::TaskManager.Task::(_updateState) Task=`dfc44fb8-4cda-4019-b0f8-3f14b9d208dd`::moving from state preparing -> state finished >Thread-448::DEBUG::2013-03-01 13:55:15,151::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-448::DEBUG::2013-03-01 13:55:15,151::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-448::DEBUG::2013-03-01 13:55:15,152::task::957::TaskManager.Task::(_decref) Task=`dfc44fb8-4cda-4019-b0f8-3f14b9d208dd`::ref 0 aborting False >Thread-449::DEBUG::2013-03-01 13:55:15,158::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-449::DEBUG::2013-03-01 13:55:15,159::task::568::TaskManager.Task::(_updateState) Task=`9a057861-a645-48c4-88b9-774cd1ad9721`::moving from state init -> state preparing >Thread-449::INFO::2013-03-01 13:55:15,159::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-449::DEBUG::2013-03-01 13:55:15,161::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`6cc16b0b-1911-45db-99a8-c9c0b2af339c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-449::DEBUG::2013-03-01 13:55:15,162::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-449::DEBUG::2013-03-01 13:55:15,163::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-449::DEBUG::2013-03-01 13:55:15,163::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`6cc16b0b-1911-45db-99a8-c9c0b2af339c`::Granted request >Thread-449::DEBUG::2013-03-01 13:55:15,164::task::794::TaskManager.Task::(resourceAcquired) Task=`9a057861-a645-48c4-88b9-774cd1ad9721`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-449::DEBUG::2013-03-01 13:55:15,164::task::957::TaskManager.Task::(_decref) Task=`9a057861-a645-48c4-88b9-774cd1ad9721`::ref 1 aborting False >Thread-449::INFO::2013-03-01 13:55:15,164::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-449::DEBUG::2013-03-01 13:55:15,169::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a8c4664dfdb8adad46bc7b07c275d31f691da8e5'] >Thread-449::DEBUG::2013-03-01 13:55:15,170::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:15,170::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:15,171::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:15,171::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:15,172::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:15,172::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:15,172::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-449::DEBUG::2013-03-01 13:55:15,179::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-449::DEBUG::2013-03-01 13:55:15,179::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-449::DEBUG::2013-03-01 13:55:15,179::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-449::DEBUG::2013-03-01 13:55:15,180::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-450::DEBUG::2013-03-01 13:55:15,188::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-450::DEBUG::2013-03-01 13:55:15,189::task::568::TaskManager.Task::(_updateState) Task=`053d52a3-4f78-4a3e-a372-2079ed9f459d`::moving from state init -> state preparing >Thread-450::INFO::2013-03-01 13:55:15,190::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-450::DEBUG::2013-03-01 13:55:15,190::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`90efb71c-0d5c-492b-8056-a3ca8077701d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-450::DEBUG::2013-03-01 13:55:15,191::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-450::DEBUG::2013-03-01 13:55:15,191::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-450::DEBUG::2013-03-01 13:55:15,191::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`90efb71c-0d5c-492b-8056-a3ca8077701d`::Granted request >Thread-450::DEBUG::2013-03-01 13:55:15,192::task::794::TaskManager.Task::(resourceAcquired) Task=`053d52a3-4f78-4a3e-a372-2079ed9f459d`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-450::DEBUG::2013-03-01 13:55:15,192::task::957::TaskManager.Task::(_decref) Task=`053d52a3-4f78-4a3e-a372-2079ed9f459d`::ref 1 aborting False >Thread-449::DEBUG::2013-03-01 13:55:15,195::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-449::DEBUG::2013-03-01 13:55:15,195::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:15,203::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:16,207::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:17,211::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:18,216::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:19,220::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:20,225::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-449::DEBUG::2013-03-01 13:55:20,228::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-449::DEBUG::2013-03-01 13:55:22,231::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-449::DEBUG::2013-03-01 13:55:23,330::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-449::DEBUG::2013-03-01 13:55:23,330::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,331::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,331::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,332::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,332::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,332::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,333::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-449::DEBUG::2013-03-01 13:55:23,333::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,334::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-449::DEBUG::2013-03-01 13:55:23,512::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-449::WARNING::2013-03-01 13:55:23,513::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-449::DEBUG::2013-03-01 13:55:23,515::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,561::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-449::DEBUG::2013-03-01 13:55:23,562::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-449::DEBUG::2013-03-01 13:55:23,566::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a8c4664dfdb8adad46bc7b07c275d31f691da8e5'] >Thread-449::DEBUG::2013-03-01 13:55:23,568::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-449::WARNING::2013-03-01 13:55:23,568::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-449::WARNING::2013-03-01 13:55:23,569::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-449::DEBUG::2013-03-01 13:55:23,571::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-449::DEBUG::2013-03-01 13:55:23,573::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-449::DEBUG::2013-03-01 13:55:23,577::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-449::DEBUG::2013-03-01 13:55:23,584::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-449::WARNING::2013-03-01 13:55:23,588::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-449::DEBUG::2013-03-01 13:55:23,597::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-449::DEBUG::2013-03-01 13:55:23,610::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-450::DEBUG::2013-03-01 13:55:23,621::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-450::DEBUG::2013-03-01 13:55:23,625::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-449::DEBUG::2013-03-01 13:55:23,800::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-449::WARNING::2013-03-01 13:55:23,801::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-450::DEBUG::2013-03-01 13:55:23,821::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-450::WARNING::2013-03-01 13:55:23,828::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-450::DEBUG::2013-03-01 13:55:23,833::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-449::INFO::2013-03-01 13:55:23,868::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-449::INFO::2013-03-01 13:55:23,874::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-449::INFO::2013-03-01 13:55:23,881::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-449::INFO::2013-03-01 13:55:23,887::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-449::DEBUG::2013-03-01 13:55:23,892::task::1151::TaskManager.Task::(prepare) Task=`9a057861-a645-48c4-88b9-774cd1ad9721`::finished: None >Thread-449::DEBUG::2013-03-01 13:55:23,895::task::568::TaskManager.Task::(_updateState) Task=`9a057861-a645-48c4-88b9-774cd1ad9721`::moving from state preparing -> state finished >Thread-449::DEBUG::2013-03-01 13:55:23,896::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-449::DEBUG::2013-03-01 13:55:23,897::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-449::DEBUG::2013-03-01 13:55:23,900::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-449::DEBUG::2013-03-01 13:55:23,902::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-449::DEBUG::2013-03-01 13:55:23,905::task::957::TaskManager.Task::(_decref) Task=`9a057861-a645-48c4-88b9-774cd1ad9721`::ref 0 aborting False >Thread-450::DEBUG::2013-03-01 13:55:23,905::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-450::DEBUG::2013-03-01 13:55:23,906::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-450::DEBUG::2013-03-01 13:55:23,916::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-450::DEBUG::2013-03-01 13:55:23,919::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-450::WARNING::2013-03-01 13:55:23,919::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-450::WARNING::2013-03-01 13:55:23,919::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-450::INFO::2013-03-01 13:55:23,920::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Active', 'diskfree': '942317502464', 'alerts': [], 'disktotal': '1098974756864'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '942503100416', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-450::DEBUG::2013-03-01 13:55:23,920::task::1151::TaskManager.Task::(prepare) Task=`053d52a3-4f78-4a3e-a372-2079ed9f459d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Active', 'diskfree': '942317502464', 'alerts': [], 'disktotal': '1098974756864'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '942503100416', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-450::DEBUG::2013-03-01 13:55:23,921::task::568::TaskManager.Task::(_updateState) Task=`053d52a3-4f78-4a3e-a372-2079ed9f459d`::moving from state preparing -> state finished >Thread-450::DEBUG::2013-03-01 13:55:23,921::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-450::DEBUG::2013-03-01 13:55:23,921::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-450::DEBUG::2013-03-01 13:55:23,921::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-450::DEBUG::2013-03-01 13:55:23,922::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-450::DEBUG::2013-03-01 13:55:23,922::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-450::DEBUG::2013-03-01 13:55:23,922::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-450::DEBUG::2013-03-01 13:55:23,923::task::957::TaskManager.Task::(_decref) Task=`053d52a3-4f78-4a3e-a372-2079ed9f459d`::ref 0 aborting False >Thread-510::DEBUG::2013-03-01 13:55:25,592::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-510::DEBUG::2013-03-01 13:55:25,593::task::568::TaskManager.Task::(_updateState) Task=`ecbcc1cb-e111-437a-a254-80b1572d4ffa`::moving from state init -> state preparing >Thread-510::INFO::2013-03-01 13:55:25,593::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-510::INFO::2013-03-01 13:55:25,593::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-510::DEBUG::2013-03-01 13:55:25,593::task::1151::TaskManager.Task::(prepare) Task=`ecbcc1cb-e111-437a-a254-80b1572d4ffa`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-510::DEBUG::2013-03-01 13:55:25,594::task::568::TaskManager.Task::(_updateState) Task=`ecbcc1cb-e111-437a-a254-80b1572d4ffa`::moving from state preparing -> state finished >Thread-510::DEBUG::2013-03-01 13:55:25,594::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-510::DEBUG::2013-03-01 13:55:25,594::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-510::DEBUG::2013-03-01 13:55:25,594::task::957::TaskManager.Task::(_decref) Task=`ecbcc1cb-e111-437a-a254-80b1572d4ffa`::ref 0 aborting False >Thread-511::DEBUG::2013-03-01 13:55:25,626::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-511::DEBUG::2013-03-01 13:55:25,626::task::568::TaskManager.Task::(_updateState) Task=`cbd30419-9a09-4a3f-bd4c-9b6e8da79354`::moving from state init -> state preparing >Thread-511::INFO::2013-03-01 13:55:25,627::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-511::INFO::2013-03-01 13:55:25,630::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-511::DEBUG::2013-03-01 13:55:25,630::task::1151::TaskManager.Task::(prepare) Task=`cbd30419-9a09-4a3f-bd4c-9b6e8da79354`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-511::DEBUG::2013-03-01 13:55:25,630::task::568::TaskManager.Task::(_updateState) Task=`cbd30419-9a09-4a3f-bd4c-9b6e8da79354`::moving from state preparing -> state finished >Thread-511::DEBUG::2013-03-01 13:55:25,630::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-511::DEBUG::2013-03-01 13:55:25,630::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-511::DEBUG::2013-03-01 13:55:25,631::task::957::TaskManager.Task::(_decref) Task=`cbd30419-9a09-4a3f-bd4c-9b6e8da79354`::ref 0 aborting False >Thread-512::DEBUG::2013-03-01 13:55:25,659::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-512::DEBUG::2013-03-01 13:55:25,659::task::568::TaskManager.Task::(_updateState) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::moving from state init -> state preparing >Thread-512::INFO::2013-03-01 13:55:25,660::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-512::DEBUG::2013-03-01 13:55:25,660::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`17fe926e-8ae6-4781-aed4-a359e77476cb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-512::DEBUG::2013-03-01 13:55:25,660::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-512::DEBUG::2013-03-01 13:55:25,661::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-512::DEBUG::2013-03-01 13:55:25,661::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`17fe926e-8ae6-4781-aed4-a359e77476cb`::Granted request >Thread-512::DEBUG::2013-03-01 13:55:25,661::task::794::TaskManager.Task::(resourceAcquired) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-512::DEBUG::2013-03-01 13:55:25,662::task::957::TaskManager.Task::(_decref) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::ref 1 aborting False >Thread-512::DEBUG::2013-03-01 13:55:25,662::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`7fede777-76a3-4288-9403-e0617ebf271d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-512::DEBUG::2013-03-01 13:55:25,662::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' for lock type 'exclusive' >Thread-512::DEBUG::2013-03-01 13:55:25,663::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free. Now locking as 'exclusive' (1 active user) >Thread-512::DEBUG::2013-03-01 13:55:25,663::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`7fede777-76a3-4288-9403-e0617ebf271d`::Granted request >Thread-512::DEBUG::2013-03-01 13:55:25,663::task::794::TaskManager.Task::(resourceAcquired) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::_resourcesAcquired: Storage.28973299-9d17-4683-a64e-9a5cec830fcd (exclusive) >Thread-512::DEBUG::2013-03-01 13:55:25,664::task::957::TaskManager.Task::(_decref) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::ref 1 aborting False >Thread-512::INFO::2013-03-01 13:55:25,664::sp::1045::Storage.StoragePool::(activateSD) sdUUID=28973299-9d17-4683-a64e-9a5cec830fcd spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-512::DEBUG::2013-03-01 13:55:25,664::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-512::DEBUG::2013-03-01 13:55:25,664::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-512::DEBUG::2013-03-01 13:55:25,665::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-512::DEBUG::2013-03-01 13:55:25,665::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-512::DEBUG::2013-03-01 13:55:25,665::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-512::DEBUG::2013-03-01 13:55:25,681::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-512::DEBUG::2013-03-01 13:55:25,681::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:25,684::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:26,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:27,692::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-513::DEBUG::2013-03-01 13:55:27,873::task::568::TaskManager.Task::(_updateState) Task=`376c782f-b594-48fa-b161-f311d76c22f1`::moving from state init -> state preparing >Thread-513::INFO::2013-03-01 13:55:27,873::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-513::INFO::2013-03-01 13:55:27,873::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'352c3a1d-5473-41a5-9693-3da8286df38d': {'delay': '0.00304198265076', 'lastCheck': '2.7', 'code': 0, 'valid': True}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0161440372467', 'lastCheck': '4.2', 'code': 0, 'valid': True}} >Thread-513::DEBUG::2013-03-01 13:55:27,874::task::1151::TaskManager.Task::(prepare) Task=`376c782f-b594-48fa-b161-f311d76c22f1`::finished: {'352c3a1d-5473-41a5-9693-3da8286df38d': {'delay': '0.00304198265076', 'lastCheck': '2.7', 'code': 0, 'valid': True}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0161440372467', 'lastCheck': '4.2', 'code': 0, 'valid': True}} >Thread-513::DEBUG::2013-03-01 13:55:27,874::task::568::TaskManager.Task::(_updateState) Task=`376c782f-b594-48fa-b161-f311d76c22f1`::moving from state preparing -> state finished >Thread-513::DEBUG::2013-03-01 13:55:27,874::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-513::DEBUG::2013-03-01 13:55:27,874::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-513::DEBUG::2013-03-01 13:55:27,875::task::957::TaskManager.Task::(_decref) Task=`376c782f-b594-48fa-b161-f311d76c22f1`::ref 0 aborting False >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:28,697::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:28,700::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:28,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-512::DEBUG::2013-03-01 13:55:28,706::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-512::DEBUG::2013-03-01 13:55:30,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-512::DEBUG::2013-03-01 13:55:31,782::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-512::DEBUG::2013-03-01 13:55:31,782::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,783::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,783::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,783::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,784::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,784::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,784::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-512::DEBUG::2013-03-01 13:55:31,785::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:31,786::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-512::DEBUG::2013-03-01 13:55:32,005::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-512::WARNING::2013-03-01 13:55:32,059::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-512::DEBUG::2013-03-01 13:55:32,059::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-512::DEBUG::2013-03-01 13:55:32,096::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-512::DEBUG::2013-03-01 13:55:32,097::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-512::DEBUG::2013-03-01 13:55:32,101::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=07af507e788ea8cb7a7d473c20ac802fe704b985'] >Thread-512::DEBUG::2013-03-01 13:55:32,102::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-512::WARNING::2013-03-01 13:55:32,102::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_imageNS already registered >Thread-512::WARNING::2013-03-01 13:55:32,103::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS already registered >Thread-512::DEBUG::2013-03-01 13:55:32,103::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-512::DEBUG::2013-03-01 13:55:32,103::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-512::DEBUG::2013-03-01 13:55:32,104::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Active,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e1474a92d4c14be3f72caa960d1bb5a8c0407ab2'] >Thread-512::DEBUG::2013-03-01 13:55:32,185::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-512::INFO::2013-03-01 13:55:32,186::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-512::DEBUG::2013-03-01 13:55:32,186::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-512::DEBUG::2013-03-01 13:55:32,186::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-512::DEBUG::2013-03-01 13:55:32,186::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-512::DEBUG::2013-03-01 13:55:32,187::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-512::DEBUG::2013-03-01 13:55:32,187::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-512::DEBUG::2013-03-01 13:55:32,187::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-512::DEBUG::2013-03-01 13:55:32,188::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` started monitoring domain `28973299-9d17-4683-a64e-9a5cec830fcd` >Thread-533::DEBUG::2013-03-01 13:55:32,188::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-512::DEBUG::2013-03-01 13:55:32,188::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-512::INFO::2013-03-01 13:55:32,190::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-512::DEBUG::2013-03-01 13:55:32,192::task::1151::TaskManager.Task::(prepare) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::finished: None >Thread-512::DEBUG::2013-03-01 13:55:32,194::task::568::TaskManager.Task::(_updateState) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::moving from state preparing -> state finished >Thread-512::DEBUG::2013-03-01 13:55:32,195::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd': < ResourceRef 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', isValid: 'True' obj: 'None'>} >Thread-512::DEBUG::2013-03-01 13:55:32,198::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-512::DEBUG::2013-03-01 13:55:32,201::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-512::DEBUG::2013-03-01 13:55:32,202::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-512::DEBUG::2013-03-01 13:55:32,202::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-512::DEBUG::2013-03-01 13:55:32,204::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-512::DEBUG::2013-03-01 13:55:32,205::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' >Thread-512::DEBUG::2013-03-01 13:55:32,205::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' (0 active users) >Thread-512::DEBUG::2013-03-01 13:55:32,205::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free, finding out if anyone is waiting for it. >Thread-512::DEBUG::2013-03-01 13:55:32,206::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', Clearing records. >Thread-512::DEBUG::2013-03-01 13:55:32,206::task::957::TaskManager.Task::(_decref) Task=`b6b2cf6a-5212-4335-868a-7ed39597d1da`::ref 0 aborting False >Thread-534::DEBUG::2013-03-01 13:55:32,262::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-534::DEBUG::2013-03-01 13:55:32,263::task::568::TaskManager.Task::(_updateState) Task=`d4530ebb-c50b-45c6-be21-b0cac0b6ace1`::moving from state init -> state preparing >Thread-534::INFO::2013-03-01 13:55:32,263::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-534::DEBUG::2013-03-01 13:55:32,264::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`66a6e061-3c45-4c0a-b282-0583680959f5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-534::DEBUG::2013-03-01 13:55:32,264::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-534::DEBUG::2013-03-01 13:55:32,264::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-534::DEBUG::2013-03-01 13:55:32,265::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`66a6e061-3c45-4c0a-b282-0583680959f5`::Granted request >Thread-534::DEBUG::2013-03-01 13:55:32,265::task::794::TaskManager.Task::(resourceAcquired) Task=`d4530ebb-c50b-45c6-be21-b0cac0b6ace1`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-534::DEBUG::2013-03-01 13:55:32,266::task::957::TaskManager.Task::(_decref) Task=`d4530ebb-c50b-45c6-be21-b0cac0b6ace1`::ref 1 aborting False >Thread-534::INFO::2013-03-01 13:55:32,266::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-534::DEBUG::2013-03-01 13:55:32,270::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Active,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e1474a92d4c14be3f72caa960d1bb5a8c0407ab2'] >Thread-534::DEBUG::2013-03-01 13:55:32,271::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:32,272::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:32,272::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:32,272::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:32,273::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:32,273::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:32,273::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-534::DEBUG::2013-03-01 13:55:32,274::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-534::DEBUG::2013-03-01 13:55:32,274::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-534::DEBUG::2013-03-01 13:55:32,274::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-534::DEBUG::2013-03-01 13:55:32,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-534::DEBUG::2013-03-01 13:55:32,289::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-534::DEBUG::2013-03-01 13:55:32,290::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:32,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:33,298::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:33,301::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:33,304::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-536::DEBUG::2013-03-01 13:55:34,029::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-536::DEBUG::2013-03-01 13:55:34,030::task::568::TaskManager.Task::(_updateState) Task=`8324b543-494c-4fa2-9ba8-d3ec97b9ced8`::moving from state init -> state preparing >Thread-536::INFO::2013-03-01 13:55:34,030::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:34,308::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:34,311::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-534::DEBUG::2013-03-01 13:55:34,314::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-447::DEBUG::2013-03-01 13:55:35,128::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-534::DEBUG::2013-03-01 13:55:36,317::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-534::DEBUG::2013-03-01 13:55:37,391::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-534::DEBUG::2013-03-01 13:55:37,392::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,392::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,393::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,393::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,393::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,394::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,394::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-447::DEBUG::2013-03-01 13:55:37,394::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-447::DEBUG::2013-03-01 13:55:37,397::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-534::DEBUG::2013-03-01 13:55:37,397::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:37,398::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-447::DEBUG::2013-03-01 13:55:37,401::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-534::DEBUG::2013-03-01 13:55:37,410::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-447::DEBUG::2013-03-01 13:55:37,418::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-447::DEBUG::2013-03-01 13:55:37,419::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:37,421::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-534::DEBUG::2013-03-01 13:55:37,573::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-534::WARNING::2013-03-01 13:55:37,574::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-534::DEBUG::2013-03-01 13:55:37,574::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,622::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-534::DEBUG::2013-03-01 13:55:37,623::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-534::DEBUG::2013-03-01 13:55:37,627::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Active,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e1474a92d4c14be3f72caa960d1bb5a8c0407ab2'] >Thread-534::DEBUG::2013-03-01 13:55:37,629::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-534::WARNING::2013-03-01 13:55:37,629::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-534::WARNING::2013-03-01 13:55:37,629::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-536::INFO::2013-03-01 13:55:37,632::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-534::DEBUG::2013-03-01 13:55:37,633::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-534::DEBUG::2013-03-01 13:55:37,635::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-536::DEBUG::2013-03-01 13:55:37,636::task::1151::TaskManager.Task::(prepare) Task=`8324b543-494c-4fa2-9ba8-d3ec97b9ced8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-534::DEBUG::2013-03-01 13:55:37,638::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-536::DEBUG::2013-03-01 13:55:37,639::task::568::TaskManager.Task::(_updateState) Task=`8324b543-494c-4fa2-9ba8-d3ec97b9ced8`::moving from state preparing -> state finished >Thread-536::DEBUG::2013-03-01 13:55:37,642::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-534::DEBUG::2013-03-01 13:55:37,643::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-536::DEBUG::2013-03-01 13:55:37,644::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-536::DEBUG::2013-03-01 13:55:37,647::task::957::TaskManager.Task::(_decref) Task=`8324b543-494c-4fa2-9ba8-d3ec97b9ced8`::ref 0 aborting False >Thread-534::WARNING::2013-03-01 13:55:37,646::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-534::DEBUG::2013-03-01 13:55:37,654::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-534::DEBUG::2013-03-01 13:55:37,659::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-556::DEBUG::2013-03-01 13:55:37,694::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-556::DEBUG::2013-03-01 13:55:37,695::task::568::TaskManager.Task::(_updateState) Task=`6bc4e051-7da1-4772-b2ce-f656988f56f2`::moving from state init -> state preparing >Thread-556::INFO::2013-03-01 13:55:37,695::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-556::DEBUG::2013-03-01 13:55:37,696::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`01865a09-4a26-4789-a7ff-c76fa0bb8390`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-556::DEBUG::2013-03-01 13:55:37,696::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-556::DEBUG::2013-03-01 13:55:37,697::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-556::DEBUG::2013-03-01 13:55:37,697::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`01865a09-4a26-4789-a7ff-c76fa0bb8390`::Granted request >Thread-556::DEBUG::2013-03-01 13:55:37,698::task::794::TaskManager.Task::(resourceAcquired) Task=`6bc4e051-7da1-4772-b2ce-f656988f56f2`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-556::DEBUG::2013-03-01 13:55:37,698::task::957::TaskManager.Task::(_decref) Task=`6bc4e051-7da1-4772-b2ce-f656988f56f2`::ref 1 aborting False >Thread-534::DEBUG::2013-03-01 13:55:37,874::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-534::WARNING::2013-03-01 13:55:37,875::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found', ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-534::DEBUG::2013-03-01 13:55:37,876::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-534::INFO::2013-03-01 13:55:37,946::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-534::INFO::2013-03-01 13:55:37,947::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-534::INFO::2013-03-01 13:55:37,947::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-534::INFO::2013-03-01 13:55:37,948::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-534::INFO::2013-03-01 13:55:37,948::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-534::DEBUG::2013-03-01 13:55:37,948::task::1151::TaskManager.Task::(prepare) Task=`d4530ebb-c50b-45c6-be21-b0cac0b6ace1`::finished: None >Thread-534::DEBUG::2013-03-01 13:55:37,949::task::568::TaskManager.Task::(_updateState) Task=`d4530ebb-c50b-45c6-be21-b0cac0b6ace1`::moving from state preparing -> state finished >Thread-534::DEBUG::2013-03-01 13:55:37,949::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-534::DEBUG::2013-03-01 13:55:37,949::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-534::DEBUG::2013-03-01 13:55:37,950::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-534::DEBUG::2013-03-01 13:55:37,950::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-534::DEBUG::2013-03-01 13:55:37,951::task::957::TaskManager.Task::(_decref) Task=`d4530ebb-c50b-45c6-be21-b0cac0b6ace1`::ref 0 aborting False >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:38,425::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:39,430::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:39,433::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:39,436::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:39,439::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:40,443::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-533::DEBUG::2013-03-01 13:55:42,210::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-447::DEBUG::2013-03-01 13:55:42,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-447::DEBUG::2013-03-01 13:55:43,525::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-447::DEBUG::2013-03-01 13:55:43,526::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,526::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,526::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,526::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,527::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,527::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,527::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-533::DEBUG::2013-03-01 13:55:43,527::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-533::DEBUG::2013-03-01 13:55:43,530::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-447::DEBUG::2013-03-01 13:55:43,530::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:43,531::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-533::DEBUG::2013-03-01 13:55:43,534::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-447::DEBUG::2013-03-01 13:55:43,543::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-533::DEBUG::2013-03-01 13:55:43,551::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-533::DEBUG::2013-03-01 13:55:43,552::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:43,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-447::DEBUG::2013-03-01 13:55:43,710::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-447::WARNING::2013-03-01 13:55:43,711::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-447::DEBUG::2013-03-01 13:55:43,712::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:43,745::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-447::DEBUG::2013-03-01 13:55:43,746::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-447::DEBUG::2013-03-01 13:55:43,751::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-447::DEBUG::2013-03-01 13:55:43,753::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-447::WARNING::2013-03-01 13:55:43,753::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-447::WARNING::2013-03-01 13:55:43,753::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-595::DEBUG::2013-03-01 13:55:43,785::task::568::TaskManager.Task::(_updateState) Task=`98c62c28-d804-4f2d-b911-c25f1ca8302c`::moving from state init -> state preparing >Thread-595::INFO::2013-03-01 13:55:43,786::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-595::INFO::2013-03-01 13:55:43,786::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'352c3a1d-5473-41a5-9693-3da8286df38d': {'delay': '0.00269794464111', 'lastCheck': '0.0', 'code': 0, 'valid': True}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'delay': '0.00517201423645', 'lastCheck': '11.6', 'code': 0, 'valid': True}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00529408454895', 'lastCheck': '6.1', 'code': 0, 'valid': True}} >Thread-595::DEBUG::2013-03-01 13:55:43,786::task::1151::TaskManager.Task::(prepare) Task=`98c62c28-d804-4f2d-b911-c25f1ca8302c`::finished: {'352c3a1d-5473-41a5-9693-3da8286df38d': {'delay': '0.00269794464111', 'lastCheck': '0.0', 'code': 0, 'valid': True}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'delay': '0.00517201423645', 'lastCheck': '11.6', 'code': 0, 'valid': True}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00529408454895', 'lastCheck': '6.1', 'code': 0, 'valid': True}} >Thread-595::DEBUG::2013-03-01 13:55:43,787::task::568::TaskManager.Task::(_updateState) Task=`98c62c28-d804-4f2d-b911-c25f1ca8302c`::moving from state preparing -> state finished >Thread-595::DEBUG::2013-03-01 13:55:43,787::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-595::DEBUG::2013-03-01 13:55:43,787::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-595::DEBUG::2013-03-01 13:55:43,788::task::957::TaskManager.Task::(_decref) Task=`98c62c28-d804-4f2d-b911-c25f1ca8302c`::ref 0 aborting False >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:44,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:44,562::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:44,565::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:44,568::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:45,572::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-533::DEBUG::2013-03-01 13:55:46,576::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-533::DEBUG::2013-03-01 13:55:48,580::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-533::DEBUG::2013-03-01 13:55:49,657::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-533::DEBUG::2013-03-01 13:55:49,658::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,658::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,658::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,659::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,659::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,660::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,660::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-533::DEBUG::2013-03-01 13:55:49,660::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,662::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-533::DEBUG::2013-03-01 13:55:49,880::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-533::WARNING::2013-03-01 13:55:49,881::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-533::DEBUG::2013-03-01 13:55:49,882::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-533::DEBUG::2013-03-01 13:55:49,928::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-533::DEBUG::2013-03-01 13:55:49,928::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-533::DEBUG::2013-03-01 13:55:49,932::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=07af507e788ea8cb7a7d473c20ac802fe704b985'] >Thread-533::DEBUG::2013-03-01 13:55:49,937::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-533::WARNING::2013-03-01 13:55:49,938::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_imageNS already registered >Thread-533::WARNING::2013-03-01 13:55:49,939::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS already registered >Thread-556::INFO::2013-03-01 13:55:49,941::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Active,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/28973299-9d17-4683-a64e-9a5cec830fcd/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Active', 'diskfree': '942195867648', 'alerts': [], 'disktotal': '1098974756864'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Active', 'diskfree': '942024949760', 'alerts': [], 'disktotal': '1098974756864'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '941937917952', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-556::DEBUG::2013-03-01 13:55:49,944::task::1151::TaskManager.Task::(prepare) Task=`6bc4e051-7da1-4772-b2ce-f656988f56f2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Active,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/28973299-9d17-4683-a64e-9a5cec830fcd/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Active', 'diskfree': '942195867648', 'alerts': [], 'disktotal': '1098974756864'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Active', 'diskfree': '942024949760', 'alerts': [], 'disktotal': '1098974756864'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '941937917952', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-556::DEBUG::2013-03-01 13:55:49,947::task::568::TaskManager.Task::(_updateState) Task=`6bc4e051-7da1-4772-b2ce-f656988f56f2`::moving from state preparing -> state finished >Thread-556::DEBUG::2013-03-01 13:55:49,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-556::DEBUG::2013-03-01 13:55:49,951::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-556::DEBUG::2013-03-01 13:55:49,955::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-556::DEBUG::2013-03-01 13:55:49,960::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-556::DEBUG::2013-03-01 13:55:49,963::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-556::DEBUG::2013-03-01 13:55:49,965::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-556::DEBUG::2013-03-01 13:55:49,968::task::957::TaskManager.Task::(_decref) Task=`6bc4e051-7da1-4772-b2ce-f656988f56f2`::ref 0 aborting False >Thread-616::DEBUG::2013-03-01 13:55:50,033::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-616::DEBUG::2013-03-01 13:55:50,034::task::568::TaskManager.Task::(_updateState) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::moving from state init -> state preparing >Thread-616::INFO::2013-03-01 13:55:50,034::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-616::DEBUG::2013-03-01 13:55:50,035::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`2c5a0c9c-e272-4ea1-aac4-a17dfae4225d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-616::DEBUG::2013-03-01 13:55:50,035::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-616::DEBUG::2013-03-01 13:55:50,035::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-616::DEBUG::2013-03-01 13:55:50,036::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`2c5a0c9c-e272-4ea1-aac4-a17dfae4225d`::Granted request >Thread-616::DEBUG::2013-03-01 13:55:50,036::task::794::TaskManager.Task::(resourceAcquired) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-616::DEBUG::2013-03-01 13:55:50,036::task::957::TaskManager.Task::(_decref) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::ref 1 aborting False >Thread-616::DEBUG::2013-03-01 13:55:50,037::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`d42d2367-0845-456b-820d-cd6b1d370ac1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-616::DEBUG::2013-03-01 13:55:50,037::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' for lock type 'exclusive' >Thread-616::DEBUG::2013-03-01 13:55:50,037::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free. Now locking as 'exclusive' (1 active user) >Thread-616::DEBUG::2013-03-01 13:55:50,038::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`d42d2367-0845-456b-820d-cd6b1d370ac1`::Granted request >Thread-616::DEBUG::2013-03-01 13:55:50,038::task::794::TaskManager.Task::(resourceAcquired) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::_resourcesAcquired: Storage.28973299-9d17-4683-a64e-9a5cec830fcd (exclusive) >Thread-616::DEBUG::2013-03-01 13:55:50,039::task::957::TaskManager.Task::(_decref) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::ref 1 aborting False >Thread-616::INFO::2013-03-01 13:55:50,039::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=28973299-9d17-4683-a64e-9a5cec830fcd spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-616::DEBUG::2013-03-01 13:55:50,042::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-616::DEBUG::2013-03-01 13:55:50,042::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-616::DEBUG::2013-03-01 13:55:50,043::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a8c4664dfdb8adad46bc7b07c275d31f691da8e5'] >Thread-616::DEBUG::2013-03-01 13:55:50,084::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-616::DEBUG::2013-03-01 13:55:50,084::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-616::DEBUG::2013-03-01 13:55:50,084::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-533::DEBUG::2013-03-01 13:55:50,085::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-616::DEBUG::2013-03-01 13:55:50,085::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` stopped monitoring domain `28973299-9d17-4683-a64e-9a5cec830fcd` >Thread-616::DEBUG::2013-03-01 13:55:50,085::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-616::INFO::2013-03-01 13:55:50,086::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-616::DEBUG::2013-03-01 13:55:50,086::task::1151::TaskManager.Task::(prepare) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::finished: None >Thread-616::DEBUG::2013-03-01 13:55:50,086::task::568::TaskManager.Task::(_updateState) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::moving from state preparing -> state finished >Thread-616::DEBUG::2013-03-01 13:55:50,086::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd': < ResourceRef 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', isValid: 'True' obj: 'None'>} >Thread-616::DEBUG::2013-03-01 13:55:50,087::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-616::DEBUG::2013-03-01 13:55:50,087::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-616::DEBUG::2013-03-01 13:55:50,087::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-616::DEBUG::2013-03-01 13:55:50,088::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-616::DEBUG::2013-03-01 13:55:50,088::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-616::DEBUG::2013-03-01 13:55:50,088::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' >Thread-616::DEBUG::2013-03-01 13:55:50,089::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' (0 active users) >Thread-616::DEBUG::2013-03-01 13:55:50,089::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free, finding out if anyone is waiting for it. >Thread-616::DEBUG::2013-03-01 13:55:50,089::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', Clearing records. >Thread-616::DEBUG::2013-03-01 13:55:50,089::task::957::TaskManager.Task::(_decref) Task=`14904b46-387e-4974-9a7e-938131ddfb3b`::ref 0 aborting False >Thread-617::DEBUG::2013-03-01 13:55:50,146::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-618::DEBUG::2013-03-01 13:55:50,148::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-617::DEBUG::2013-03-01 13:55:50,150::task::568::TaskManager.Task::(_updateState) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::moving from state init -> state preparing >Thread-618::DEBUG::2013-03-01 13:55:50,151::task::568::TaskManager.Task::(_updateState) Task=`8edb7c76-3eac-465c-8b99-79870a5f10cc`::moving from state init -> state preparing >Thread-617::INFO::2013-03-01 13:55:50,152::logUtils::37::dispatcher::(wrapper) Run and protect: getIsoList(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', extension='iso', options=None) >Thread-618::INFO::2013-03-01 13:55:50,153::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-617::DEBUG::2013-03-01 13:55:50,155::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`b038cb76-ea59-4e48-98db-cb2c8af309cd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-618::DEBUG::2013-03-01 13:55:50,157::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`601af671-397a-4e7b-9150-bb275645c301`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-617::DEBUG::2013-03-01 13:55:50,157::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-618::DEBUG::2013-03-01 13:55:50,158::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-617::DEBUG::2013-03-01 13:55:50,160::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-617::DEBUG::2013-03-01 13:55:50,160::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`b038cb76-ea59-4e48-98db-cb2c8af309cd`::Granted request >Thread-618::DEBUG::2013-03-01 13:55:50,161::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-617::DEBUG::2013-03-01 13:55:50,163::task::794::TaskManager.Task::(resourceAcquired) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-618::DEBUG::2013-03-01 13:55:50,163::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`601af671-397a-4e7b-9150-bb275645c301`::Granted request >Thread-617::DEBUG::2013-03-01 13:55:50,164::task::957::TaskManager.Task::(_decref) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::ref 1 aborting False >Thread-618::DEBUG::2013-03-01 13:55:50,167::task::794::TaskManager.Task::(resourceAcquired) Task=`8edb7c76-3eac-465c-8b99-79870a5f10cc`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-618::DEBUG::2013-03-01 13:55:50,169::task::957::TaskManager.Task::(_decref) Task=`8edb7c76-3eac-465c-8b99-79870a5f10cc`::ref 1 aborting False >Thread-617::ERROR::2013-03-01 13:55:50,168::task::833::TaskManager.Task::(_setError) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 2182, in getIsoList > raise se.GetIsoListError(spUUID) >GetIsoListError: Cannot get ISO list: ('56be65b1-c08c-4688-bc80-a72136fefb12',) >Thread-618::INFO::2013-03-01 13:55:50,170::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-617::DEBUG::2013-03-01 13:55:50,171::task::852::TaskManager.Task::(_run) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::Task._run: 176bc957-f8fe-4ea2-ae2e-74266be2d5d1 ('56be65b1-c08c-4688-bc80-a72136fefb12', 'iso') {} failed - stopping task >Thread-617::DEBUG::2013-03-01 13:55:50,173::task::1177::TaskManager.Task::(stop) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::stopping in state preparing (force False) >Thread-617::DEBUG::2013-03-01 13:55:50,173::task::957::TaskManager.Task::(_decref) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::ref 1 aborting True >Thread-617::INFO::2013-03-01 13:55:50,174::task::1134::TaskManager.Task::(prepare) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::aborting: Task is aborted: 'Cannot get ISO list' - code 314 >Thread-617::DEBUG::2013-03-01 13:55:50,176::task::1139::TaskManager.Task::(prepare) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::Prepare: aborted: Cannot get ISO list >Thread-617::DEBUG::2013-03-01 13:55:50,176::task::957::TaskManager.Task::(_decref) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::ref 0 aborting True >Thread-617::DEBUG::2013-03-01 13:55:50,177::task::892::TaskManager.Task::(_doAbort) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::Task._doAbort: force False >Thread-617::DEBUG::2013-03-01 13:55:50,177::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-617::DEBUG::2013-03-01 13:55:50,177::task::568::TaskManager.Task::(_updateState) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::moving from state preparing -> state aborting >Thread-617::DEBUG::2013-03-01 13:55:50,178::task::523::TaskManager.Task::(__state_aborting) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::_aborting: recover policy none >Thread-617::DEBUG::2013-03-01 13:55:50,178::task::568::TaskManager.Task::(_updateState) Task=`176bc957-f8fe-4ea2-ae2e-74266be2d5d1`::moving from state aborting -> state failed >Thread-617::DEBUG::2013-03-01 13:55:50,179::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-617::DEBUG::2013-03-01 13:55:50,181::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-618::DEBUG::2013-03-01 13:55:50,181::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a8c4664dfdb8adad46bc7b07c275d31f691da8e5'] >Thread-617::DEBUG::2013-03-01 13:55:50,185::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-617::DEBUG::2013-03-01 13:55:50,187::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-618::DEBUG::2013-03-01 13:55:50,187::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:50,190::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-617::ERROR::2013-03-01 13:55:50,190::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Cannot get ISO list: ('56be65b1-c08c-4688-bc80-a72136fefb12',)", 'code': 314}} >Thread-618::DEBUG::2013-03-01 13:55:50,192::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:50,195::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:50,195::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:50,196::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:50,196::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-618::DEBUG::2013-03-01 13:55:50,197::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-618::DEBUG::2013-03-01 13:55:50,197::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-618::DEBUG::2013-03-01 13:55:50,197::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-618::DEBUG::2013-03-01 13:55:50,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-618::DEBUG::2013-03-01 13:55:50,213::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-618::DEBUG::2013-03-01 13:55:50,214::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:50,216::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-619::DEBUG::2013-03-01 13:55:50,242::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-619::DEBUG::2013-03-01 13:55:50,243::task::568::TaskManager.Task::(_updateState) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::moving from state init -> state preparing >Thread-619::INFO::2013-03-01 13:55:50,243::logUtils::37::dispatcher::(wrapper) Run and protect: getFloppyList(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-619::INFO::2013-03-01 13:55:50,244::logUtils::37::dispatcher::(wrapper) Run and protect: getIsoList(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', extension='vfd', options=None) >Thread-619::DEBUG::2013-03-01 13:55:50,244::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`9d94362e-ba14-48ad-afa7-20c5e7e344be`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-619::DEBUG::2013-03-01 13:55:50,244::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-619::DEBUG::2013-03-01 13:55:50,245::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-619::DEBUG::2013-03-01 13:55:50,245::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`9d94362e-ba14-48ad-afa7-20c5e7e344be`::Granted request >Thread-619::DEBUG::2013-03-01 13:55:50,246::task::794::TaskManager.Task::(resourceAcquired) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-619::DEBUG::2013-03-01 13:55:50,246::task::957::TaskManager.Task::(_decref) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::ref 1 aborting False >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:51,221::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:51,224::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:52,228::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:52,231::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:52,234::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-618::DEBUG::2013-03-01 13:55:52,237::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-447::DEBUG::2013-03-01 13:55:53,763::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-618::DEBUG::2013-03-01 13:55:54,240::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-618::DEBUG::2013-03-01 13:55:55,316::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-618::DEBUG::2013-03-01 13:55:55,316::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,317::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,317::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,317::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,318::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,318::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,319::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-447::DEBUG::2013-03-01 13:55:55,319::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-447::DEBUG::2013-03-01 13:55:55,321::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-618::DEBUG::2013-03-01 13:55:55,322::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:55:55,323::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-447::DEBUG::2013-03-01 13:55:55,326::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-618::DEBUG::2013-03-01 13:55:55,335::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-447::DEBUG::2013-03-01 13:55:55,343::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-447::DEBUG::2013-03-01 13:55:55,344::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:55,345::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-618::DEBUG::2013-03-01 13:55:55,553::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-618::WARNING::2013-03-01 13:55:55,554::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-618::DEBUG::2013-03-01 13:55:55,555::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,602::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-618::DEBUG::2013-03-01 13:55:55,603::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-618::DEBUG::2013-03-01 13:55:55,607::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a8c4664dfdb8adad46bc7b07c275d31f691da8e5'] >Thread-618::DEBUG::2013-03-01 13:55:55,609::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-618::WARNING::2013-03-01 13:55:55,609::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-618::WARNING::2013-03-01 13:55:55,609::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-618::DEBUG::2013-03-01 13:55:55,611::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-618::DEBUG::2013-03-01 13:55:55,611::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-618::DEBUG::2013-03-01 13:55:55,611::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-618::DEBUG::2013-03-01 13:55:55,611::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-618::WARNING::2013-03-01 13:55:55,612::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-618::DEBUG::2013-03-01 13:55:55,612::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-618::DEBUG::2013-03-01 13:55:55,613::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-618::DEBUG::2013-03-01 13:55:55,834::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-618::WARNING::2013-03-01 13:55:55,835::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-618::DEBUG::2013-03-01 13:55:55,836::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-618::INFO::2013-03-01 13:55:55,898::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-618::INFO::2013-03-01 13:55:55,899::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-618::INFO::2013-03-01 13:55:55,899::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-618::INFO::2013-03-01 13:55:55,900::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-618::DEBUG::2013-03-01 13:55:55,900::task::1151::TaskManager.Task::(prepare) Task=`8edb7c76-3eac-465c-8b99-79870a5f10cc`::finished: None >Thread-618::DEBUG::2013-03-01 13:55:55,901::task::568::TaskManager.Task::(_updateState) Task=`8edb7c76-3eac-465c-8b99-79870a5f10cc`::moving from state preparing -> state finished >Thread-618::DEBUG::2013-03-01 13:55:55,901::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-618::DEBUG::2013-03-01 13:55:55,901::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-618::DEBUG::2013-03-01 13:55:55,902::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-618::DEBUG::2013-03-01 13:55:55,902::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-618::DEBUG::2013-03-01 13:55:55,902::task::957::TaskManager.Task::(_decref) Task=`8edb7c76-3eac-465c-8b99-79870a5f10cc`::ref 0 aborting False >Thread-666::DEBUG::2013-03-01 13:55:55,942::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-666::DEBUG::2013-03-01 13:55:55,942::task::568::TaskManager.Task::(_updateState) Task=`aeba9974-9a25-403a-b6fb-3de4a761219c`::moving from state init -> state preparing >Thread-666::INFO::2013-03-01 13:55:55,943::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-666::DEBUG::2013-03-01 13:55:55,943::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-666::DEBUG::2013-03-01 13:55:55,991::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:56,349::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:56,353::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:57,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:57,360::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:57,363::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-447::DEBUG::2013-03-01 13:55:57,366::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-668::DEBUG::2013-03-01 13:55:59,051::task::568::TaskManager.Task::(_updateState) Task=`8c40f0f3-d7ca-4bc6-baa2-ee02ce3f8465`::moving from state init -> state preparing >Thread-668::INFO::2013-03-01 13:55:59,051::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-668::INFO::2013-03-01 13:55:59,051::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'352c3a1d-5473-41a5-9693-3da8286df38d': {'delay': '0.00269794464111', 'lastCheck': '15.3', 'code': 0, 'valid': True}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00379395484924', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-668::DEBUG::2013-03-01 13:55:59,052::task::1151::TaskManager.Task::(prepare) Task=`8c40f0f3-d7ca-4bc6-baa2-ee02ce3f8465`::finished: {'352c3a1d-5473-41a5-9693-3da8286df38d': {'delay': '0.00269794464111', 'lastCheck': '15.3', 'code': 0, 'valid': True}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00379395484924', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-668::DEBUG::2013-03-01 13:55:59,052::task::568::TaskManager.Task::(_updateState) Task=`8c40f0f3-d7ca-4bc6-baa2-ee02ce3f8465`::moving from state preparing -> state finished >Thread-668::DEBUG::2013-03-01 13:55:59,052::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-668::DEBUG::2013-03-01 13:55:59,052::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-668::DEBUG::2013-03-01 13:55:59,053::task::957::TaskManager.Task::(_decref) Task=`8c40f0f3-d7ca-4bc6-baa2-ee02ce3f8465`::ref 0 aborting False >Thread-447::DEBUG::2013-03-01 13:55:59,369::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-447::DEBUG::2013-03-01 13:56:00,493::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-447::DEBUG::2013-03-01 13:56:00,494::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,494::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,495::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,495::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,496::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,496::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,496::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-666::DEBUG::2013-03-01 13:56:00,496::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-666::DEBUG::2013-03-01 13:56:00,498::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-447::DEBUG::2013-03-01 13:56:00,499::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:00,500::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-666::DEBUG::2013-03-01 13:56:00,502::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-447::DEBUG::2013-03-01 13:56:00,511::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-666::DEBUG::2013-03-01 13:56:00,519::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-666::DEBUG::2013-03-01 13:56:00,520::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:00,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-447::DEBUG::2013-03-01 13:56:00,732::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-447::WARNING::2013-03-01 13:56:00,733::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-447::DEBUG::2013-03-01 13:56:00,734::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-447::DEBUG::2013-03-01 13:56:00,766::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-447::DEBUG::2013-03-01 13:56:00,767::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-447::DEBUG::2013-03-01 13:56:00,770::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-447::DEBUG::2013-03-01 13:56:00,772::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-447::WARNING::2013-03-01 13:56:00,773::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-447::WARNING::2013-03-01 13:56:00,773::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-619::ERROR::2013-03-01 13:56:00,775::task::833::TaskManager.Task::(_setError) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 2205, in getFloppyList > return self.getIsoList(spUUID=spUUID, extension='vfd') > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 2182, in getIsoList > raise se.GetIsoListError(spUUID) >GetIsoListError: Cannot get ISO list: ('56be65b1-c08c-4688-bc80-a72136fefb12',) >Thread-619::DEBUG::2013-03-01 13:56:00,780::task::852::TaskManager.Task::(_run) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::Task._run: eaf0f1ef-de07-414e-a84c-8e3954031fa3 ('56be65b1-c08c-4688-bc80-a72136fefb12',) {} failed - stopping task >Thread-619::DEBUG::2013-03-01 13:56:00,782::task::1177::TaskManager.Task::(stop) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::stopping in state preparing (force False) >Thread-619::DEBUG::2013-03-01 13:56:00,786::task::957::TaskManager.Task::(_decref) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::ref 1 aborting True >Thread-619::INFO::2013-03-01 13:56:00,790::task::1134::TaskManager.Task::(prepare) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::aborting: Task is aborted: 'Cannot get ISO list' - code 314 >Thread-619::DEBUG::2013-03-01 13:56:00,792::task::1139::TaskManager.Task::(prepare) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::Prepare: aborted: Cannot get ISO list >Thread-619::DEBUG::2013-03-01 13:56:00,793::task::957::TaskManager.Task::(_decref) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::ref 0 aborting True >Thread-619::DEBUG::2013-03-01 13:56:00,796::task::892::TaskManager.Task::(_doAbort) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::Task._doAbort: force False >Thread-619::DEBUG::2013-03-01 13:56:00,796::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-619::DEBUG::2013-03-01 13:56:00,797::task::568::TaskManager.Task::(_updateState) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::moving from state preparing -> state aborting >Thread-619::DEBUG::2013-03-01 13:56:00,797::task::523::TaskManager.Task::(__state_aborting) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::_aborting: recover policy none >Thread-619::DEBUG::2013-03-01 13:56:00,797::task::568::TaskManager.Task::(_updateState) Task=`eaf0f1ef-de07-414e-a84c-8e3954031fa3`::moving from state aborting -> state failed >Thread-619::DEBUG::2013-03-01 13:56:00,798::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-619::DEBUG::2013-03-01 13:56:00,798::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-619::DEBUG::2013-03-01 13:56:00,798::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-619::DEBUG::2013-03-01 13:56:00,799::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-619::DEBUG::2013-03-01 13:56:00,799::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-619::DEBUG::2013-03-01 13:56:00,799::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-619::ERROR::2013-03-01 13:56:00,800::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Cannot get ISO list: ('56be65b1-c08c-4688-bc80-a72136fefb12',)", 'code': 314}} >Thread-681::DEBUG::2013-03-01 13:56:00,834::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-681::DEBUG::2013-03-01 13:56:00,834::task::568::TaskManager.Task::(_updateState) Task=`aa9df498-833a-4125-8755-069cd033b40c`::moving from state init -> state preparing >Thread-681::INFO::2013-03-01 13:56:00,835::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-681::INFO::2013-03-01 13:56:00,835::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-681::DEBUG::2013-03-01 13:56:00,835::task::1151::TaskManager.Task::(prepare) Task=`aa9df498-833a-4125-8755-069cd033b40c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-681::DEBUG::2013-03-01 13:56:00,835::task::568::TaskManager.Task::(_updateState) Task=`aa9df498-833a-4125-8755-069cd033b40c`::moving from state preparing -> state finished >Thread-681::DEBUG::2013-03-01 13:56:00,836::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-681::DEBUG::2013-03-01 13:56:00,836::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-681::DEBUG::2013-03-01 13:56:00,836::task::957::TaskManager.Task::(_decref) Task=`aa9df498-833a-4125-8755-069cd033b40c`::ref 0 aborting False >Thread-682::DEBUG::2013-03-01 13:56:00,868::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-682::DEBUG::2013-03-01 13:56:00,869::task::568::TaskManager.Task::(_updateState) Task=`972f7b78-bb35-477e-b0e4-b0854bbbe2d3`::moving from state init -> state preparing >Thread-682::INFO::2013-03-01 13:56:00,869::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-682::DEBUG::2013-03-01 13:56:00,869::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`b31330da-33d6-4b8d-871b-9a34a3c920d9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-682::DEBUG::2013-03-01 13:56:00,870::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-682::DEBUG::2013-03-01 13:56:00,870::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-682::DEBUG::2013-03-01 13:56:00,870::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`b31330da-33d6-4b8d-871b-9a34a3c920d9`::Granted request >Thread-682::DEBUG::2013-03-01 13:56:00,871::task::794::TaskManager.Task::(resourceAcquired) Task=`972f7b78-bb35-477e-b0e4-b0854bbbe2d3`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-682::DEBUG::2013-03-01 13:56:00,871::task::957::TaskManager.Task::(_decref) Task=`972f7b78-bb35-477e-b0e4-b0854bbbe2d3`::ref 1 aborting False >Thread-682::INFO::2013-03-01 13:56:00,875::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Active', 'diskfree': '943741468672', 'alerts': [], 'disktotal': '1098974756864'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '942666678272', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-682::DEBUG::2013-03-01 13:56:00,875::task::1151::TaskManager.Task::(prepare) Task=`972f7b78-bb35-477e-b0e4-b0854bbbe2d3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Active,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Active', 'diskfree': '943741468672', 'alerts': [], 'disktotal': '1098974756864'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '942666678272', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-682::DEBUG::2013-03-01 13:56:00,876::task::568::TaskManager.Task::(_updateState) Task=`972f7b78-bb35-477e-b0e4-b0854bbbe2d3`::moving from state preparing -> state finished >Thread-682::DEBUG::2013-03-01 13:56:00,876::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-682::DEBUG::2013-03-01 13:56:00,876::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-682::DEBUG::2013-03-01 13:56:00,877::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-682::DEBUG::2013-03-01 13:56:00,877::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-682::DEBUG::2013-03-01 13:56:00,877::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-682::DEBUG::2013-03-01 13:56:00,877::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-682::DEBUG::2013-03-01 13:56:00,878::task::957::TaskManager.Task::(_decref) Task=`972f7b78-bb35-477e-b0e4-b0854bbbe2d3`::ref 0 aborting False >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:01,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:01,530::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:01,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:01,536::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:02,540::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-666::DEBUG::2013-03-01 13:56:03,545::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-666::DEBUG::2013-03-01 13:56:05,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-666::DEBUG::2013-03-01 13:56:06,681::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-666::DEBUG::2013-03-01 13:56:06,682::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:06,682::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:06,683::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:06,683::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:06,683::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:06,684::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-666::DEBUG::2013-03-01 13:56:06,684::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-666::INFO::2013-03-01 13:56:06,684::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-666::DEBUG::2013-03-01 13:56:06,685::task::1151::TaskManager.Task::(prepare) Task=`aeba9974-9a25-403a-b6fb-3de4a761219c`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-666::DEBUG::2013-03-01 13:56:06,685::task::568::TaskManager.Task::(_updateState) Task=`aeba9974-9a25-403a-b6fb-3de4a761219c`::moving from state preparing -> state finished >Thread-666::DEBUG::2013-03-01 13:56:06,685::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-666::DEBUG::2013-03-01 13:56:06,686::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-666::DEBUG::2013-03-01 13:56:06,686::task::957::TaskManager.Task::(_decref) Task=`aeba9974-9a25-403a-b6fb-3de4a761219c`::ref 0 aborting False >Thread-685::DEBUG::2013-03-01 13:56:07,708::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-685::DEBUG::2013-03-01 13:56:07,711::task::568::TaskManager.Task::(_updateState) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::moving from state init -> state preparing >Thread-685::INFO::2013-03-01 13:56:07,712::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-685::DEBUG::2013-03-01 13:56:07,713::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`07870271-fe59-44fc-8be0-01a070bb8fc2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-685::DEBUG::2013-03-01 13:56:07,713::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-685::DEBUG::2013-03-01 13:56:07,714::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-685::DEBUG::2013-03-01 13:56:07,714::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`07870271-fe59-44fc-8be0-01a070bb8fc2`::Granted request >Thread-685::DEBUG::2013-03-01 13:56:07,719::task::794::TaskManager.Task::(resourceAcquired) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-685::DEBUG::2013-03-01 13:56:07,719::task::957::TaskManager.Task::(_decref) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::ref 1 aborting False >Thread-685::DEBUG::2013-03-01 13:56:07,722::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`a9a6ba5a-4573-4d8a-87be-5f3f6f0b508a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-685::DEBUG::2013-03-01 13:56:07,723::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' for lock type 'exclusive' >Thread-685::DEBUG::2013-03-01 13:56:07,726::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free. Now locking as 'exclusive' (1 active user) >Thread-685::DEBUG::2013-03-01 13:56:07,727::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`a9a6ba5a-4573-4d8a-87be-5f3f6f0b508a`::Granted request >Thread-685::DEBUG::2013-03-01 13:56:07,731::task::794::TaskManager.Task::(resourceAcquired) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::_resourcesAcquired: Storage.352c3a1d-5473-41a5-9693-3da8286df38d (exclusive) >Thread-685::DEBUG::2013-03-01 13:56:07,732::task::957::TaskManager.Task::(_decref) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::ref 1 aborting False >Thread-685::INFO::2013-03-01 13:56:07,733::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=352c3a1d-5473-41a5-9693-3da8286df38d spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-685::DEBUG::2013-03-01 13:56:07,737::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-685::DEBUG::2013-03-01 13:56:07,738::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-685::DEBUG::2013-03-01 13:56:07,738::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d87fa6579f7c785ab481723840aaea7a1eddb3'] >Thread-685::DEBUG::2013-03-01 13:56:07,798::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-685::DEBUG::2013-03-01 13:56:07,798::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-685::DEBUG::2013-03-01 13:56:07,798::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-447::DEBUG::2013-03-01 13:56:07,799::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-447::INFO::2013-03-01 13:56:07,799::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 352c3a1d-5473-41a5-9693-3da8286df38d (id: 1) >Thread-447::DEBUG::2013-03-01 13:56:09,800::clusterlock::206::SANLock::(releaseHostId) Host id for domain 352c3a1d-5473-41a5-9693-3da8286df38d released successfully (id: 1) >Thread-685::DEBUG::2013-03-01 13:56:09,800::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` stopped monitoring domain `352c3a1d-5473-41a5-9693-3da8286df38d` >Thread-685::DEBUG::2013-03-01 13:56:09,842::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-685::INFO::2013-03-01 13:56:09,842::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-685::DEBUG::2013-03-01 13:56:09,843::task::1151::TaskManager.Task::(prepare) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::finished: None >Thread-685::DEBUG::2013-03-01 13:56:09,843::task::568::TaskManager.Task::(_updateState) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::moving from state preparing -> state finished >Thread-685::DEBUG::2013-03-01 13:56:09,843::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d': < ResourceRef 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', isValid: 'True' obj: 'None'>} >Thread-685::DEBUG::2013-03-01 13:56:09,843::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-685::DEBUG::2013-03-01 13:56:09,844::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-685::DEBUG::2013-03-01 13:56:09,844::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-685::DEBUG::2013-03-01 13:56:09,844::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-685::DEBUG::2013-03-01 13:56:09,844::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-685::DEBUG::2013-03-01 13:56:09,845::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' >Thread-685::DEBUG::2013-03-01 13:56:09,845::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' (0 active users) >Thread-685::DEBUG::2013-03-01 13:56:09,845::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free, finding out if anyone is waiting for it. >Thread-685::DEBUG::2013-03-01 13:56:09,845::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', Clearing records. >Thread-685::DEBUG::2013-03-01 13:56:09,846::task::957::TaskManager.Task::(_decref) Task=`2869b30c-0322-44e0-9b5f-097ceb1a90c2`::ref 0 aborting False >Thread-687::DEBUG::2013-03-01 13:56:09,889::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-687::DEBUG::2013-03-01 13:56:09,890::task::568::TaskManager.Task::(_updateState) Task=`59927838-fb4a-4403-8603-dfd42e704388`::moving from state init -> state preparing >Thread-687::INFO::2013-03-01 13:56:09,890::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-687::DEBUG::2013-03-01 13:56:09,890::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`455e7acd-9728-4653-8020-f3730e0fd90e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-687::DEBUG::2013-03-01 13:56:09,891::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-687::DEBUG::2013-03-01 13:56:09,891::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-687::DEBUG::2013-03-01 13:56:09,891::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`455e7acd-9728-4653-8020-f3730e0fd90e`::Granted request >Thread-687::DEBUG::2013-03-01 13:56:09,892::task::794::TaskManager.Task::(resourceAcquired) Task=`59927838-fb4a-4403-8603-dfd42e704388`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-687::DEBUG::2013-03-01 13:56:09,892::task::957::TaskManager.Task::(_decref) Task=`59927838-fb4a-4403-8603-dfd42e704388`::ref 1 aborting False >Thread-687::INFO::2013-03-01 13:56:09,892::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-687::DEBUG::2013-03-01 13:56:09,897::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d87fa6579f7c785ab481723840aaea7a1eddb3'] >Thread-687::DEBUG::2013-03-01 13:56:09,897::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:09,898::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:09,898::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:09,898::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:09,899::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:09,899::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:09,899::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-687::DEBUG::2013-03-01 13:56:09,899::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-687::DEBUG::2013-03-01 13:56:09,900::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-687::DEBUG::2013-03-01 13:56:09,900::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-687::DEBUG::2013-03-01 13:56:09,900::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-687::DEBUG::2013-03-01 13:56:09,916::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-687::DEBUG::2013-03-01 13:56:09,917::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:09,919::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:10,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-688::DEBUG::2013-03-01 13:56:10,976::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-688::DEBUG::2013-03-01 13:56:10,977::task::568::TaskManager.Task::(_updateState) Task=`44b8699f-226e-45f3-a9e1-d6f9fb6db569`::moving from state init -> state preparing >Thread-688::INFO::2013-03-01 13:56:10,978::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:11,928::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:11,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:11,934::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:12,938::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-687::DEBUG::2013-03-01 13:56:13,942::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-687::DEBUG::2013-03-01 13:56:15,946::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-687::DEBUG::2013-03-01 13:56:17,041::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:56:17,042::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,049::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,049::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,049::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,050::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,050::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,050::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-687::DEBUG::2013-03-01 13:56:17,051::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,052::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-687::DEBUG::2013-03-01 13:56:17,309::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-687::WARNING::2013-03-01 13:56:17,310::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-687::DEBUG::2013-03-01 13:56:17,311::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,357::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-687::DEBUG::2013-03-01 13:56:17,358::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-687::DEBUG::2013-03-01 13:56:17,361::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d87fa6579f7c785ab481723840aaea7a1eddb3'] >Thread-687::DEBUG::2013-03-01 13:56:17,363::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-687::WARNING::2013-03-01 13:56:17,364::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-687::WARNING::2013-03-01 13:56:17,364::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-688::INFO::2013-03-01 13:56:17,365::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-687::DEBUG::2013-03-01 13:56:17,366::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-688::DEBUG::2013-03-01 13:56:17,366::task::1151::TaskManager.Task::(prepare) Task=`44b8699f-226e-45f3-a9e1-d6f9fb6db569`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-687::DEBUG::2013-03-01 13:56:17,367::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-688::DEBUG::2013-03-01 13:56:17,368::task::568::TaskManager.Task::(_updateState) Task=`44b8699f-226e-45f3-a9e1-d6f9fb6db569`::moving from state preparing -> state finished >Thread-687::DEBUG::2013-03-01 13:56:17,368::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-688::DEBUG::2013-03-01 13:56:17,369::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-688::DEBUG::2013-03-01 13:56:17,370::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-687::DEBUG::2013-03-01 13:56:17,370::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-688::DEBUG::2013-03-01 13:56:17,372::task::957::TaskManager.Task::(_decref) Task=`44b8699f-226e-45f3-a9e1-d6f9fb6db569`::ref 0 aborting False >Thread-687::WARNING::2013-03-01 13:56:17,372::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-687::DEBUG::2013-03-01 13:56:17,375::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-687::DEBUG::2013-03-01 13:56:17,378::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-707::DEBUG::2013-03-01 13:56:17,409::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-707::DEBUG::2013-03-01 13:56:17,410::task::568::TaskManager.Task::(_updateState) Task=`b2f81f2c-40f0-455c-b51b-5d25b5769dfd`::moving from state init -> state preparing >Thread-707::INFO::2013-03-01 13:56:17,410::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-707::DEBUG::2013-03-01 13:56:17,411::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`90288dab-77a5-4353-83ff-11a967e01c24`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-707::DEBUG::2013-03-01 13:56:17,411::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-707::DEBUG::2013-03-01 13:56:17,411::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-707::DEBUG::2013-03-01 13:56:17,412::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`90288dab-77a5-4353-83ff-11a967e01c24`::Granted request >Thread-707::DEBUG::2013-03-01 13:56:17,412::task::794::TaskManager.Task::(resourceAcquired) Task=`b2f81f2c-40f0-455c-b51b-5d25b5769dfd`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-707::DEBUG::2013-03-01 13:56:17,413::task::957::TaskManager.Task::(_decref) Task=`b2f81f2c-40f0-455c-b51b-5d25b5769dfd`::ref 1 aborting False >Thread-707::INFO::2013-03-01 13:56:17,417::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '943741468672', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-707::DEBUG::2013-03-01 13:56:17,417::task::1151::TaskManager.Task::(prepare) Task=`b2f81f2c-40f0-455c-b51b-5d25b5769dfd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,28973299-9d17-4683-a64e-9a5cec830fcd:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, '28973299-9d17-4683-a64e-9a5cec830fcd': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '943741468672', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-707::DEBUG::2013-03-01 13:56:17,417::task::568::TaskManager.Task::(_updateState) Task=`b2f81f2c-40f0-455c-b51b-5d25b5769dfd`::moving from state preparing -> state finished >Thread-707::DEBUG::2013-03-01 13:56:17,417::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-707::DEBUG::2013-03-01 13:56:17,418::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-707::DEBUG::2013-03-01 13:56:17,418::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-707::DEBUG::2013-03-01 13:56:17,419::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-707::DEBUG::2013-03-01 13:56:17,419::task::957::TaskManager.Task::(_decref) Task=`b2f81f2c-40f0-455c-b51b-5d25b5769dfd`::ref 0 aborting False >Thread-687::DEBUG::2013-03-01 13:56:17,588::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-687::DEBUG::2013-03-01 13:56:17,589::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-687::INFO::2013-03-01 13:56:17,649::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-687::INFO::2013-03-01 13:56:17,649::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-687::INFO::2013-03-01 13:56:17,650::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-687::DEBUG::2013-03-01 13:56:17,650::task::1151::TaskManager.Task::(prepare) Task=`59927838-fb4a-4403-8603-dfd42e704388`::finished: None >Thread-687::DEBUG::2013-03-01 13:56:17,650::task::568::TaskManager.Task::(_updateState) Task=`59927838-fb4a-4403-8603-dfd42e704388`::moving from state preparing -> state finished >Thread-687::DEBUG::2013-03-01 13:56:17,651::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-687::DEBUG::2013-03-01 13:56:17,651::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-687::DEBUG::2013-03-01 13:56:17,651::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-687::DEBUG::2013-03-01 13:56:17,652::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-687::DEBUG::2013-03-01 13:56:17,652::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-687::DEBUG::2013-03-01 13:56:17,652::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-687::DEBUG::2013-03-01 13:56:17,653::task::957::TaskManager.Task::(_decref) Task=`59927838-fb4a-4403-8603-dfd42e704388`::ref 0 aborting False >Thread-733::DEBUG::2013-03-01 13:56:17,689::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-733::DEBUG::2013-03-01 13:56:17,689::task::568::TaskManager.Task::(_updateState) Task=`007db0ea-468e-480e-9455-38b4885699b2`::moving from state init -> state preparing >Thread-733::INFO::2013-03-01 13:56:17,690::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-733::DEBUG::2013-03-01 13:56:17,690::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-733::DEBUG::2013-03-01 13:56:17,742::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-733::DEBUG::2013-03-01 13:56:17,743::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-733::DEBUG::2013-03-01 13:56:17,743::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-733::DEBUG::2013-03-01 13:56:17,743::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-733::DEBUG::2013-03-01 13:56:17,744::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-733::DEBUG::2013-03-01 13:56:17,760::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-733::DEBUG::2013-03-01 13:56:17,760::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:17,764::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:18,769::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:19,774::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-734::DEBUG::2013-03-01 13:56:20,446::task::568::TaskManager.Task::(_updateState) Task=`080f6e39-994c-45aa-b114-fab68e20899a`::moving from state init -> state preparing >Thread-734::INFO::2013-03-01 13:56:20,447::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-734::INFO::2013-03-01 13:56:20,447::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0114831924438', 'lastCheck': '2.7', 'code': 0, 'valid': True}} >Thread-734::DEBUG::2013-03-01 13:56:20,447::task::1151::TaskManager.Task::(prepare) Task=`080f6e39-994c-45aa-b114-fab68e20899a`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0114831924438', 'lastCheck': '2.7', 'code': 0, 'valid': True}} >Thread-734::DEBUG::2013-03-01 13:56:20,447::task::568::TaskManager.Task::(_updateState) Task=`080f6e39-994c-45aa-b114-fab68e20899a`::moving from state preparing -> state finished >Thread-734::DEBUG::2013-03-01 13:56:20,448::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-734::DEBUG::2013-03-01 13:56:20,448::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-734::DEBUG::2013-03-01 13:56:20,448::task::957::TaskManager.Task::(_decref) Task=`080f6e39-994c-45aa-b114-fab68e20899a`::ref 0 aborting False >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:20,778::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:20,781::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:20,784::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-733::DEBUG::2013-03-01 13:56:20,787::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-733::DEBUG::2013-03-01 13:56:22,791::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-733::DEBUG::2013-03-01 13:56:23,875::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-733::DEBUG::2013-03-01 13:56:23,876::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-733::DEBUG::2013-03-01 13:56:23,876::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-733::DEBUG::2013-03-01 13:56:23,876::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-733::DEBUG::2013-03-01 13:56:23,876::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-733::DEBUG::2013-03-01 13:56:23,877::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-733::DEBUG::2013-03-01 13:56:23,877::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-733::DEBUG::2013-03-01 13:56:23,877::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-733::INFO::2013-03-01 13:56:23,877::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-733::DEBUG::2013-03-01 13:56:23,877::task::1151::TaskManager.Task::(prepare) Task=`007db0ea-468e-480e-9455-38b4885699b2`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-733::DEBUG::2013-03-01 13:56:23,878::task::568::TaskManager.Task::(_updateState) Task=`007db0ea-468e-480e-9455-38b4885699b2`::moving from state preparing -> state finished >Thread-733::DEBUG::2013-03-01 13:56:23,878::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-733::DEBUG::2013-03-01 13:56:23,878::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-733::DEBUG::2013-03-01 13:56:23,878::task::957::TaskManager.Task::(_decref) Task=`007db0ea-468e-480e-9455-38b4885699b2`::ref 0 aborting False >Thread-737::DEBUG::2013-03-01 13:56:25,298::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-737::DEBUG::2013-03-01 13:56:25,299::task::568::TaskManager.Task::(_updateState) Task=`dbbc7c49-3bed-44d1-ac7b-d6538d02e3ad`::moving from state init -> state preparing >Thread-737::INFO::2013-03-01 13:56:25,299::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-737::INFO::2013-03-01 13:56:25,300::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-737::DEBUG::2013-03-01 13:56:25,300::task::1151::TaskManager.Task::(prepare) Task=`dbbc7c49-3bed-44d1-ac7b-d6538d02e3ad`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-737::DEBUG::2013-03-01 13:56:25,300::task::568::TaskManager.Task::(_updateState) Task=`dbbc7c49-3bed-44d1-ac7b-d6538d02e3ad`::moving from state preparing -> state finished >Thread-737::DEBUG::2013-03-01 13:56:25,300::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-737::DEBUG::2013-03-01 13:56:25,300::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-737::DEBUG::2013-03-01 13:56:25,301::task::957::TaskManager.Task::(_decref) Task=`dbbc7c49-3bed-44d1-ac7b-d6538d02e3ad`::ref 0 aborting False >Thread-738::DEBUG::2013-03-01 13:56:25,332::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-738::DEBUG::2013-03-01 13:56:25,332::task::568::TaskManager.Task::(_updateState) Task=`21224a98-e144-4416-b73e-473220286b40`::moving from state init -> state preparing >Thread-738::INFO::2013-03-01 13:56:25,332::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-738::DEBUG::2013-03-01 13:56:25,336::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-738::INFO::2013-03-01 13:56:25,385::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-738::DEBUG::2013-03-01 13:56:25,386::task::1151::TaskManager.Task::(prepare) Task=`21224a98-e144-4416-b73e-473220286b40`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-738::DEBUG::2013-03-01 13:56:25,386::task::568::TaskManager.Task::(_updateState) Task=`21224a98-e144-4416-b73e-473220286b40`::moving from state preparing -> state finished >Thread-738::DEBUG::2013-03-01 13:56:25,386::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-738::DEBUG::2013-03-01 13:56:25,386::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-738::DEBUG::2013-03-01 13:56:25,387::task::957::TaskManager.Task::(_decref) Task=`21224a98-e144-4416-b73e-473220286b40`::ref 0 aborting False >Thread-739::DEBUG::2013-03-01 13:56:25,420::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-739::DEBUG::2013-03-01 13:56:25,421::task::568::TaskManager.Task::(_updateState) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::moving from state init -> state preparing >Thread-739::INFO::2013-03-01 13:56:25,421::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-739::DEBUG::2013-03-01 13:56:25,422::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`b9fca2b0-c1af-470d-97a6-1f2987190441`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-739::DEBUG::2013-03-01 13:56:25,422::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-739::DEBUG::2013-03-01 13:56:25,423::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-739::DEBUG::2013-03-01 13:56:25,423::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`b9fca2b0-c1af-470d-97a6-1f2987190441`::Granted request >Thread-739::DEBUG::2013-03-01 13:56:25,424::task::794::TaskManager.Task::(resourceAcquired) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-739::DEBUG::2013-03-01 13:56:25,424::task::957::TaskManager.Task::(_decref) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::ref 1 aborting False >Thread-739::DEBUG::2013-03-01 13:56:25,424::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`eee7bd2b-26df-44a9-ac49-aceb8d97a2f4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-739::DEBUG::2013-03-01 13:56:25,425::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' for lock type 'exclusive' >Thread-739::DEBUG::2013-03-01 13:56:25,425::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free. Now locking as 'exclusive' (1 active user) >Thread-739::DEBUG::2013-03-01 13:56:25,425::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`eee7bd2b-26df-44a9-ac49-aceb8d97a2f4`::Granted request >Thread-739::DEBUG::2013-03-01 13:56:25,426::task::794::TaskManager.Task::(resourceAcquired) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::_resourcesAcquired: Storage.28973299-9d17-4683-a64e-9a5cec830fcd (exclusive) >Thread-739::DEBUG::2013-03-01 13:56:25,426::task::957::TaskManager.Task::(_decref) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::ref 1 aborting False >Thread-739::INFO::2013-03-01 13:56:25,426::sp::984::Storage.StoragePool::(detachSD) sdUUID=28973299-9d17-4683-a64e-9a5cec830fcd spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-739::DEBUG::2013-03-01 13:56:25,427::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-739::DEBUG::2013-03-01 13:56:25,427::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-739::DEBUG::2013-03-01 13:56:25,427::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-739::DEBUG::2013-03-01 13:56:25,427::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-739::DEBUG::2013-03-01 13:56:25,428::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-739::DEBUG::2013-03-01 13:56:25,443::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-739::DEBUG::2013-03-01 13:56:25,443::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:25,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:26,450::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:27,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:28,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:29,463::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:30,468::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-739::DEBUG::2013-03-01 13:56:31,472::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-739::DEBUG::2013-03-01 13:56:33,476::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-739::DEBUG::2013-03-01 13:56:34,549::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-739::DEBUG::2013-03-01 13:56:34,549::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,550::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,550::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,550::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,551::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,551::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,551::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-739::DEBUG::2013-03-01 13:56:34,552::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-739::DEBUG::2013-03-01 13:56:34,775::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-739::WARNING::2013-03-01 13:56:34,776::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-739::DEBUG::2013-03-01 13:56:34,777::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-739::DEBUG::2013-03-01 13:56:34,818::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-739::DEBUG::2013-03-01 13:56:34,818::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-739::DEBUG::2013-03-01 13:56:34,823::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=07af507e788ea8cb7a7d473c20ac802fe704b985'] >Thread-739::DEBUG::2013-03-01 13:56:34,825::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-739::WARNING::2013-03-01 13:56:34,826::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_imageNS already registered >Thread-739::WARNING::2013-03-01 13:56:34,826::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS already registered >Thread-739::DEBUG::2013-03-01 13:56:34,826::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 28973299-9d17-4683-a64e-9a5cec830fcd successfully acquired (id: 1) >Thread-739::DEBUG::2013-03-01 13:56:34,827::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-739::DEBUG::2013-03-01 13:56:34,828::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 28973299-9d17-4683-a64e-9a5cec830fcd 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-759::DEBUG::2013-03-01 13:56:35,728::task::568::TaskManager.Task::(_updateState) Task=`50eca407-b0a9-434b-bcc8-2628c374bd4a`::moving from state init -> state preparing >Thread-759::INFO::2013-03-01 13:56:35,728::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-759::INFO::2013-03-01 13:56:35,729::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00340890884399', 'lastCheck': '8.0', 'code': 0, 'valid': True}} >Thread-759::DEBUG::2013-03-01 13:56:35,729::task::1151::TaskManager.Task::(prepare) Task=`50eca407-b0a9-434b-bcc8-2628c374bd4a`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00340890884399', 'lastCheck': '8.0', 'code': 0, 'valid': True}} >Thread-759::DEBUG::2013-03-01 13:56:35,729::task::568::TaskManager.Task::(_updateState) Task=`50eca407-b0a9-434b-bcc8-2628c374bd4a`::moving from state preparing -> state finished >Thread-759::DEBUG::2013-03-01 13:56:35,729::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-759::DEBUG::2013-03-01 13:56:35,730::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-759::DEBUG::2013-03-01 13:56:35,730::task::957::TaskManager.Task::(_decref) Task=`50eca407-b0a9-434b-bcc8-2628c374bd4a`::ref 0 aborting False >Thread-739::DEBUG::2013-03-01 13:56:36,914::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-739::DEBUG::2013-03-01 13:56:36,964::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-739::DEBUG::2013-03-01 13:56:36,967::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=07af507e788ea8cb7a7d473c20ac802fe704b985'] >Thread-739::DEBUG::2013-03-01 13:56:36,968::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-739::DEBUG::2013-03-01 13:56:36,968::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-739::DEBUG::2013-03-01 13:56:36,969::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-739::DEBUG::2013-03-01 13:56:36,969::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-739::DEBUG::2013-03-01 13:56:36,969::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=7a156f011db95d975c61210334f11a818450ba65'] >Thread-739::DEBUG::2013-03-01 13:56:37,012::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-739::INFO::2013-03-01 13:56:37,012::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-739::DEBUG::2013-03-01 13:56:37,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd /usr/libexec/vdsm) >Thread-739::DEBUG::2013-03-01 13:56:38,131::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-739::DEBUG::2013-03-01 13:56:38,131::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-739::DEBUG::2013-03-01 13:56:38,132::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 28973299-9d17-4683-a64e-9a5cec830fcd released successfully (id: 1) >Thread-739::WARNING::2013-03-01 13:56:38,132::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `28973299-9d17-4683-a64e-9a5cec830fcd` >Thread-739::DEBUG::2013-03-01 13:56:38,132::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-739::DEBUG::2013-03-01 13:56:38,133::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-739::DEBUG::2013-03-01 13:56:38,133::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b2bf4d1e7a78adcd62af7488881ba5f0fb6162a6'] >Thread-739::DEBUG::2013-03-01 13:56:38,181::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-739::DEBUG::2013-03-01 13:56:38,181::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-739::DEBUG::2013-03-01 13:56:38,182::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-739::DEBUG::2013-03-01 13:56:38,182::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-739::DEBUG::2013-03-01 13:56:38,182::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `28973299-9d17-4683-a64e-9a5cec830fcd` is done >Thread-739::INFO::2013-03-01 13:56:38,183::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-739::DEBUG::2013-03-01 13:56:38,183::task::1151::TaskManager.Task::(prepare) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::finished: None >Thread-739::DEBUG::2013-03-01 13:56:38,183::task::568::TaskManager.Task::(_updateState) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::moving from state preparing -> state finished >Thread-739::DEBUG::2013-03-01 13:56:38,183::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd': < ResourceRef 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', isValid: 'True' obj: 'None'>} >Thread-739::DEBUG::2013-03-01 13:56:38,184::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-739::DEBUG::2013-03-01 13:56:38,184::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-739::DEBUG::2013-03-01 13:56:38,185::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-739::DEBUG::2013-03-01 13:56:38,185::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-739::DEBUG::2013-03-01 13:56:38,185::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-739::DEBUG::2013-03-01 13:56:38,186::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' >Thread-739::DEBUG::2013-03-01 13:56:38,186::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' (0 active users) >Thread-739::DEBUG::2013-03-01 13:56:38,186::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free, finding out if anyone is waiting for it. >Thread-739::DEBUG::2013-03-01 13:56:38,186::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', Clearing records. >Thread-739::DEBUG::2013-03-01 13:56:38,187::task::957::TaskManager.Task::(_decref) Task=`0ef34f7e-44b6-4ee0-92ef-b92cf7905342`::ref 0 aborting False >Thread-761::DEBUG::2013-03-01 13:56:38,228::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-761::DEBUG::2013-03-01 13:56:38,229::task::568::TaskManager.Task::(_updateState) Task=`c53e2357-760a-4e7b-ba67-b463fddf864f`::moving from state init -> state preparing >Thread-761::INFO::2013-03-01 13:56:38,230::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-761::INFO::2013-03-01 13:56:38,230::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-761::DEBUG::2013-03-01 13:56:38,231::task::1151::TaskManager.Task::(prepare) Task=`c53e2357-760a-4e7b-ba67-b463fddf864f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-761::DEBUG::2013-03-01 13:56:38,231::task::568::TaskManager.Task::(_updateState) Task=`c53e2357-760a-4e7b-ba67-b463fddf864f`::moving from state preparing -> state finished >Thread-761::DEBUG::2013-03-01 13:56:38,231::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-761::DEBUG::2013-03-01 13:56:38,232::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-761::DEBUG::2013-03-01 13:56:38,232::task::957::TaskManager.Task::(_decref) Task=`c53e2357-760a-4e7b-ba67-b463fddf864f`::ref 0 aborting False >Thread-762::DEBUG::2013-03-01 13:56:38,250::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-762::DEBUG::2013-03-01 13:56:38,251::task::568::TaskManager.Task::(_updateState) Task=`ba2a50d3-fc15-4ccc-80c9-21699e8574d3`::moving from state init -> state preparing >Thread-762::INFO::2013-03-01 13:56:38,251::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-762::DEBUG::2013-03-01 13:56:38,252::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`2e7dea5a-9441-4762-b6d4-df070afdd8a8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-762::DEBUG::2013-03-01 13:56:38,252::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-762::DEBUG::2013-03-01 13:56:38,252::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-762::DEBUG::2013-03-01 13:56:38,253::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`2e7dea5a-9441-4762-b6d4-df070afdd8a8`::Granted request >Thread-762::DEBUG::2013-03-01 13:56:38,253::task::794::TaskManager.Task::(resourceAcquired) Task=`ba2a50d3-fc15-4ccc-80c9-21699e8574d3`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-762::DEBUG::2013-03-01 13:56:38,253::task::957::TaskManager.Task::(_decref) Task=`ba2a50d3-fc15-4ccc-80c9-21699e8574d3`::ref 1 aborting False >Thread-762::INFO::2013-03-01 13:56:38,254::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-763::DEBUG::2013-03-01 13:56:38,260::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-763::DEBUG::2013-03-01 13:56:38,262::task::568::TaskManager.Task::(_updateState) Task=`5318d303-5112-4746-b9ef-c4d28080b6e0`::moving from state init -> state preparing >Thread-762::DEBUG::2013-03-01 13:56:38,263::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b2bf4d1e7a78adcd62af7488881ba5f0fb6162a6'] >Thread-763::INFO::2013-03-01 13:56:38,264::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-763::DEBUG::2013-03-01 13:56:38,267::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`6cbd5384-1d09-4c26-b58d-83abde777074`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-763::DEBUG::2013-03-01 13:56:38,269::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-762::DEBUG::2013-03-01 13:56:38,269::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:38,271::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-762::DEBUG::2013-03-01 13:56:38,272::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:38,273::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`6cbd5384-1d09-4c26-b58d-83abde777074`::Granted request >Thread-762::DEBUG::2013-03-01 13:56:38,275::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:38,277::task::794::TaskManager.Task::(resourceAcquired) Task=`5318d303-5112-4746-b9ef-c4d28080b6e0`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-762::DEBUG::2013-03-01 13:56:38,277::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:38,279::task::957::TaskManager.Task::(_decref) Task=`5318d303-5112-4746-b9ef-c4d28080b6e0`::ref 1 aborting False >Thread-762::DEBUG::2013-03-01 13:56:38,280::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-762::DEBUG::2013-03-01 13:56:38,280::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:38,281::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-763::DEBUG::2013-03-01 13:56:38,281::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-763::DEBUG::2013-03-01 13:56:38,282::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-763::DEBUG::2013-03-01 13:56:38,282::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-763::DEBUG::2013-03-01 13:56:38,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-763::DEBUG::2013-03-01 13:56:38,300::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-763::DEBUG::2013-03-01 13:56:38,300::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:38,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:39,307::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:40,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:41,316::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:42,320::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:42,324::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-763::DEBUG::2013-03-01 13:56:43,328::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-763::DEBUG::2013-03-01 13:56:45,331::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-763::DEBUG::2013-03-01 13:56:48,646::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-763::DEBUG::2013-03-01 13:56:48,647::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,647::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,648::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,648::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,648::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,649::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,649::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-763::DEBUG::2013-03-01 13:56:48,649::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,651::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-763::DEBUG::2013-03-01 13:56:48,874::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-763::WARNING::2013-03-01 13:56:48,875::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-763::DEBUG::2013-03-01 13:56:48,875::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-763::DEBUG::2013-03-01 13:56:48,922::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-763::DEBUG::2013-03-01 13:56:48,922::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-763::DEBUG::2013-03-01 13:56:48,926::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b2bf4d1e7a78adcd62af7488881ba5f0fb6162a6'] >Thread-763::DEBUG::2013-03-01 13:56:48,929::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-763::WARNING::2013-03-01 13:56:48,929::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-763::WARNING::2013-03-01 13:56:48,929::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-762::DEBUG::2013-03-01 13:56:48,934::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-762::DEBUG::2013-03-01 13:56:48,938::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-762::DEBUG::2013-03-01 13:56:48,941::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-762::DEBUG::2013-03-01 13:56:48,945::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-762::WARNING::2013-03-01 13:56:48,948::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-762::DEBUG::2013-03-01 13:56:48,956::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-762::DEBUG::2013-03-01 13:56:48,966::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-763::INFO::2013-03-01 13:56:48,981::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '943741468672', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-763::DEBUG::2013-03-01 13:56:48,983::task::1151::TaskManager.Task::(prepare) Task=`5318d303-5112-4746-b9ef-c4d28080b6e0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': '352c3a1d-5473-41a5-9693-3da8286df38d:Attached,ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'352c3a1d-5473-41a5-9693-3da8286df38d': {'status': 'Attached'}, 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '943741468672', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-763::DEBUG::2013-03-01 13:56:48,985::task::568::TaskManager.Task::(_updateState) Task=`5318d303-5112-4746-b9ef-c4d28080b6e0`::moving from state preparing -> state finished >Thread-763::DEBUG::2013-03-01 13:56:48,985::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-763::DEBUG::2013-03-01 13:56:48,986::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-763::DEBUG::2013-03-01 13:56:48,988::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-763::DEBUG::2013-03-01 13:56:48,991::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-763::DEBUG::2013-03-01 13:56:48,992::task::957::TaskManager.Task::(_decref) Task=`5318d303-5112-4746-b9ef-c4d28080b6e0`::ref 0 aborting False >Thread-762::DEBUG::2013-03-01 13:56:49,178::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-762::DEBUG::2013-03-01 13:56:49,178::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-762::INFO::2013-03-01 13:56:49,239::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-762::INFO::2013-03-01 13:56:49,240::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-762::INFO::2013-03-01 13:56:49,240::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-762::DEBUG::2013-03-01 13:56:49,240::task::1151::TaskManager.Task::(prepare) Task=`ba2a50d3-fc15-4ccc-80c9-21699e8574d3`::finished: None >Thread-762::DEBUG::2013-03-01 13:56:49,241::task::568::TaskManager.Task::(_updateState) Task=`ba2a50d3-fc15-4ccc-80c9-21699e8574d3`::moving from state preparing -> state finished >Thread-762::DEBUG::2013-03-01 13:56:49,241::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-762::DEBUG::2013-03-01 13:56:49,241::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-762::DEBUG::2013-03-01 13:56:49,242::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-762::DEBUG::2013-03-01 13:56:49,242::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-762::DEBUG::2013-03-01 13:56:49,242::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-762::DEBUG::2013-03-01 13:56:49,242::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-762::DEBUG::2013-03-01 13:56:49,243::task::957::TaskManager.Task::(_decref) Task=`ba2a50d3-fc15-4ccc-80c9-21699e8574d3`::ref 0 aborting False >Thread-810::DEBUG::2013-03-01 13:56:49,280::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-810::DEBUG::2013-03-01 13:56:49,281::task::568::TaskManager.Task::(_updateState) Task=`bff7247d-cc72-4441-8141-04dd1dcf0f7e`::moving from state init -> state preparing >Thread-810::INFO::2013-03-01 13:56:49,281::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-810::DEBUG::2013-03-01 13:56:49,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-810::DEBUG::2013-03-01 13:56:49,308::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-810::DEBUG::2013-03-01 13:56:49,309::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-810::DEBUG::2013-03-01 13:56:49,309::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-810::DEBUG::2013-03-01 13:56:49,309::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-810::DEBUG::2013-03-01 13:56:49,310::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-810::DEBUG::2013-03-01 13:56:49,330::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-810::DEBUG::2013-03-01 13:56:49,330::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:49,333::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:50,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-811::DEBUG::2013-03-01 13:56:51,089::task::568::TaskManager.Task::(_updateState) Task=`fafa88fc-8283-4050-8fc0-da0993e3cada`::moving from state init -> state preparing >Thread-811::INFO::2013-03-01 13:56:51,089::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-811::INFO::2013-03-01 13:56:51,089::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0165078639984', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-811::DEBUG::2013-03-01 13:56:51,090::task::1151::TaskManager.Task::(prepare) Task=`fafa88fc-8283-4050-8fc0-da0993e3cada`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0165078639984', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-811::DEBUG::2013-03-01 13:56:51,090::task::568::TaskManager.Task::(_updateState) Task=`fafa88fc-8283-4050-8fc0-da0993e3cada`::moving from state preparing -> state finished >Thread-811::DEBUG::2013-03-01 13:56:51,090::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-811::DEBUG::2013-03-01 13:56:51,091::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-811::DEBUG::2013-03-01 13:56:51,091::task::957::TaskManager.Task::(_decref) Task=`fafa88fc-8283-4050-8fc0-da0993e3cada`::ref 0 aborting False >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:51,342::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:52,346::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:52,349::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:52,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-810::DEBUG::2013-03-01 13:56:53,356::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-810::DEBUG::2013-03-01 13:56:55,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-810::DEBUG::2013-03-01 13:56:56,435::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-810::DEBUG::2013-03-01 13:56:56,435::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-810::DEBUG::2013-03-01 13:56:56,436::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-810::DEBUG::2013-03-01 13:56:56,436::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-810::DEBUG::2013-03-01 13:56:56,437::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-810::DEBUG::2013-03-01 13:56:56,437::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-810::DEBUG::2013-03-01 13:56:56,437::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-810::DEBUG::2013-03-01 13:56:56,438::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-810::INFO::2013-03-01 13:56:56,438::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-810::DEBUG::2013-03-01 13:56:56,438::task::1151::TaskManager.Task::(prepare) Task=`bff7247d-cc72-4441-8141-04dd1dcf0f7e`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-810::DEBUG::2013-03-01 13:56:56,439::task::568::TaskManager.Task::(_updateState) Task=`bff7247d-cc72-4441-8141-04dd1dcf0f7e`::moving from state preparing -> state finished >Thread-810::DEBUG::2013-03-01 13:56:56,439::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-810::DEBUG::2013-03-01 13:56:56,439::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-810::DEBUG::2013-03-01 13:56:56,440::task::957::TaskManager.Task::(_decref) Task=`bff7247d-cc72-4441-8141-04dd1dcf0f7e`::ref 0 aborting False >Thread-814::DEBUG::2013-03-01 13:56:57,146::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-814::DEBUG::2013-03-01 13:56:57,147::task::568::TaskManager.Task::(_updateState) Task=`e545b424-96fc-4803-b3a3-e14695e2d9d8`::moving from state init -> state preparing >Thread-814::INFO::2013-03-01 13:56:57,147::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-814::INFO::2013-03-01 13:56:57,148::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-814::DEBUG::2013-03-01 13:56:57,148::task::1151::TaskManager.Task::(prepare) Task=`e545b424-96fc-4803-b3a3-e14695e2d9d8`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-814::DEBUG::2013-03-01 13:56:57,148::task::568::TaskManager.Task::(_updateState) Task=`e545b424-96fc-4803-b3a3-e14695e2d9d8`::moving from state preparing -> state finished >Thread-814::DEBUG::2013-03-01 13:56:57,148::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-814::DEBUG::2013-03-01 13:56:57,149::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-814::DEBUG::2013-03-01 13:56:57,149::task::957::TaskManager.Task::(_decref) Task=`e545b424-96fc-4803-b3a3-e14695e2d9d8`::ref 0 aborting False >Thread-815::DEBUG::2013-03-01 13:56:57,180::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-815::DEBUG::2013-03-01 13:56:57,181::task::568::TaskManager.Task::(_updateState) Task=`3b0a27de-aa47-4985-84a7-36c9e95caf5f`::moving from state init -> state preparing >Thread-815::INFO::2013-03-01 13:56:57,181::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-815::DEBUG::2013-03-01 13:56:57,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-815::INFO::2013-03-01 13:56:57,227::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-815::DEBUG::2013-03-01 13:56:57,228::task::1151::TaskManager.Task::(prepare) Task=`3b0a27de-aa47-4985-84a7-36c9e95caf5f`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-815::DEBUG::2013-03-01 13:56:57,228::task::568::TaskManager.Task::(_updateState) Task=`3b0a27de-aa47-4985-84a7-36c9e95caf5f`::moving from state preparing -> state finished >Thread-815::DEBUG::2013-03-01 13:56:57,228::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-815::DEBUG::2013-03-01 13:56:57,228::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-815::DEBUG::2013-03-01 13:56:57,229::task::957::TaskManager.Task::(_decref) Task=`3b0a27de-aa47-4985-84a7-36c9e95caf5f`::ref 0 aborting False >Thread-817::DEBUG::2013-03-01 13:56:57,262::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-817::DEBUG::2013-03-01 13:56:57,262::task::568::TaskManager.Task::(_updateState) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::moving from state init -> state preparing >Thread-817::INFO::2013-03-01 13:56:57,263::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-817::DEBUG::2013-03-01 13:56:57,264::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`8b87c06c-3897-49be-99d1-a11d9535d40c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-817::DEBUG::2013-03-01 13:56:57,264::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-817::DEBUG::2013-03-01 13:56:57,264::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-817::DEBUG::2013-03-01 13:56:57,265::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`8b87c06c-3897-49be-99d1-a11d9535d40c`::Granted request >Thread-817::DEBUG::2013-03-01 13:56:57,265::task::794::TaskManager.Task::(resourceAcquired) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-817::DEBUG::2013-03-01 13:56:57,265::task::957::TaskManager.Task::(_decref) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::ref 1 aborting False >Thread-817::DEBUG::2013-03-01 13:56:57,266::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`872ef994-7662-4ace-8438-2f343d62df15`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-817::DEBUG::2013-03-01 13:56:57,266::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' for lock type 'exclusive' >Thread-817::DEBUG::2013-03-01 13:56:57,267::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free. Now locking as 'exclusive' (1 active user) >Thread-817::DEBUG::2013-03-01 13:56:57,267::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`872ef994-7662-4ace-8438-2f343d62df15`::Granted request >Thread-817::DEBUG::2013-03-01 13:56:57,267::task::794::TaskManager.Task::(resourceAcquired) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::_resourcesAcquired: Storage.352c3a1d-5473-41a5-9693-3da8286df38d (exclusive) >Thread-817::DEBUG::2013-03-01 13:56:57,268::task::957::TaskManager.Task::(_decref) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::ref 1 aborting False >Thread-817::INFO::2013-03-01 13:56:57,268::sp::984::Storage.StoragePool::(detachSD) sdUUID=352c3a1d-5473-41a5-9693-3da8286df38d spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-817::DEBUG::2013-03-01 13:56:57,268::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-817::DEBUG::2013-03-01 13:56:57,268::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-817::DEBUG::2013-03-01 13:56:57,269::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-817::DEBUG::2013-03-01 13:56:57,269::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-817::DEBUG::2013-03-01 13:56:57,269::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-817::DEBUG::2013-03-01 13:56:57,285::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-817::DEBUG::2013-03-01 13:56:57,285::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:57,288::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:58,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:59,297::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:59,300::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:59,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:59,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2013-03-01 13:56:59,309::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-817::DEBUG::2013-03-01 13:57:01,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-817::DEBUG::2013-03-01 13:57:02,365::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-817::DEBUG::2013-03-01 13:57:02,366::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,366::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,367::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,367::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,368::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,368::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,368::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-817::DEBUG::2013-03-01 13:57:02,369::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,370::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-817::DEBUG::2013-03-01 13:57:02,595::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-817::WARNING::2013-03-01 13:57:02,596::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-817::DEBUG::2013-03-01 13:57:02,597::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-817::DEBUG::2013-03-01 13:57:02,682::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-817::DEBUG::2013-03-01 13:57:02,683::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-817::DEBUG::2013-03-01 13:57:02,687::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-817::DEBUG::2013-03-01 13:57:02,690::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-817::WARNING::2013-03-01 13:57:02,690::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-817::WARNING::2013-03-01 13:57:02,690::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-817::DEBUG::2013-03-01 13:57:02,694::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8a352826a76def5c0453fbecb85b22489cf3fe5'] >Thread-817::DEBUG::2013-03-01 13:57:02,694::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-817::DEBUG::2013-03-01 13:57:02,695::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-817::DEBUG::2013-03-01 13:57:02,695::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-817::DEBUG::2013-03-01 13:57:02,695::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-817::DEBUG::2013-03-01 13:57:02,696::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c07ec8aef5484bc9911a04baa0f89a159dc8ca83'] >Thread-817::DEBUG::2013-03-01 13:57:02,744::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-817::WARNING::2013-03-01 13:57:02,745::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `352c3a1d-5473-41a5-9693-3da8286df38d` >Thread-817::DEBUG::2013-03-01 13:57:02,745::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-817::DEBUG::2013-03-01 13:57:02,746::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-817::DEBUG::2013-03-01 13:57:02,746::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4973f9aab1aae0d91b34fe6d8baf9997f772dfd9'] >Thread-817::DEBUG::2013-03-01 13:57:02,788::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-817::DEBUG::2013-03-01 13:57:02,789::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-817::DEBUG::2013-03-01 13:57:02,789::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-817::DEBUG::2013-03-01 13:57:02,789::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-817::DEBUG::2013-03-01 13:57:02,789::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `352c3a1d-5473-41a5-9693-3da8286df38d` is done >Thread-817::INFO::2013-03-01 13:57:02,790::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-817::DEBUG::2013-03-01 13:57:02,790::task::1151::TaskManager.Task::(prepare) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::finished: None >Thread-817::DEBUG::2013-03-01 13:57:02,790::task::568::TaskManager.Task::(_updateState) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::moving from state preparing -> state finished >Thread-817::DEBUG::2013-03-01 13:57:02,790::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d': < ResourceRef 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', isValid: 'True' obj: 'None'>} >Thread-817::DEBUG::2013-03-01 13:57:02,791::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-817::DEBUG::2013-03-01 13:57:02,791::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-817::DEBUG::2013-03-01 13:57:02,792::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-817::DEBUG::2013-03-01 13:57:02,792::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-817::DEBUG::2013-03-01 13:57:02,792::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-817::DEBUG::2013-03-01 13:57:02,793::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' >Thread-817::DEBUG::2013-03-01 13:57:02,793::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' (0 active users) >Thread-817::DEBUG::2013-03-01 13:57:02,793::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free, finding out if anyone is waiting for it. >Thread-817::DEBUG::2013-03-01 13:57:02,793::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', Clearing records. >Thread-817::DEBUG::2013-03-01 13:57:02,794::task::957::TaskManager.Task::(_decref) Task=`0c80d99b-bb79-4fb5-88ac-684348c781ee`::ref 0 aborting False >Thread-844::DEBUG::2013-03-01 13:57:02,832::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-844::DEBUG::2013-03-01 13:57:02,832::task::568::TaskManager.Task::(_updateState) Task=`6d8c9d8e-e2bd-4070-93b8-c00c7b3a8e01`::moving from state init -> state preparing >Thread-844::INFO::2013-03-01 13:57:02,833::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-844::INFO::2013-03-01 13:57:02,833::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-844::DEBUG::2013-03-01 13:57:02,833::task::1151::TaskManager.Task::(prepare) Task=`6d8c9d8e-e2bd-4070-93b8-c00c7b3a8e01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-844::DEBUG::2013-03-01 13:57:02,834::task::568::TaskManager.Task::(_updateState) Task=`6d8c9d8e-e2bd-4070-93b8-c00c7b3a8e01`::moving from state preparing -> state finished >Thread-844::DEBUG::2013-03-01 13:57:02,834::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-844::DEBUG::2013-03-01 13:57:02,834::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-844::DEBUG::2013-03-01 13:57:02,835::task::957::TaskManager.Task::(_decref) Task=`6d8c9d8e-e2bd-4070-93b8-c00c7b3a8e01`::ref 0 aborting False >Thread-845::DEBUG::2013-03-01 13:57:02,844::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-845::DEBUG::2013-03-01 13:57:02,845::task::568::TaskManager.Task::(_updateState) Task=`97d2946d-a5c2-4998-9c0b-bad954a1971c`::moving from state init -> state preparing >Thread-845::INFO::2013-03-01 13:57:02,845::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-845::DEBUG::2013-03-01 13:57:02,846::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ddfa9698-f150-4d3f-960d-85770755ce5f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-845::DEBUG::2013-03-01 13:57:02,846::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-845::DEBUG::2013-03-01 13:57:02,846::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'shared' (1 active user) >Thread-845::DEBUG::2013-03-01 13:57:02,846::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ddfa9698-f150-4d3f-960d-85770755ce5f`::Granted request >Thread-845::DEBUG::2013-03-01 13:57:02,847::task::794::TaskManager.Task::(resourceAcquired) Task=`97d2946d-a5c2-4998-9c0b-bad954a1971c`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-845::DEBUG::2013-03-01 13:57:02,847::task::957::TaskManager.Task::(_decref) Task=`97d2946d-a5c2-4998-9c0b-bad954a1971c`::ref 1 aborting False >Thread-845::INFO::2013-03-01 13:57:02,848::fileSD::302::Storage.StorageDomain::(validate) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-845::DEBUG::2013-03-01 13:57:02,852::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4973f9aab1aae0d91b34fe6d8baf9997f772dfd9'] >Thread-845::DEBUG::2013-03-01 13:57:02,853::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:02,853::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:02,853::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:02,854::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:02,854::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:02,854::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:02,855::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-845::DEBUG::2013-03-01 13:57:02,855::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-845::DEBUG::2013-03-01 13:57:02,855::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-845::DEBUG::2013-03-01 13:57:02,856::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-845::DEBUG::2013-03-01 13:57:02,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-846::DEBUG::2013-03-01 13:57:02,863::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-846::DEBUG::2013-03-01 13:57:02,864::task::568::TaskManager.Task::(_updateState) Task=`8d18d155-6c8b-4360-8016-03802b0f2d2f`::moving from state init -> state preparing >Thread-846::INFO::2013-03-01 13:57:02,864::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-846::DEBUG::2013-03-01 13:57:02,865::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`1b304be7-e9de-4466-8b82-e06536f1836f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-846::DEBUG::2013-03-01 13:57:02,865::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'shared' >Thread-846::DEBUG::2013-03-01 13:57:02,866::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-846::DEBUG::2013-03-01 13:57:02,866::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`1b304be7-e9de-4466-8b82-e06536f1836f`::Granted request >Thread-846::DEBUG::2013-03-01 13:57:02,867::task::794::TaskManager.Task::(resourceAcquired) Task=`8d18d155-6c8b-4360-8016-03802b0f2d2f`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (shared) >Thread-846::DEBUG::2013-03-01 13:57:02,867::task::957::TaskManager.Task::(_decref) Task=`8d18d155-6c8b-4360-8016-03802b0f2d2f`::ref 1 aborting False >Thread-845::DEBUG::2013-03-01 13:57:02,871::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-845::DEBUG::2013-03-01 13:57:02,871::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:02,873::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:03,877::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:04,882::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:05,886::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-848::DEBUG::2013-03-01 13:57:06,335::task::568::TaskManager.Task::(_updateState) Task=`0b4516e9-dd07-4710-bc3e-7d9df42ef62e`::moving from state init -> state preparing >Thread-848::INFO::2013-03-01 13:57:06,336::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-848::INFO::2013-03-01 13:57:06,336::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00289082527161', 'lastCheck': '7.3', 'code': 0, 'valid': True}} >Thread-848::DEBUG::2013-03-01 13:57:06,336::task::1151::TaskManager.Task::(prepare) Task=`0b4516e9-dd07-4710-bc3e-7d9df42ef62e`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00289082527161', 'lastCheck': '7.3', 'code': 0, 'valid': True}} >Thread-848::DEBUG::2013-03-01 13:57:06,336::task::568::TaskManager.Task::(_updateState) Task=`0b4516e9-dd07-4710-bc3e-7d9df42ef62e`::moving from state preparing -> state finished >Thread-848::DEBUG::2013-03-01 13:57:06,337::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-848::DEBUG::2013-03-01 13:57:06,337::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-848::DEBUG::2013-03-01 13:57:06,337::task::957::TaskManager.Task::(_decref) Task=`0b4516e9-dd07-4710-bc3e-7d9df42ef62e`::ref 0 aborting False >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:06,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:06,893::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2013-03-01 13:57:06,896::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-845::DEBUG::2013-03-01 13:57:08,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-845::DEBUG::2013-03-01 13:57:11,708::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-845::DEBUG::2013-03-01 13:57:11,708::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,708::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,709::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,709::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,709::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,709::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,710::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-845::DEBUG::2013-03-01 13:57:11,710::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-845::DEBUG::2013-03-01 13:57:11,934::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-845::WARNING::2013-03-01 13:57:11,935::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-845::DEBUG::2013-03-01 13:57:11,936::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-845::DEBUG::2013-03-01 13:57:11,978::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-845::DEBUG::2013-03-01 13:57:11,979::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-845::DEBUG::2013-03-01 13:57:11,983::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4973f9aab1aae0d91b34fe6d8baf9997f772dfd9'] >Thread-845::DEBUG::2013-03-01 13:57:11,985::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-845::WARNING::2013-03-01 13:57:11,985::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-845::WARNING::2013-03-01 13:57:11,985::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-845::DEBUG::2013-03-01 13:57:11,989::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-845::DEBUG::2013-03-01 13:57:11,992::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-845::DEBUG::2013-03-01 13:57:11,995::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-845::DEBUG::2013-03-01 13:57:12,000::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-845::WARNING::2013-03-01 13:57:12,003::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12 already exists >Thread-845::DEBUG::2013-03-01 13:57:12,012::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-846::INFO::2013-03-01 13:57:12,016::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '943740420096', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-846::DEBUG::2013-03-01 13:57:12,018::task::1151::TaskManager.Task::(prepare) Task=`8d18d155-6c8b-4360-8016-03802b0f2d2f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'name': 'nfsStorageTest', 'version': '3', 'domains': 'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'status': 'Active', 'diskfree': '943740420096', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-846::DEBUG::2013-03-01 13:57:12,020::task::568::TaskManager.Task::(_updateState) Task=`8d18d155-6c8b-4360-8016-03802b0f2d2f`::moving from state preparing -> state finished >Thread-845::DEBUG::2013-03-01 13:57:12,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-846::DEBUG::2013-03-01 13:57:12,021::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-846::DEBUG::2013-03-01 13:57:12,022::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-846::DEBUG::2013-03-01 13:57:12,031::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-846::DEBUG::2013-03-01 13:57:12,033::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (1 active users) >Thread-846::DEBUG::2013-03-01 13:57:12,035::task::957::TaskManager.Task::(_decref) Task=`8d18d155-6c8b-4360-8016-03802b0f2d2f`::ref 0 aborting False >Thread-845::DEBUG::2013-03-01 13:57:12,190::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-845::DEBUG::2013-03-01 13:57:12,191::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-845::INFO::2013-03-01 13:57:12,250::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-845::INFO::2013-03-01 13:57:12,250::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-845::INFO::2013-03-01 13:57:12,251::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-845::DEBUG::2013-03-01 13:57:12,251::task::1151::TaskManager.Task::(prepare) Task=`97d2946d-a5c2-4998-9c0b-bad954a1971c`::finished: None >Thread-845::DEBUG::2013-03-01 13:57:12,251::task::568::TaskManager.Task::(_updateState) Task=`97d2946d-a5c2-4998-9c0b-bad954a1971c`::moving from state preparing -> state finished >Thread-845::DEBUG::2013-03-01 13:57:12,252::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-845::DEBUG::2013-03-01 13:57:12,252::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-845::DEBUG::2013-03-01 13:57:12,252::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-845::DEBUG::2013-03-01 13:57:12,253::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-845::DEBUG::2013-03-01 13:57:12,253::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-845::DEBUG::2013-03-01 13:57:12,253::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-845::DEBUG::2013-03-01 13:57:12,253::task::957::TaskManager.Task::(_decref) Task=`97d2946d-a5c2-4998-9c0b-bad954a1971c`::ref 0 aborting False >Thread-893::DEBUG::2013-03-01 13:57:12,288::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-893::DEBUG::2013-03-01 13:57:12,288::task::568::TaskManager.Task::(_updateState) Task=`7a8ecf94-cec4-4689-9b2f-c2d8b2da5b5a`::moving from state init -> state preparing >Thread-893::INFO::2013-03-01 13:57:12,289::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-893::DEBUG::2013-03-01 13:57:12,290::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-893::DEBUG::2013-03-01 13:57:12,318::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-893::DEBUG::2013-03-01 13:57:12,318::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-893::DEBUG::2013-03-01 13:57:12,318::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-893::DEBUG::2013-03-01 13:57:12,319::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-893::DEBUG::2013-03-01 13:57:12,319::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-893::DEBUG::2013-03-01 13:57:12,334::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-893::DEBUG::2013-03-01 13:57:12,335::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:12,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:13,341::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:13,345::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:14,349::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:14,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:15,447::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-893::DEBUG::2013-03-01 13:57:15,498::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-893::DEBUG::2013-03-01 13:57:17,504::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-893::DEBUG::2013-03-01 13:57:18,558::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-893::DEBUG::2013-03-01 13:57:18,558::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-893::DEBUG::2013-03-01 13:57:18,559::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-893::DEBUG::2013-03-01 13:57:18,559::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-893::DEBUG::2013-03-01 13:57:18,560::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-893::DEBUG::2013-03-01 13:57:18,560::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-893::DEBUG::2013-03-01 13:57:18,560::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-893::DEBUG::2013-03-01 13:57:18,561::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-893::INFO::2013-03-01 13:57:18,561::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-893::DEBUG::2013-03-01 13:57:18,561::task::1151::TaskManager.Task::(prepare) Task=`7a8ecf94-cec4-4689-9b2f-c2d8b2da5b5a`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-893::DEBUG::2013-03-01 13:57:18,562::task::568::TaskManager.Task::(_updateState) Task=`7a8ecf94-cec4-4689-9b2f-c2d8b2da5b5a`::moving from state preparing -> state finished >Thread-893::DEBUG::2013-03-01 13:57:18,562::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-893::DEBUG::2013-03-01 13:57:18,562::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-893::DEBUG::2013-03-01 13:57:18,562::task::957::TaskManager.Task::(_decref) Task=`7a8ecf94-cec4-4689-9b2f-c2d8b2da5b5a`::ref 0 aborting False >Thread-897::DEBUG::2013-03-01 13:57:19,673::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-897::DEBUG::2013-03-01 13:57:19,674::task::568::TaskManager.Task::(_updateState) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::moving from state init -> state preparing >Thread-897::INFO::2013-03-01 13:57:19,762::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-897::DEBUG::2013-03-01 13:57:19,763::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`a551aa6d-115a-4708-8288-7ef7cd4203e6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-897::DEBUG::2013-03-01 13:57:19,763::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-897::DEBUG::2013-03-01 13:57:19,763::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-897::DEBUG::2013-03-01 13:57:19,763::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`a551aa6d-115a-4708-8288-7ef7cd4203e6`::Granted request >Thread-897::DEBUG::2013-03-01 13:57:19,764::task::794::TaskManager.Task::(resourceAcquired) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-897::DEBUG::2013-03-01 13:57:19,764::task::957::TaskManager.Task::(_decref) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::ref 1 aborting False >Thread-897::DEBUG::2013-03-01 13:57:19,764::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`da0338e8-7b7c-451d-8d40-3a9493310eab`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-897::DEBUG::2013-03-01 13:57:19,764::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >Thread-897::DEBUG::2013-03-01 13:57:19,765::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >Thread-897::DEBUG::2013-03-01 13:57:19,765::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`da0338e8-7b7c-451d-8d40-3a9493310eab`::Granted request >Thread-897::DEBUG::2013-03-01 13:57:19,765::task::794::TaskManager.Task::(resourceAcquired) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::_resourcesAcquired: Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (exclusive) >Thread-897::DEBUG::2013-03-01 13:57:19,765::task::957::TaskManager.Task::(_decref) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::ref 1 aborting False >Thread-897::INFO::2013-03-01 13:57:19,765::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-897::INFO::2013-03-01 13:57:19,766::sp::1103::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-897::INFO::2013-03-01 13:57:19,766::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-897::DEBUG::2013-03-01 13:57:19,766::task::1151::TaskManager.Task::(prepare) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::finished: None >Thread-897::DEBUG::2013-03-01 13:57:19,766::task::568::TaskManager.Task::(_updateState) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::moving from state preparing -> state finished >Thread-897::DEBUG::2013-03-01 13:57:19,766::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': < ResourceRef 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', isValid: 'True' obj: 'None'>} >Thread-897::DEBUG::2013-03-01 13:57:19,766::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-897::DEBUG::2013-03-01 13:57:19,767::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-897::DEBUG::2013-03-01 13:57:19,767::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-897::DEBUG::2013-03-01 13:57:19,767::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-897::DEBUG::2013-03-01 13:57:19,767::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-897::DEBUG::2013-03-01 13:57:19,767::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >Thread-897::DEBUG::2013-03-01 13:57:19,767::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >Thread-897::DEBUG::2013-03-01 13:57:19,768::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >Thread-897::DEBUG::2013-03-01 13:57:19,768::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >Thread-897::DEBUG::2013-03-01 13:57:19,768::task::957::TaskManager.Task::(_decref) Task=`193bd062-6cb4-4688-ba20-7db738d109dd`::ref 0 aborting False >Thread-898::DEBUG::2013-03-01 13:57:19,809::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-898::DEBUG::2013-03-01 13:57:19,809::task::568::TaskManager.Task::(_updateState) Task=`10e8308b-6825-45a8-b852-7f3abfd66254`::moving from state init -> state preparing >Thread-898::INFO::2013-03-01 13:57:19,809::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-898::DEBUG::2013-03-01 13:57:19,810::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-898::DEBUG::2013-03-01 13:57:19,810::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-898::INFO::2013-03-01 13:57:19,810::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-898::DEBUG::2013-03-01 13:57:19,810::task::1151::TaskManager.Task::(prepare) Task=`10e8308b-6825-45a8-b852-7f3abfd66254`::finished: {'allTasksStatus': {}} >Thread-898::DEBUG::2013-03-01 13:57:19,811::task::568::TaskManager.Task::(_updateState) Task=`10e8308b-6825-45a8-b852-7f3abfd66254`::moving from state preparing -> state finished >Thread-898::DEBUG::2013-03-01 13:57:19,811::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-898::DEBUG::2013-03-01 13:57:19,811::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-898::DEBUG::2013-03-01 13:57:19,811::task::957::TaskManager.Task::(_decref) Task=`10e8308b-6825-45a8-b852-7f3abfd66254`::ref 0 aborting False >Thread-899::DEBUG::2013-03-01 13:57:19,838::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-899::DEBUG::2013-03-01 13:57:19,838::task::568::TaskManager.Task::(_updateState) Task=`b760a06d-4520-4f68-a95e-512be23a0859`::moving from state init -> state preparing >Thread-899::INFO::2013-03-01 13:57:19,839::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-899::DEBUG::2013-03-01 13:57:19,839::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`c89d4c0d-2ca8-4810-9736-26257a2c3c4d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-899::DEBUG::2013-03-01 13:57:19,839::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-899::DEBUG::2013-03-01 13:57:19,840::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-899::DEBUG::2013-03-01 13:57:19,840::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`c89d4c0d-2ca8-4810-9736-26257a2c3c4d`::Granted request >Thread-899::DEBUG::2013-03-01 13:57:19,840::task::794::TaskManager.Task::(resourceAcquired) Task=`b760a06d-4520-4f68-a95e-512be23a0859`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-899::DEBUG::2013-03-01 13:57:19,841::task::957::TaskManager.Task::(_decref) Task=`b760a06d-4520-4f68-a95e-512be23a0859`::ref 1 aborting False >Thread-899::DEBUG::2013-03-01 13:57:19,841::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-899::DEBUG::2013-03-01 13:57:19,841::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`5517da52-1d13-415a-9d1c-621463c58074`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-899::DEBUG::2013-03-01 13:57:19,841::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-899::DEBUG::2013-03-01 13:57:19,842::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-899::DEBUG::2013-03-01 13:57:19,842::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`5517da52-1d13-415a-9d1c-621463c58074`::Granted request >Thread-899::DEBUG::2013-03-01 13:57:19,843::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-899::DEBUG::2013-03-01 13:57:19,843::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-899::DEBUG::2013-03-01 13:57:19,843::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-899::DEBUG::2013-03-01 13:57:19,843::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-899::DEBUG::2013-03-01 13:57:19,848::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,850::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,852::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,854::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,857::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,859::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,861::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,863::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,865::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,868::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,870::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,872::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,874::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,876::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,878::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,881::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,883::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,885::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,887::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,889::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,892::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,894::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,896::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,898::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,900::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,903::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,905::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,907::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,909::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,911::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,913::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,916::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,918::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,920::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,922::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,924::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-899::DEBUG::2013-03-01 13:57:19,925::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-899::DEBUG::2013-03-01 13:57:19,925::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-899::DEBUG::2013-03-01 13:57:19,925::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a83caeddc65920bd1f7693bd211f4306492f1fe4'] >Thread-899::DEBUG::2013-03-01 13:57:19,970::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-899::INFO::2013-03-01 13:57:19,970::clusterlock::252::SANLock::(release) Releasing cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-899::DEBUG::2013-03-01 13:57:19,995::clusterlock::263::SANLock::(release) Cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully released >Thread-899::INFO::2013-03-01 13:57:19,995::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-899::DEBUG::2013-03-01 13:57:19,995::task::1151::TaskManager.Task::(prepare) Task=`b760a06d-4520-4f68-a95e-512be23a0859`::finished: None >Thread-899::DEBUG::2013-03-01 13:57:19,995::task::568::TaskManager.Task::(_updateState) Task=`b760a06d-4520-4f68-a95e-512be23a0859`::moving from state preparing -> state finished >Thread-899::DEBUG::2013-03-01 13:57:19,996::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-899::DEBUG::2013-03-01 13:57:19,996::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-899::DEBUG::2013-03-01 13:57:19,996::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-899::DEBUG::2013-03-01 13:57:19,996::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-899::DEBUG::2013-03-01 13:57:19,997::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-899::DEBUG::2013-03-01 13:57:19,997::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-899::DEBUG::2013-03-01 13:57:19,997::task::957::TaskManager.Task::(_decref) Task=`b760a06d-4520-4f68-a95e-512be23a0859`::ref 0 aborting False >Thread-900::DEBUG::2013-03-01 13:57:20,035::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-900::DEBUG::2013-03-01 13:57:20,036::task::568::TaskManager.Task::(_updateState) Task=`3e1cfbfd-4320-49c9-8421-d57d4a7768b6`::moving from state init -> state preparing >Thread-900::INFO::2013-03-01 13:57:20,036::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', hostID=1, scsiKey='56be65b1-c08c-4688-bc80-a72136fefb12', remove=False, options=None) >Thread-900::DEBUG::2013-03-01 13:57:20,037::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`48ffe74a-b5ac-42e9-a84e-92e3da544a76`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-900::DEBUG::2013-03-01 13:57:20,037::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-900::DEBUG::2013-03-01 13:57:20,037::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-900::DEBUG::2013-03-01 13:57:20,037::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`48ffe74a-b5ac-42e9-a84e-92e3da544a76`::Granted request >Thread-900::DEBUG::2013-03-01 13:57:20,038::task::794::TaskManager.Task::(resourceAcquired) Task=`3e1cfbfd-4320-49c9-8421-d57d4a7768b6`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-900::DEBUG::2013-03-01 13:57:20,038::task::957::TaskManager.Task::(_decref) Task=`3e1cfbfd-4320-49c9-8421-d57d4a7768b6`::ref 1 aborting False >Thread-900::INFO::2013-03-01 13:57:20,038::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-259::DEBUG::2013-03-01 13:57:20,039::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-259::INFO::2013-03-01 13:57:20,039::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >Thread-901::DEBUG::2013-03-01 13:57:21,737::task::568::TaskManager.Task::(_updateState) Task=`000b1a9b-7458-4c1d-9581-4292125a71fe`::moving from state init -> state preparing >Thread-901::INFO::2013-03-01 13:57:21,737::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-901::INFO::2013-03-01 13:57:21,738::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0160720348358', 'lastCheck': '9.7', 'code': 0, 'valid': True}} >Thread-901::DEBUG::2013-03-01 13:57:21,738::task::1151::TaskManager.Task::(prepare) Task=`000b1a9b-7458-4c1d-9581-4292125a71fe`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.0160720348358', 'lastCheck': '9.7', 'code': 0, 'valid': True}} >Thread-901::DEBUG::2013-03-01 13:57:21,738::task::568::TaskManager.Task::(_updateState) Task=`000b1a9b-7458-4c1d-9581-4292125a71fe`::moving from state preparing -> state finished >Thread-901::DEBUG::2013-03-01 13:57:21,738::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-901::DEBUG::2013-03-01 13:57:21,739::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-901::DEBUG::2013-03-01 13:57:21,739::task::957::TaskManager.Task::(_decref) Task=`000b1a9b-7458-4c1d-9581-4292125a71fe`::ref 0 aborting False >Thread-259::DEBUG::2013-03-01 13:57:22,041::clusterlock::206::SANLock::(releaseHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c released successfully (id: 1) >Thread-900::INFO::2013-03-01 13:57:22,041::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-900::DEBUG::2013-03-01 13:57:22,041::task::1151::TaskManager.Task::(prepare) Task=`3e1cfbfd-4320-49c9-8421-d57d4a7768b6`::finished: True >Thread-900::DEBUG::2013-03-01 13:57:22,042::task::568::TaskManager.Task::(_updateState) Task=`3e1cfbfd-4320-49c9-8421-d57d4a7768b6`::moving from state preparing -> state finished >Thread-900::DEBUG::2013-03-01 13:57:22,042::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >Thread-900::DEBUG::2013-03-01 13:57:22,042::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-900::DEBUG::2013-03-01 13:57:22,043::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-900::DEBUG::2013-03-01 13:57:22,043::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-900::DEBUG::2013-03-01 13:57:22,043::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-900::DEBUG::2013-03-01 13:57:22,043::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-900::DEBUG::2013-03-01 13:57:22,044::task::957::TaskManager.Task::(_decref) Task=`3e1cfbfd-4320-49c9-8421-d57d4a7768b6`::ref 0 aborting False >Thread-903::DEBUG::2013-03-01 13:57:22,087::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-903::DEBUG::2013-03-01 13:57:22,087::task::568::TaskManager.Task::(_updateState) Task=`25061028-a8f5-4f02-9c53-9305b5f738ea`::moving from state init -> state preparing >Thread-903::INFO::2013-03-01 13:57:22,088::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-903::DEBUG::2013-03-01 13:57:22,088::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-903::DEBUG::2013-03-01 13:57:22,125::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-903::DEBUG::2013-03-01 13:57:22,126::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-903::DEBUG::2013-03-01 13:57:22,126::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-903::DEBUG::2013-03-01 13:57:22,126::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-903::DEBUG::2013-03-01 13:57:22,127::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-903::DEBUG::2013-03-01 13:57:22,142::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-903::DEBUG::2013-03-01 13:57:22,142::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:22,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:23,149::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:24,153::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:25,158::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:25,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:26,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-903::DEBUG::2013-03-01 13:57:27,169::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-903::DEBUG::2013-03-01 13:57:29,172::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-903::DEBUG::2013-03-01 13:57:30,245::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-903::DEBUG::2013-03-01 13:57:30,245::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-903::DEBUG::2013-03-01 13:57:30,246::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-903::DEBUG::2013-03-01 13:57:30,246::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-903::DEBUG::2013-03-01 13:57:30,247::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-903::DEBUG::2013-03-01 13:57:30,247::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-903::DEBUG::2013-03-01 13:57:30,247::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-903::DEBUG::2013-03-01 13:57:30,248::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-903::INFO::2013-03-01 13:57:30,248::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-903::DEBUG::2013-03-01 13:57:30,248::task::1151::TaskManager.Task::(prepare) Task=`25061028-a8f5-4f02-9c53-9305b5f738ea`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-903::DEBUG::2013-03-01 13:57:30,249::task::568::TaskManager.Task::(_updateState) Task=`25061028-a8f5-4f02-9c53-9305b5f738ea`::moving from state preparing -> state finished >Thread-903::DEBUG::2013-03-01 13:57:30,249::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-903::DEBUG::2013-03-01 13:57:30,249::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-903::DEBUG::2013-03-01 13:57:30,249::task::957::TaskManager.Task::(_decref) Task=`25061028-a8f5-4f02-9c53-9305b5f738ea`::ref 0 aborting False >Thread-907::DEBUG::2013-03-01 13:57:31,462::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-907::DEBUG::2013-03-01 13:57:31,463::task::568::TaskManager.Task::(_updateState) Task=`4c9d2343-d03b-4b39-8f00-2a0440ea1e4d`::moving from state init -> state preparing >Thread-907::INFO::2013-03-01 13:57:31,463::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-907::INFO::2013-03-01 13:57:31,463::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-907::DEBUG::2013-03-01 13:57:31,463::task::1151::TaskManager.Task::(prepare) Task=`4c9d2343-d03b-4b39-8f00-2a0440ea1e4d`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-907::DEBUG::2013-03-01 13:57:31,464::task::568::TaskManager.Task::(_updateState) Task=`4c9d2343-d03b-4b39-8f00-2a0440ea1e4d`::moving from state preparing -> state finished >Thread-907::DEBUG::2013-03-01 13:57:31,464::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-907::DEBUG::2013-03-01 13:57:31,464::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-907::DEBUG::2013-03-01 13:57:31,464::task::957::TaskManager.Task::(_decref) Task=`4c9d2343-d03b-4b39-8f00-2a0440ea1e4d`::ref 0 aborting False >Thread-908::DEBUG::2013-03-01 13:57:31,501::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-908::DEBUG::2013-03-01 13:57:31,501::task::568::TaskManager.Task::(_updateState) Task=`8c41c3be-894d-48ae-a645-3714ac37bca3`::moving from state init -> state preparing >Thread-908::INFO::2013-03-01 13:57:31,502::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-908::DEBUG::2013-03-01 13:57:31,504::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-908::INFO::2013-03-01 13:57:31,555::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-908::DEBUG::2013-03-01 13:57:31,556::task::1151::TaskManager.Task::(prepare) Task=`8c41c3be-894d-48ae-a645-3714ac37bca3`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-908::DEBUG::2013-03-01 13:57:31,556::task::568::TaskManager.Task::(_updateState) Task=`8c41c3be-894d-48ae-a645-3714ac37bca3`::moving from state preparing -> state finished >Thread-908::DEBUG::2013-03-01 13:57:31,556::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-908::DEBUG::2013-03-01 13:57:31,557::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-908::DEBUG::2013-03-01 13:57:31,557::task::957::TaskManager.Task::(_decref) Task=`8c41c3be-894d-48ae-a645-3714ac37bca3`::ref 0 aborting False >Thread-909::DEBUG::2013-03-01 13:57:31,589::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-909::DEBUG::2013-03-01 13:57:31,590::task::568::TaskManager.Task::(_updateState) Task=`496d08dc-daf0-47c3-8b73-b06db239bebf`::moving from state init -> state preparing >Thread-909::INFO::2013-03-01 13:57:31,590::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', hostID=1, scsiKey='56be65b1-c08c-4688-bc80-a72136fefb12', msdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', masterVersion=1, options=None) >Thread-909::DEBUG::2013-03-01 13:57:31,591::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`f122896d-b00f-4b6e-8b01-741753b0d8cb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-909::DEBUG::2013-03-01 13:57:31,591::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-909::DEBUG::2013-03-01 13:57:31,591::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-909::DEBUG::2013-03-01 13:57:31,592::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`f122896d-b00f-4b6e-8b01-741753b0d8cb`::Granted request >Thread-909::INFO::2013-03-01 13:57:31,592::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 56be65b1-c08c-4688-bc80-a72136fefb12 with master domain: ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (ver = 1) >Thread-909::DEBUG::2013-03-01 13:57:31,593::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:31,593::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:31,594::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:31,594::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:31,594::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:31,595::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:31,595::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-909::DEBUG::2013-03-01 13:57:31,595::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-909::DEBUG::2013-03-01 13:57:31,596::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-909::DEBUG::2013-03-01 13:57:31,596::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-909::DEBUG::2013-03-01 13:57:31,596::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-909::DEBUG::2013-03-01 13:57:31,611::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-909::DEBUG::2013-03-01 13:57:31,612::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:31,614::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:32,619::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:32,622::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:32,625::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:32,628::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:32,631::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2013-03-01 13:57:33,635::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-909::DEBUG::2013-03-01 13:57:35,638::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-909::DEBUG::2013-03-01 13:57:36,704::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-909::DEBUG::2013-03-01 13:57:36,704::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,705::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,705::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,705::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,706::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,706::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,706::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-909::DEBUG::2013-03-01 13:57:36,707::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:36,708::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-909::DEBUG::2013-03-01 13:57:36,943::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-909::WARNING::2013-03-01 13:57:36,944::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-909::DEBUG::2013-03-01 13:57:36,945::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-919::DEBUG::2013-03-01 13:57:36,989::task::568::TaskManager.Task::(_updateState) Task=`f16eba25-8c98-46c3-b7b1-9523bd6e6a62`::moving from state init -> state preparing >Thread-919::INFO::2013-03-01 13:57:36,991::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-919::INFO::2013-03-01 13:57:36,992::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-919::DEBUG::2013-03-01 13:57:36,993::task::1151::TaskManager.Task::(prepare) Task=`f16eba25-8c98-46c3-b7b1-9523bd6e6a62`::finished: {} >Thread-919::DEBUG::2013-03-01 13:57:36,995::task::568::TaskManager.Task::(_updateState) Task=`f16eba25-8c98-46c3-b7b1-9523bd6e6a62`::moving from state preparing -> state finished >Thread-919::DEBUG::2013-03-01 13:57:36,997::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-909::DEBUG::2013-03-01 13:57:36,998::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-909::DEBUG::2013-03-01 13:57:36,999::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-919::DEBUG::2013-03-01 13:57:36,999::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-919::DEBUG::2013-03-01 13:57:37,001::task::957::TaskManager.Task::(_decref) Task=`f16eba25-8c98-46c3-b7b1-9523bd6e6a62`::ref 0 aborting False >Thread-909::DEBUG::2013-03-01 13:57:37,007::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a83caeddc65920bd1f7693bd211f4306492f1fe4'] >Thread-909::DEBUG::2013-03-01 13:57:37,010::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-909::WARNING::2013-03-01 13:57:37,010::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-909::WARNING::2013-03-01 13:57:37,011::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-909::DEBUG::2013-03-01 13:57:37,011::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c verified, version 1 >Thread-909::DEBUG::2013-03-01 13:57:37,011::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-909::DEBUG::2013-03-01 13:57:37,012::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-909::DEBUG::2013-03-01 13:57:37,015::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a83caeddc65920bd1f7693bd211f4306492f1fe4'] >Thread-909::DEBUG::2013-03-01 13:57:37,016::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` started monitoring domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >Thread-928::DEBUG::2013-03-01 13:57:37,016::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-909::DEBUG::2013-03-01 13:57:37,018::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-909::DEBUG::2013-03-01 13:57:37,023::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-909::DEBUG::2013-03-01 13:57:37,031::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-928::INFO::2013-03-01 13:57:37,058::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >Thread-928::DEBUG::2013-03-01 13:57:37,059::clusterlock::191::SANLock::(acquireHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1) >Thread-909::DEBUG::2013-03-01 13:57:37,229::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-909::DEBUG::2013-03-01 13:57:37,229::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-909::INFO::2013-03-01 13:57:37,282::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-909::INFO::2013-03-01 13:57:37,283::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c to /rhev/data-center/56be65b1-c08c-4688-bc80-a72136fefb12/mastersd >Thread-909::DEBUG::2013-03-01 13:57:37,283::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-909::DEBUG::2013-03-01 13:57:37,284::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-909::DEBUG::2013-03-01 13:57:37,284::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-909::DEBUG::2013-03-01 13:57:37,284::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-909::INFO::2013-03-01 13:57:37,284::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-909::DEBUG::2013-03-01 13:57:37,285::task::1151::TaskManager.Task::(prepare) Task=`496d08dc-daf0-47c3-8b73-b06db239bebf`::finished: True >Thread-909::DEBUG::2013-03-01 13:57:37,285::task::568::TaskManager.Task::(_updateState) Task=`496d08dc-daf0-47c3-8b73-b06db239bebf`::moving from state preparing -> state finished >Thread-909::DEBUG::2013-03-01 13:57:37,285::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-909::DEBUG::2013-03-01 13:57:37,286::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-909::DEBUG::2013-03-01 13:57:37,286::task::957::TaskManager.Task::(_decref) Task=`496d08dc-daf0-47c3-8b73-b06db239bebf`::ref 0 aborting False >Thread-954::DEBUG::2013-03-01 13:57:37,376::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-954::DEBUG::2013-03-01 13:57:37,377::task::568::TaskManager.Task::(_updateState) Task=`c620147a-d106-4aa1-bdf5-58a2ea80ec00`::moving from state init -> state preparing >Thread-954::INFO::2013-03-01 13:57:37,377::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-954::INFO::2013-03-01 13:57:37,378::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-954::DEBUG::2013-03-01 13:57:37,378::task::1151::TaskManager.Task::(prepare) Task=`c620147a-d106-4aa1-bdf5-58a2ea80ec00`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-954::DEBUG::2013-03-01 13:57:37,378::task::568::TaskManager.Task::(_updateState) Task=`c620147a-d106-4aa1-bdf5-58a2ea80ec00`::moving from state preparing -> state finished >Thread-954::DEBUG::2013-03-01 13:57:37,378::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-954::DEBUG::2013-03-01 13:57:37,379::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-954::DEBUG::2013-03-01 13:57:37,379::task::957::TaskManager.Task::(_decref) Task=`c620147a-d106-4aa1-bdf5-58a2ea80ec00`::ref 0 aborting False >Thread-955::DEBUG::2013-03-01 13:57:37,446::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-955::DEBUG::2013-03-01 13:57:37,447::task::568::TaskManager.Task::(_updateState) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::moving from state init -> state preparing >Thread-955::INFO::2013-03-01 13:57:37,447::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-955::DEBUG::2013-03-01 13:57:37,448::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`96bb8cc3-3ad9-41b3-ab42-59123ef8d405`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-955::DEBUG::2013-03-01 13:57:37,448::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-955::DEBUG::2013-03-01 13:57:37,448::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-955::DEBUG::2013-03-01 13:57:37,449::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`96bb8cc3-3ad9-41b3-ab42-59123ef8d405`::Granted request >Thread-955::DEBUG::2013-03-01 13:57:37,449::task::794::TaskManager.Task::(resourceAcquired) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-955::DEBUG::2013-03-01 13:57:37,449::task::957::TaskManager.Task::(_decref) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::ref 1 aborting False >Thread-955::INFO::2013-03-01 13:57:37,450::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-955::DEBUG::2013-03-01 13:57:37,450::task::1146::TaskManager.Task::(prepare) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::Prepare: 1 jobs exist, move to acquiring >Thread-955::DEBUG::2013-03-01 13:57:37,450::task::568::TaskManager.Task::(_updateState) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::moving from state preparing -> state acquiring >Thread-955::DEBUG::2013-03-01 13:57:37,450::task::568::TaskManager.Task::(_updateState) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::moving from state acquiring -> state queued >Thread-955::DEBUG::2013-03-01 13:57:37,451::taskManager::50::TaskManager::(_queueTask) queuing task: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-955::DEBUG::2013-03-01 13:57:37,451::taskManager::56::TaskManager::(_queueTask) task queued: d04a8954-3853-4139-b943-52c1a9fed7bf >5851c941-31b5-4300-93df-0a457e738480::DEBUG::2013-03-01 13:57:37,451::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-955::DEBUG::2013-03-01 13:57:37,452::task::1148::TaskManager.Task::(prepare) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::returning >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,453::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: d04a8954-3853-4139-b943-52c1a9fed7bf running: <bound method Task.commit of <storage.task.Task instance at 0x7fbb6812bb90>> with: None >Thread-955::DEBUG::2013-03-01 13:57:37,453::task::957::TaskManager.Task::(_decref) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::ref 0 aborting False >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,454::task::1159::TaskManager.Task::(commit) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::committing task: d04a8954-3853-4139-b943-52c1a9fed7bf >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,456::task::568::TaskManager.Task::(_updateState) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::moving from state queued -> state running >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,457::task::872::TaskManager.Task::(_runJobs) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fbb780c4f50>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,457::task::304::TaskManager.Task::(run) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fbb780c4f50>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,457::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,458::misc::1055::SamplingMethod::(__call__) Got in to sampling method >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,462::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a83caeddc65920bd1f7693bd211f4306492f1fe4'] >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,462::misc::1063::SamplingMethod::(__call__) Returning last result >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:37,466::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a83caeddc65920bd1f7693bd211f4306492f1fe4'] >d04a8954-3853-4139-b943-52c1a9fed7bf::INFO::2013-03-01 13:57:37,466::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >Thread-956::DEBUG::2013-03-01 13:57:38,485::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-956::DEBUG::2013-03-01 13:57:38,486::task::568::TaskManager.Task::(_updateState) Task=`ce6458a9-22a7-4ab4-a993-d59e4b212232`::moving from state init -> state preparing >Thread-956::INFO::2013-03-01 13:57:38,486::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-956::DEBUG::2013-03-01 13:57:38,486::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-956::DEBUG::2013-03-01 13:57:38,486::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-956::INFO::2013-03-01 13:57:38,487::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-956::DEBUG::2013-03-01 13:57:38,487::task::1151::TaskManager.Task::(prepare) Task=`ce6458a9-22a7-4ab4-a993-d59e4b212232`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-956::DEBUG::2013-03-01 13:57:38,487::task::568::TaskManager.Task::(_updateState) Task=`ce6458a9-22a7-4ab4-a993-d59e4b212232`::moving from state preparing -> state finished >Thread-956::DEBUG::2013-03-01 13:57:38,487::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-956::DEBUG::2013-03-01 13:57:38,488::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-956::DEBUG::2013-03-01 13:57:38,488::task::957::TaskManager.Task::(_decref) Task=`ce6458a9-22a7-4ab4-a993-d59e4b212232`::ref 0 aborting False >Thread-957::DEBUG::2013-03-01 13:57:39,519::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-957::DEBUG::2013-03-01 13:57:39,519::task::568::TaskManager.Task::(_updateState) Task=`865e39eb-8e0f-4e1f-a78a-22fdda847db6`::moving from state init -> state preparing >Thread-957::INFO::2013-03-01 13:57:39,519::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-957::DEBUG::2013-03-01 13:57:39,520::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-957::DEBUG::2013-03-01 13:57:39,520::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-957::INFO::2013-03-01 13:57:39,520::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-957::DEBUG::2013-03-01 13:57:39,520::task::1151::TaskManager.Task::(prepare) Task=`865e39eb-8e0f-4e1f-a78a-22fdda847db6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-957::DEBUG::2013-03-01 13:57:39,521::task::568::TaskManager.Task::(_updateState) Task=`865e39eb-8e0f-4e1f-a78a-22fdda847db6`::moving from state preparing -> state finished >Thread-957::DEBUG::2013-03-01 13:57:39,521::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-957::DEBUG::2013-03-01 13:57:39,521::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-957::DEBUG::2013-03-01 13:57:39,521::task::957::TaskManager.Task::(_decref) Task=`865e39eb-8e0f-4e1f-a78a-22fdda847db6`::ref 0 aborting False >Thread-959::DEBUG::2013-03-01 13:57:40,551::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-959::DEBUG::2013-03-01 13:57:40,552::task::568::TaskManager.Task::(_updateState) Task=`b9f48bf2-6dc5-48db-82cc-204b0cfa9791`::moving from state init -> state preparing >Thread-959::INFO::2013-03-01 13:57:40,552::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-959::DEBUG::2013-03-01 13:57:40,552::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-959::DEBUG::2013-03-01 13:57:40,552::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-959::INFO::2013-03-01 13:57:40,553::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-959::DEBUG::2013-03-01 13:57:40,553::task::1151::TaskManager.Task::(prepare) Task=`b9f48bf2-6dc5-48db-82cc-204b0cfa9791`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-959::DEBUG::2013-03-01 13:57:40,553::task::568::TaskManager.Task::(_updateState) Task=`b9f48bf2-6dc5-48db-82cc-204b0cfa9791`::moving from state preparing -> state finished >Thread-959::DEBUG::2013-03-01 13:57:40,553::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-959::DEBUG::2013-03-01 13:57:40,554::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-959::DEBUG::2013-03-01 13:57:40,554::task::957::TaskManager.Task::(_decref) Task=`b9f48bf2-6dc5-48db-82cc-204b0cfa9791`::ref 0 aborting False >Thread-960::DEBUG::2013-03-01 13:57:41,584::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-960::DEBUG::2013-03-01 13:57:41,584::task::568::TaskManager.Task::(_updateState) Task=`b68dc833-f1c0-4ec2-afae-9c688e4f5c70`::moving from state init -> state preparing >Thread-960::INFO::2013-03-01 13:57:41,584::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-960::DEBUG::2013-03-01 13:57:41,585::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-960::DEBUG::2013-03-01 13:57:41,585::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-960::INFO::2013-03-01 13:57:41,585::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-960::DEBUG::2013-03-01 13:57:41,585::task::1151::TaskManager.Task::(prepare) Task=`b68dc833-f1c0-4ec2-afae-9c688e4f5c70`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-960::DEBUG::2013-03-01 13:57:41,586::task::568::TaskManager.Task::(_updateState) Task=`b68dc833-f1c0-4ec2-afae-9c688e4f5c70`::moving from state preparing -> state finished >Thread-960::DEBUG::2013-03-01 13:57:41,586::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-960::DEBUG::2013-03-01 13:57:41,586::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-960::DEBUG::2013-03-01 13:57:41,586::task::957::TaskManager.Task::(_decref) Task=`b68dc833-f1c0-4ec2-afae-9c688e4f5c70`::ref 0 aborting False >Thread-961::DEBUG::2013-03-01 13:57:42,617::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-961::DEBUG::2013-03-01 13:57:42,617::task::568::TaskManager.Task::(_updateState) Task=`907f1a96-5599-422e-b70d-7e28bf699fc1`::moving from state init -> state preparing >Thread-961::INFO::2013-03-01 13:57:42,618::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-961::DEBUG::2013-03-01 13:57:42,618::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-961::DEBUG::2013-03-01 13:57:42,618::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-961::INFO::2013-03-01 13:57:42,618::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-961::DEBUG::2013-03-01 13:57:42,619::task::1151::TaskManager.Task::(prepare) Task=`907f1a96-5599-422e-b70d-7e28bf699fc1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-961::DEBUG::2013-03-01 13:57:42,619::task::568::TaskManager.Task::(_updateState) Task=`907f1a96-5599-422e-b70d-7e28bf699fc1`::moving from state preparing -> state finished >Thread-961::DEBUG::2013-03-01 13:57:42,619::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-961::DEBUG::2013-03-01 13:57:42,619::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-961::DEBUG::2013-03-01 13:57:42,619::task::957::TaskManager.Task::(_decref) Task=`907f1a96-5599-422e-b70d-7e28bf699fc1`::ref 0 aborting False >Thread-963::DEBUG::2013-03-01 13:57:43,647::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-963::DEBUG::2013-03-01 13:57:43,648::task::568::TaskManager.Task::(_updateState) Task=`8eaff683-899f-40eb-90bb-eb99d6c37ae3`::moving from state init -> state preparing >Thread-963::INFO::2013-03-01 13:57:43,648::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-963::DEBUG::2013-03-01 13:57:43,648::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-963::DEBUG::2013-03-01 13:57:43,649::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-963::INFO::2013-03-01 13:57:43,649::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-963::DEBUG::2013-03-01 13:57:43,649::task::1151::TaskManager.Task::(prepare) Task=`8eaff683-899f-40eb-90bb-eb99d6c37ae3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-963::DEBUG::2013-03-01 13:57:43,649::task::568::TaskManager.Task::(_updateState) Task=`8eaff683-899f-40eb-90bb-eb99d6c37ae3`::moving from state preparing -> state finished >Thread-963::DEBUG::2013-03-01 13:57:43,649::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-963::DEBUG::2013-03-01 13:57:43,650::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-963::DEBUG::2013-03-01 13:57:43,650::task::957::TaskManager.Task::(_decref) Task=`8eaff683-899f-40eb-90bb-eb99d6c37ae3`::ref 0 aborting False >Thread-964::DEBUG::2013-03-01 13:57:44,678::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-964::DEBUG::2013-03-01 13:57:44,679::task::568::TaskManager.Task::(_updateState) Task=`71f25e10-e8c0-4e69-ad11-6ba936917583`::moving from state init -> state preparing >Thread-964::INFO::2013-03-01 13:57:44,679::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-964::DEBUG::2013-03-01 13:57:44,679::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-964::DEBUG::2013-03-01 13:57:44,680::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-964::INFO::2013-03-01 13:57:44,680::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-964::DEBUG::2013-03-01 13:57:44,680::task::1151::TaskManager.Task::(prepare) Task=`71f25e10-e8c0-4e69-ad11-6ba936917583`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-964::DEBUG::2013-03-01 13:57:44,680::task::568::TaskManager.Task::(_updateState) Task=`71f25e10-e8c0-4e69-ad11-6ba936917583`::moving from state preparing -> state finished >Thread-964::DEBUG::2013-03-01 13:57:44,681::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-964::DEBUG::2013-03-01 13:57:44,681::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-964::DEBUG::2013-03-01 13:57:44,681::task::957::TaskManager.Task::(_decref) Task=`71f25e10-e8c0-4e69-ad11-6ba936917583`::ref 0 aborting False >Thread-965::DEBUG::2013-03-01 13:57:45,710::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-965::DEBUG::2013-03-01 13:57:45,710::task::568::TaskManager.Task::(_updateState) Task=`101986c7-f32f-42f2-ab12-f6c6278caa1c`::moving from state init -> state preparing >Thread-965::INFO::2013-03-01 13:57:45,710::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-965::DEBUG::2013-03-01 13:57:45,710::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-965::DEBUG::2013-03-01 13:57:45,711::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-965::INFO::2013-03-01 13:57:45,711::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-965::DEBUG::2013-03-01 13:57:45,711::task::1151::TaskManager.Task::(prepare) Task=`101986c7-f32f-42f2-ab12-f6c6278caa1c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-965::DEBUG::2013-03-01 13:57:45,711::task::568::TaskManager.Task::(_updateState) Task=`101986c7-f32f-42f2-ab12-f6c6278caa1c`::moving from state preparing -> state finished >Thread-965::DEBUG::2013-03-01 13:57:45,712::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-965::DEBUG::2013-03-01 13:57:45,712::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-965::DEBUG::2013-03-01 13:57:45,712::task::957::TaskManager.Task::(_decref) Task=`101986c7-f32f-42f2-ab12-f6c6278caa1c`::ref 0 aborting False >Thread-967::DEBUG::2013-03-01 13:57:46,740::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-967::DEBUG::2013-03-01 13:57:46,741::task::568::TaskManager.Task::(_updateState) Task=`fb285417-a967-49f3-a648-ff79a124e4b9`::moving from state init -> state preparing >Thread-967::INFO::2013-03-01 13:57:46,768::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-967::DEBUG::2013-03-01 13:57:46,768::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-967::DEBUG::2013-03-01 13:57:46,768::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-967::INFO::2013-03-01 13:57:46,768::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-967::DEBUG::2013-03-01 13:57:46,768::task::1151::TaskManager.Task::(prepare) Task=`fb285417-a967-49f3-a648-ff79a124e4b9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-967::DEBUG::2013-03-01 13:57:46,769::task::568::TaskManager.Task::(_updateState) Task=`fb285417-a967-49f3-a648-ff79a124e4b9`::moving from state preparing -> state finished >Thread-967::DEBUG::2013-03-01 13:57:46,769::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-967::DEBUG::2013-03-01 13:57:46,769::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-967::DEBUG::2013-03-01 13:57:46,769::task::957::TaskManager.Task::(_decref) Task=`fb285417-a967-49f3-a648-ff79a124e4b9`::ref 0 aborting False >Thread-968::DEBUG::2013-03-01 13:57:47,798::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-968::DEBUG::2013-03-01 13:57:47,798::task::568::TaskManager.Task::(_updateState) Task=`a9953dbc-cbf9-4fff-aa1e-2d3ee55277c2`::moving from state init -> state preparing >Thread-968::INFO::2013-03-01 13:57:47,798::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-968::DEBUG::2013-03-01 13:57:47,799::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-968::DEBUG::2013-03-01 13:57:47,799::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-968::INFO::2013-03-01 13:57:47,799::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-968::DEBUG::2013-03-01 13:57:47,799::task::1151::TaskManager.Task::(prepare) Task=`a9953dbc-cbf9-4fff-aa1e-2d3ee55277c2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-968::DEBUG::2013-03-01 13:57:47,800::task::568::TaskManager.Task::(_updateState) Task=`a9953dbc-cbf9-4fff-aa1e-2d3ee55277c2`::moving from state preparing -> state finished >Thread-968::DEBUG::2013-03-01 13:57:47,800::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-968::DEBUG::2013-03-01 13:57:47,800::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-968::DEBUG::2013-03-01 13:57:47,800::task::957::TaskManager.Task::(_decref) Task=`a9953dbc-cbf9-4fff-aa1e-2d3ee55277c2`::ref 0 aborting False >Thread-969::DEBUG::2013-03-01 13:57:48,829::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-969::DEBUG::2013-03-01 13:57:48,829::task::568::TaskManager.Task::(_updateState) Task=`f046c8df-b827-4627-b87b-497926071cf6`::moving from state init -> state preparing >Thread-969::INFO::2013-03-01 13:57:48,829::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-969::DEBUG::2013-03-01 13:57:48,830::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-969::DEBUG::2013-03-01 13:57:48,830::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-969::INFO::2013-03-01 13:57:48,830::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-969::DEBUG::2013-03-01 13:57:48,830::task::1151::TaskManager.Task::(prepare) Task=`f046c8df-b827-4627-b87b-497926071cf6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-969::DEBUG::2013-03-01 13:57:48,831::task::568::TaskManager.Task::(_updateState) Task=`f046c8df-b827-4627-b87b-497926071cf6`::moving from state preparing -> state finished >Thread-969::DEBUG::2013-03-01 13:57:48,831::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-969::DEBUG::2013-03-01 13:57:48,831::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-969::DEBUG::2013-03-01 13:57:48,831::task::957::TaskManager.Task::(_decref) Task=`f046c8df-b827-4627-b87b-497926071cf6`::ref 0 aborting False >Thread-971::DEBUG::2013-03-01 13:57:49,863::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-971::DEBUG::2013-03-01 13:57:49,863::task::568::TaskManager.Task::(_updateState) Task=`e6709e0d-9490-470a-b51e-b4d1e1906b43`::moving from state init -> state preparing >Thread-971::INFO::2013-03-01 13:57:49,864::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-971::DEBUG::2013-03-01 13:57:49,864::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-971::DEBUG::2013-03-01 13:57:49,864::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-971::INFO::2013-03-01 13:57:49,864::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-971::DEBUG::2013-03-01 13:57:49,865::task::1151::TaskManager.Task::(prepare) Task=`e6709e0d-9490-470a-b51e-b4d1e1906b43`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-971::DEBUG::2013-03-01 13:57:49,865::task::568::TaskManager.Task::(_updateState) Task=`e6709e0d-9490-470a-b51e-b4d1e1906b43`::moving from state preparing -> state finished >Thread-971::DEBUG::2013-03-01 13:57:49,865::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-971::DEBUG::2013-03-01 13:57:49,865::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-971::DEBUG::2013-03-01 13:57:49,865::task::957::TaskManager.Task::(_decref) Task=`e6709e0d-9490-470a-b51e-b4d1e1906b43`::ref 0 aborting False >Thread-972::DEBUG::2013-03-01 13:57:50,894::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-972::DEBUG::2013-03-01 13:57:50,894::task::568::TaskManager.Task::(_updateState) Task=`9bc557e8-d54b-4658-b50a-7dc732e10611`::moving from state init -> state preparing >Thread-972::INFO::2013-03-01 13:57:50,894::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-972::DEBUG::2013-03-01 13:57:50,895::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-972::DEBUG::2013-03-01 13:57:50,895::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-972::INFO::2013-03-01 13:57:50,895::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-972::DEBUG::2013-03-01 13:57:50,895::task::1151::TaskManager.Task::(prepare) Task=`9bc557e8-d54b-4658-b50a-7dc732e10611`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-972::DEBUG::2013-03-01 13:57:50,895::task::568::TaskManager.Task::(_updateState) Task=`9bc557e8-d54b-4658-b50a-7dc732e10611`::moving from state preparing -> state finished >Thread-972::DEBUG::2013-03-01 13:57:50,896::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-972::DEBUG::2013-03-01 13:57:50,896::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-972::DEBUG::2013-03-01 13:57:50,896::task::957::TaskManager.Task::(_decref) Task=`9bc557e8-d54b-4658-b50a-7dc732e10611`::ref 0 aborting False >Thread-973::DEBUG::2013-03-01 13:57:51,924::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-973::DEBUG::2013-03-01 13:57:51,925::task::568::TaskManager.Task::(_updateState) Task=`e79c2e7e-6b58-4142-9cd3-c2e6c339b8ac`::moving from state init -> state preparing >Thread-973::INFO::2013-03-01 13:57:51,925::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-973::DEBUG::2013-03-01 13:57:51,925::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-973::DEBUG::2013-03-01 13:57:51,925::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-973::INFO::2013-03-01 13:57:51,926::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-973::DEBUG::2013-03-01 13:57:51,926::task::1151::TaskManager.Task::(prepare) Task=`e79c2e7e-6b58-4142-9cd3-c2e6c339b8ac`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-973::DEBUG::2013-03-01 13:57:51,926::task::568::TaskManager.Task::(_updateState) Task=`e79c2e7e-6b58-4142-9cd3-c2e6c339b8ac`::moving from state preparing -> state finished >Thread-973::DEBUG::2013-03-01 13:57:51,926::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-973::DEBUG::2013-03-01 13:57:51,927::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-973::DEBUG::2013-03-01 13:57:51,927::task::957::TaskManager.Task::(_decref) Task=`e79c2e7e-6b58-4142-9cd3-c2e6c339b8ac`::ref 0 aborting False >Thread-974::DEBUG::2013-03-01 13:57:52,260::task::568::TaskManager.Task::(_updateState) Task=`f841d055-3d87-4bbf-8925-19ed2fd0ada7`::moving from state init -> state preparing >Thread-974::INFO::2013-03-01 13:57:52,260::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-974::INFO::2013-03-01 13:57:52,260::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00275707244873', 'lastCheck': '15.2', 'code': 0, 'valid': True}} >Thread-974::DEBUG::2013-03-01 13:57:52,261::task::1151::TaskManager.Task::(prepare) Task=`f841d055-3d87-4bbf-8925-19ed2fd0ada7`::finished: {'ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': {'delay': '0.00275707244873', 'lastCheck': '15.2', 'code': 0, 'valid': True}} >Thread-974::DEBUG::2013-03-01 13:57:52,261::task::568::TaskManager.Task::(_updateState) Task=`f841d055-3d87-4bbf-8925-19ed2fd0ada7`::moving from state preparing -> state finished >Thread-974::DEBUG::2013-03-01 13:57:52,261::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-974::DEBUG::2013-03-01 13:57:52,261::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-974::DEBUG::2013-03-01 13:57:52,262::task::957::TaskManager.Task::(_decref) Task=`f841d055-3d87-4bbf-8925-19ed2fd0ada7`::ref 0 aborting False >Thread-976::DEBUG::2013-03-01 13:57:52,955::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-976::DEBUG::2013-03-01 13:57:52,956::task::568::TaskManager.Task::(_updateState) Task=`a2f2c09c-98e3-44cf-88ca-deccf65de300`::moving from state init -> state preparing >Thread-976::INFO::2013-03-01 13:57:52,956::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-976::DEBUG::2013-03-01 13:57:52,956::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-976::DEBUG::2013-03-01 13:57:52,956::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-976::INFO::2013-03-01 13:57:52,957::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-976::DEBUG::2013-03-01 13:57:52,957::task::1151::TaskManager.Task::(prepare) Task=`a2f2c09c-98e3-44cf-88ca-deccf65de300`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-976::DEBUG::2013-03-01 13:57:52,957::task::568::TaskManager.Task::(_updateState) Task=`a2f2c09c-98e3-44cf-88ca-deccf65de300`::moving from state preparing -> state finished >Thread-976::DEBUG::2013-03-01 13:57:52,957::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-976::DEBUG::2013-03-01 13:57:52,958::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-976::DEBUG::2013-03-01 13:57:52,958::task::957::TaskManager.Task::(_decref) Task=`a2f2c09c-98e3-44cf-88ca-deccf65de300`::ref 0 aborting False >Thread-977::DEBUG::2013-03-01 13:57:54,049::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-977::DEBUG::2013-03-01 13:57:54,054::task::568::TaskManager.Task::(_updateState) Task=`650616ab-ebef-47db-8a99-7f2f6734efa8`::moving from state init -> state preparing >Thread-977::INFO::2013-03-01 13:57:54,057::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-977::DEBUG::2013-03-01 13:57:54,059::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-977::DEBUG::2013-03-01 13:57:54,061::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-977::INFO::2013-03-01 13:57:54,064::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-977::DEBUG::2013-03-01 13:57:54,067::task::1151::TaskManager.Task::(prepare) Task=`650616ab-ebef-47db-8a99-7f2f6734efa8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-977::DEBUG::2013-03-01 13:57:54,069::task::568::TaskManager.Task::(_updateState) Task=`650616ab-ebef-47db-8a99-7f2f6734efa8`::moving from state preparing -> state finished >Thread-977::DEBUG::2013-03-01 13:57:54,072::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-977::DEBUG::2013-03-01 13:57:54,074::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-977::DEBUG::2013-03-01 13:57:54,077::task::957::TaskManager.Task::(_decref) Task=`650616ab-ebef-47db-8a99-7f2f6734efa8`::ref 0 aborting False >Thread-978::DEBUG::2013-03-01 13:57:55,178::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-978::DEBUG::2013-03-01 13:57:55,183::task::568::TaskManager.Task::(_updateState) Task=`3c684752-a584-440c-80de-5e517fa7dbc1`::moving from state init -> state preparing >Thread-978::INFO::2013-03-01 13:57:55,186::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-978::DEBUG::2013-03-01 13:57:55,189::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-978::DEBUG::2013-03-01 13:57:55,191::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-978::INFO::2013-03-01 13:57:55,194::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-978::DEBUG::2013-03-01 13:57:55,197::task::1151::TaskManager.Task::(prepare) Task=`3c684752-a584-440c-80de-5e517fa7dbc1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-978::DEBUG::2013-03-01 13:57:55,200::task::568::TaskManager.Task::(_updateState) Task=`3c684752-a584-440c-80de-5e517fa7dbc1`::moving from state preparing -> state finished >Thread-978::DEBUG::2013-03-01 13:57:55,203::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-978::DEBUG::2013-03-01 13:57:55,205::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-978::DEBUG::2013-03-01 13:57:55,208::task::957::TaskManager.Task::(_decref) Task=`3c684752-a584-440c-80de-5e517fa7dbc1`::ref 0 aborting False >Thread-980::DEBUG::2013-03-01 13:57:56,245::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-980::DEBUG::2013-03-01 13:57:56,245::task::568::TaskManager.Task::(_updateState) Task=`aa027423-43af-4371-a657-3c734f65eeaa`::moving from state init -> state preparing >Thread-980::INFO::2013-03-01 13:57:56,245::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-980::DEBUG::2013-03-01 13:57:56,246::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-980::DEBUG::2013-03-01 13:57:56,246::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-980::INFO::2013-03-01 13:57:56,246::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-980::DEBUG::2013-03-01 13:57:56,246::task::1151::TaskManager.Task::(prepare) Task=`aa027423-43af-4371-a657-3c734f65eeaa`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-980::DEBUG::2013-03-01 13:57:56,247::task::568::TaskManager.Task::(_updateState) Task=`aa027423-43af-4371-a657-3c734f65eeaa`::moving from state preparing -> state finished >Thread-980::DEBUG::2013-03-01 13:57:56,247::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-980::DEBUG::2013-03-01 13:57:56,247::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-980::DEBUG::2013-03-01 13:57:56,247::task::957::TaskManager.Task::(_decref) Task=`aa027423-43af-4371-a657-3c734f65eeaa`::ref 0 aborting False >Thread-981::DEBUG::2013-03-01 13:57:57,276::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-981::DEBUG::2013-03-01 13:57:57,276::task::568::TaskManager.Task::(_updateState) Task=`9aeddf76-9739-4f15-ad00-a96e420d13c8`::moving from state init -> state preparing >Thread-981::INFO::2013-03-01 13:57:57,276::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-981::DEBUG::2013-03-01 13:57:57,277::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-981::DEBUG::2013-03-01 13:57:57,277::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-981::INFO::2013-03-01 13:57:57,277::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-981::DEBUG::2013-03-01 13:57:57,277::task::1151::TaskManager.Task::(prepare) Task=`9aeddf76-9739-4f15-ad00-a96e420d13c8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-981::DEBUG::2013-03-01 13:57:57,278::task::568::TaskManager.Task::(_updateState) Task=`9aeddf76-9739-4f15-ad00-a96e420d13c8`::moving from state preparing -> state finished >Thread-981::DEBUG::2013-03-01 13:57:57,278::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-981::DEBUG::2013-03-01 13:57:57,278::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-981::DEBUG::2013-03-01 13:57:57,278::task::957::TaskManager.Task::(_decref) Task=`9aeddf76-9739-4f15-ad00-a96e420d13c8`::ref 0 aborting False >Thread-982::DEBUG::2013-03-01 13:57:58,307::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-982::DEBUG::2013-03-01 13:57:58,307::task::568::TaskManager.Task::(_updateState) Task=`53951c31-1656-4941-971d-16101c209088`::moving from state init -> state preparing >Thread-982::INFO::2013-03-01 13:57:58,307::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-982::DEBUG::2013-03-01 13:57:58,308::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-982::DEBUG::2013-03-01 13:57:58,308::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-982::INFO::2013-03-01 13:57:58,308::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-982::DEBUG::2013-03-01 13:57:58,308::task::1151::TaskManager.Task::(prepare) Task=`53951c31-1656-4941-971d-16101c209088`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-982::DEBUG::2013-03-01 13:57:58,309::task::568::TaskManager.Task::(_updateState) Task=`53951c31-1656-4941-971d-16101c209088`::moving from state preparing -> state finished >Thread-982::DEBUG::2013-03-01 13:57:58,309::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-982::DEBUG::2013-03-01 13:57:58,309::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-982::DEBUG::2013-03-01 13:57:58,309::task::957::TaskManager.Task::(_decref) Task=`53951c31-1656-4941-971d-16101c209088`::ref 0 aborting False >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,469::clusterlock::191::SANLock::(acquireHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1) >d04a8954-3853-4139-b943-52c1a9fed7bf::INFO::2013-03-01 13:57:58,471::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,616::clusterlock::248::SANLock::(acquire) Cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully acquired (id: 1) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,617::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,622::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a83caeddc65920bd1f7693bd211f4306492f1fe4'] >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,622::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,623::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,623::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a7f70940cd71b726a34ab6cbf5ac0be9816b0e3d'] >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,700::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,701::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ae7f93f3-1e44-4ec6-8d82-f3f1216aa084`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,701::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,701::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,702::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`ae7f93f3-1e44-4ec6-8d82-f3f1216aa084`::Granted request >d04a8954-3853-4139-b943-52c1a9fed7bf::INFO::2013-03-01 13:57:58,702::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,703::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`55cef892-fb99-4486-a121-79fc57e33a75`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,703::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,703::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,703::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`55cef892-fb99-4486-a121-79fc57e33a75`::Granted request >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,704::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,928::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >d04a8954-3853-4139-b943-52c1a9fed7bf::WARNING::2013-03-01 13:57:58,929::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,930::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,970::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,970::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,974::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a7f70940cd71b726a34ab6cbf5ac0be9816b0e3d'] >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,975::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >d04a8954-3853-4139-b943-52c1a9fed7bf::WARNING::2013-03-01 13:57:58,975::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >d04a8954-3853-4139-b943-52c1a9fed7bf::WARNING::2013-03-01 13:57:58,976::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,976::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,976::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,976::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,977::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,977::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,977::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,977::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,977::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,978::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,978::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,978::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,979::sp::309::Storage.StoragePool::(startSpm) ended. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,980::task::568::TaskManager.Task::(_updateState) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::moving from state running -> state finished >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,980::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>} >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,980::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,980::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,981::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,981::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,981::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,981::task::880::TaskManager.Task::(_runJobs) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::Task.run: exit - success: result >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,981::task::957::TaskManager.Task::(_decref) Task=`d04a8954-3853-4139-b943-52c1a9fed7bf`::ref 0 aborting False >d04a8954-3853-4139-b943-52c1a9fed7bf::DEBUG::2013-03-01 13:57:58,981::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-1000::DEBUG::2013-03-01 13:57:59,338::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1000::DEBUG::2013-03-01 13:57:59,338::task::568::TaskManager.Task::(_updateState) Task=`d223ce64-7b62-4ae2-bff1-3bd092a883dd`::moving from state init -> state preparing >Thread-1000::INFO::2013-03-01 13:57:59,339::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-1000::DEBUG::2013-03-01 13:57:59,339::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-1000::DEBUG::2013-03-01 13:57:59,339::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'} >Thread-1000::INFO::2013-03-01 13:57:59,340::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-1000::DEBUG::2013-03-01 13:57:59,340::task::1151::TaskManager.Task::(prepare) Task=`d223ce64-7b62-4ae2-bff1-3bd092a883dd`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd04a8954-3853-4139-b943-52c1a9fed7bf'}} >Thread-1000::DEBUG::2013-03-01 13:57:59,340::task::568::TaskManager.Task::(_updateState) Task=`d223ce64-7b62-4ae2-bff1-3bd092a883dd`::moving from state preparing -> state finished >Thread-1000::DEBUG::2013-03-01 13:57:59,341::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1000::DEBUG::2013-03-01 13:57:59,341::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1000::DEBUG::2013-03-01 13:57:59,341::task::957::TaskManager.Task::(_decref) Task=`d223ce64-7b62-4ae2-bff1-3bd092a883dd`::ref 0 aborting False >Thread-1001::DEBUG::2013-03-01 13:57:59,367::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1001::DEBUG::2013-03-01 13:57:59,367::task::568::TaskManager.Task::(_updateState) Task=`b645a3c4-a552-4340-976b-35ed4d4ce3d2`::moving from state init -> state preparing >Thread-1001::INFO::2013-03-01 13:57:59,367::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-1001::INFO::2013-03-01 13:57:59,368::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-1001::DEBUG::2013-03-01 13:57:59,368::task::1151::TaskManager.Task::(prepare) Task=`b645a3c4-a552-4340-976b-35ed4d4ce3d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-1001::DEBUG::2013-03-01 13:57:59,368::task::568::TaskManager.Task::(_updateState) Task=`b645a3c4-a552-4340-976b-35ed4d4ce3d2`::moving from state preparing -> state finished >Thread-1001::DEBUG::2013-03-01 13:57:59,369::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1001::DEBUG::2013-03-01 13:57:59,369::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1001::DEBUG::2013-03-01 13:57:59,369::task::957::TaskManager.Task::(_decref) Task=`b645a3c4-a552-4340-976b-35ed4d4ce3d2`::ref 0 aborting False >Thread-1002::DEBUG::2013-03-01 13:57:59,399::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1002::DEBUG::2013-03-01 13:57:59,399::task::568::TaskManager.Task::(_updateState) Task=`c2dc037f-7e0f-4d8a-a13c-89bd411d376b`::moving from state init -> state preparing >Thread-1002::INFO::2013-03-01 13:57:59,399::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='d04a8954-3853-4139-b943-52c1a9fed7bf', spUUID=None, options=None) >Thread-1002::DEBUG::2013-03-01 13:57:59,400::taskManager::161::TaskManager::(clearTask) Entry. taskID: d04a8954-3853-4139-b943-52c1a9fed7bf >Thread-1002::DEBUG::2013-03-01 13:57:59,400::taskManager::166::TaskManager::(clearTask) Return. >Thread-1002::INFO::2013-03-01 13:57:59,400::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-1002::DEBUG::2013-03-01 13:57:59,401::task::1151::TaskManager.Task::(prepare) Task=`c2dc037f-7e0f-4d8a-a13c-89bd411d376b`::finished: None >Thread-1002::DEBUG::2013-03-01 13:57:59,401::task::568::TaskManager.Task::(_updateState) Task=`c2dc037f-7e0f-4d8a-a13c-89bd411d376b`::moving from state preparing -> state finished >Thread-1002::DEBUG::2013-03-01 13:57:59,401::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1002::DEBUG::2013-03-01 13:57:59,401::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1002::DEBUG::2013-03-01 13:57:59,402::task::957::TaskManager.Task::(_decref) Task=`c2dc037f-7e0f-4d8a-a13c-89bd411d376b`::ref 0 aborting False >Thread-1003::DEBUG::2013-03-01 13:57:59,529::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1003::DEBUG::2013-03-01 13:57:59,529::task::568::TaskManager.Task::(_updateState) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::moving from state init -> state preparing >Thread-1003::INFO::2013-03-01 13:57:59,529::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', hostID=1, scsiKey='56be65b1-c08c-4688-bc80-a72136fefb12', options=None) >Thread-1003::INFO::2013-03-01 13:57:59,530::hsm::1042::Storage.HSM::(destroyStoragePool) spUUID=56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-1003::DEBUG::2013-03-01 13:57:59,530::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`327fbe8a-6f10-4b11-9784-6078616fa4ed`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1003::DEBUG::2013-03-01 13:57:59,530::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-1003::DEBUG::2013-03-01 13:57:59,531::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-1003::DEBUG::2013-03-01 13:57:59,531::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`327fbe8a-6f10-4b11-9784-6078616fa4ed`::Granted request >Thread-1003::DEBUG::2013-03-01 13:57:59,532::task::794::TaskManager.Task::(resourceAcquired) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::_resourcesAcquired: Storage.56be65b1-c08c-4688-bc80-a72136fefb12 (exclusive) >Thread-1003::DEBUG::2013-03-01 13:57:59,532::task::957::TaskManager.Task::(_decref) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::ref 1 aborting False >Thread-1003::DEBUG::2013-03-01 13:57:59,532::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`de20dd94-b4c3-4714-a4e4-bec3af79ffd9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1003::DEBUG::2013-03-01 13:57:59,533::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >Thread-1003::DEBUG::2013-03-01 13:57:59,533::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >Thread-1003::DEBUG::2013-03-01 13:57:59,533::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`de20dd94-b4c3-4714-a4e4-bec3af79ffd9`::Granted request >Thread-1003::DEBUG::2013-03-01 13:57:59,534::task::794::TaskManager.Task::(resourceAcquired) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::_resourcesAcquired: Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (exclusive) >Thread-1003::DEBUG::2013-03-01 13:57:59,534::task::957::TaskManager.Task::(_decref) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::ref 1 aborting False >Thread-1003::WARNING::2013-03-01 13:57:59,535::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >Thread-1003::DEBUG::2013-03-01 13:57:59,535::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1003::DEBUG::2013-03-01 13:57:59,535::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1003::DEBUG::2013-03-01 13:57:59,536::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a425a3e90219e94c39931c2398e8b3b7d665b70c'] >Thread-1003::DEBUG::2013-03-01 13:57:59,603::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1003::DEBUG::2013-03-01 13:57:59,604::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-1003::DEBUG::2013-03-01 13:57:59,604::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`bdee7e44-81ba-4658-9a53-c3e386545e30`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1003::DEBUG::2013-03-01 13:57:59,605::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' for lock type 'exclusive' >Thread-1003::DEBUG::2013-03-01 13:57:59,605::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free. Now locking as 'exclusive' (1 active user) >Thread-1003::DEBUG::2013-03-01 13:57:59,605::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12`ReqID=`bdee7e44-81ba-4658-9a53-c3e386545e30`::Granted request >Thread-1003::DEBUG::2013-03-01 13:57:59,606::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-1003::DEBUG::2013-03-01 13:57:59,606::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-1003::DEBUG::2013-03-01 13:57:59,607::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-1003::DEBUG::2013-03-01 13:57:59,607::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-1003::DEBUG::2013-03-01 13:57:59,611::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,614::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,616::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,619::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,622::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,624::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,626::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,628::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,629::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,631::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,634::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,636::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,639::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,641::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,644::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,647::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,649::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,652::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,655::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,657::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,660::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,662::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,665::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,668::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,670::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,673::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,676::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,678::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,681::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,683::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,686::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,689::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,691::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,694::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,697::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,699::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-1003::DEBUG::2013-03-01 13:57:59,699::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1003::DEBUG::2013-03-01 13:57:59,700::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1003::DEBUG::2013-03-01 13:57:59,700::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea12606a5d394150387cda3f943e1bdcdb804d87'] >Thread-1003::DEBUG::2013-03-01 13:57:59,779::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1003::INFO::2013-03-01 13:57:59,780::clusterlock::252::SANLock::(release) Releasing cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-1003::DEBUG::2013-03-01 13:57:59,819::clusterlock::263::SANLock::(release) Cluster lock for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c successfully released >Thread-1003::DEBUG::2013-03-01 13:57:59,819::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1003::DEBUG::2013-03-01 13:57:59,819::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1003::DEBUG::2013-03-01 13:57:59,824::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea12606a5d394150387cda3f943e1bdcdb804d87'] >Thread-928::DEBUG::2013-03-01 13:57:59,825::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-928::INFO::2013-03-01 13:57:59,825::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (id: 1) >Thread-928::DEBUG::2013-03-01 13:58:01,826::clusterlock::206::SANLock::(releaseHostId) Host id for domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c released successfully (id: 1) >Thread-1003::DEBUG::2013-03-01 13:58:01,832::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `56be65b1-c08c-4688-bc80-a72136fefb12` stopped monitoring domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` >Thread-1003::DEBUG::2013-03-01 13:58:01,832::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1003::DEBUG::2013-03-01 13:58:01,832::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `ea6b50ab-6bf1-46b8-bdd7-c762d569c49c` is done >Thread-1003::DEBUG::2013-03-01 13:58:01,837::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=56be65b1-c08c-4688-bc80-a72136fefb12', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea12606a5d394150387cda3f943e1bdcdb804d87'] >Thread-1003::DEBUG::2013-03-01 13:58:01,837::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1003::DEBUG::2013-03-01 13:58:01,838::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1003::DEBUG::2013-03-01 13:58:01,838::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1003::DEBUG::2013-03-01 13:58:01,838::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1003::DEBUG::2013-03-01 13:58:01,838::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4b27eef13f184a08d51d40ee19754e2ac3545a4b'] >Thread-1003::DEBUG::2013-03-01 13:58:01,907::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1003::DEBUG::2013-03-01 13:58:01,908::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1003::DEBUG::2013-03-01 13:58:01,908::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1003::DEBUG::2013-03-01 13:58:01,912::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4b27eef13f184a08d51d40ee19754e2ac3545a4b'] >Thread-1003::DEBUG::2013-03-01 13:58:01,912::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1003::INFO::2013-03-01 13:58:01,913::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 56be65b1-c08c-4688-bc80-a72136fefb12 >Thread-1003::INFO::2013-03-01 13:58:01,913::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-1003::DEBUG::2013-03-01 13:58:01,913::task::1151::TaskManager.Task::(prepare) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::finished: True >Thread-1003::DEBUG::2013-03-01 13:58:01,913::task::568::TaskManager.Task::(_updateState) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::moving from state preparing -> state finished >Thread-1003::DEBUG::2013-03-01 13:58:01,914::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.56be65b1-c08c-4688-bc80-a72136fefb12': < ResourceRef 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', isValid: 'True' obj: 'None'>, 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': < ResourceRef 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', isValid: 'True' obj: 'None'>} >Thread-1003::DEBUG::2013-03-01 13:58:01,914::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1003::DEBUG::2013-03-01 13:58:01,914::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' >Thread-1003::DEBUG::2013-03-01 13:58:01,915::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' (0 active users) >Thread-1003::DEBUG::2013-03-01 13:58:01,915::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12' is free, finding out if anyone is waiting for it. >Thread-1003::DEBUG::2013-03-01 13:58:01,915::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.56be65b1-c08c-4688-bc80-a72136fefb12', Clearing records. >Thread-1003::DEBUG::2013-03-01 13:58:01,915::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >Thread-1003::DEBUG::2013-03-01 13:58:01,916::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >Thread-1003::DEBUG::2013-03-01 13:58:01,916::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >Thread-1003::DEBUG::2013-03-01 13:58:01,916::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >Thread-1003::DEBUG::2013-03-01 13:58:01,916::task::957::TaskManager.Task::(_decref) Task=`18803828-9f4a-447b-b626-aea1fde0fa8a`::ref 0 aborting False >Thread-1005::DEBUG::2013-03-01 13:58:01,961::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1005::DEBUG::2013-03-01 13:58:01,961::task::568::TaskManager.Task::(_updateState) Task=`e350bb9e-72ff-4f96-84d4-11a67313727a`::moving from state init -> state preparing >Thread-1005::INFO::2013-03-01 13:58:01,962::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-1005::DEBUG::2013-03-01 13:58:01,962::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-1005::DEBUG::2013-03-01 13:58:02,001::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1005::DEBUG::2013-03-01 13:58:02,002::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1005::DEBUG::2013-03-01 13:58:02,002::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1005::DEBUG::2013-03-01 13:58:02,002::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1005::DEBUG::2013-03-01 13:58:02,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1005::DEBUG::2013-03-01 13:58:02,023::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1005::DEBUG::2013-03-01 13:58:02,024::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:02,026::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:03,031::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:04,035::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:04,041::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:05,045::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:05,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1005::DEBUG::2013-03-01 13:58:05,052::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1005::DEBUG::2013-03-01 13:58:07,055::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1007::DEBUG::2013-03-01 13:58:07,574::task::568::TaskManager.Task::(_updateState) Task=`979135d5-30a6-480c-a4e5-2d07556672fc`::moving from state init -> state preparing >Thread-1007::INFO::2013-03-01 13:58:07,601::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1007::INFO::2013-03-01 13:58:07,601::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1007::DEBUG::2013-03-01 13:58:07,601::task::1151::TaskManager.Task::(prepare) Task=`979135d5-30a6-480c-a4e5-2d07556672fc`::finished: {} >Thread-1007::DEBUG::2013-03-01 13:58:07,601::task::568::TaskManager.Task::(_updateState) Task=`979135d5-30a6-480c-a4e5-2d07556672fc`::moving from state preparing -> state finished >Thread-1007::DEBUG::2013-03-01 13:58:07,602::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1007::DEBUG::2013-03-01 13:58:07,602::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1007::DEBUG::2013-03-01 13:58:07,602::task::957::TaskManager.Task::(_decref) Task=`979135d5-30a6-480c-a4e5-2d07556672fc`::ref 0 aborting False >Thread-1005::DEBUG::2013-03-01 13:58:08,192::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1005::DEBUG::2013-03-01 13:58:08,192::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1005::DEBUG::2013-03-01 13:58:08,193::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1005::DEBUG::2013-03-01 13:58:08,193::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1005::DEBUG::2013-03-01 13:58:08,193::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1005::DEBUG::2013-03-01 13:58:08,194::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1005::DEBUG::2013-03-01 13:58:08,194::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1005::DEBUG::2013-03-01 13:58:08,194::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1005::INFO::2013-03-01 13:58:08,195::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1005::DEBUG::2013-03-01 13:58:08,195::task::1151::TaskManager.Task::(prepare) Task=`e350bb9e-72ff-4f96-84d4-11a67313727a`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1005::DEBUG::2013-03-01 13:58:08,195::task::568::TaskManager.Task::(_updateState) Task=`e350bb9e-72ff-4f96-84d4-11a67313727a`::moving from state preparing -> state finished >Thread-1005::DEBUG::2013-03-01 13:58:08,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1005::DEBUG::2013-03-01 13:58:08,196::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1005::DEBUG::2013-03-01 13:58:08,196::task::957::TaskManager.Task::(_decref) Task=`e350bb9e-72ff-4f96-84d4-11a67313727a`::ref 0 aborting False >Thread-1009::DEBUG::2013-03-01 13:58:08,230::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1009::DEBUG::2013-03-01 13:58:08,231::task::568::TaskManager.Task::(_updateState) Task=`e1c8df05-a461-494b-a2e7-23537fd65b15`::moving from state init -> state preparing >Thread-1009::INFO::2013-03-01 13:58:08,231::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='56be65b1-c08c-4688-bc80-a72136fefb12', hostID=1, scsiKey='56be65b1-c08c-4688-bc80-a72136fefb12', remove=False, options=None) >Thread-1009::WARNING::2013-03-01 13:58:08,231::hsm::1008::Storage.HSM::(disconnectStoragePool) disconnect sp: 56be65b1-c08c-4688-bc80-a72136fefb12 failed. Known pools {} >Thread-1009::INFO::2013-03-01 13:58:08,237::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-1009::DEBUG::2013-03-01 13:58:08,238::task::1151::TaskManager.Task::(prepare) Task=`e1c8df05-a461-494b-a2e7-23537fd65b15`::finished: None >Thread-1009::DEBUG::2013-03-01 13:58:08,238::task::568::TaskManager.Task::(_updateState) Task=`e1c8df05-a461-494b-a2e7-23537fd65b15`::moving from state preparing -> state finished >Thread-1009::DEBUG::2013-03-01 13:58:08,238::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1009::DEBUG::2013-03-01 13:58:08,238::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1009::DEBUG::2013-03-01 13:58:08,239::task::957::TaskManager.Task::(_decref) Task=`e1c8df05-a461-494b-a2e7-23537fd65b15`::ref 0 aborting False >Thread-1010::DEBUG::2013-03-01 13:58:09,213::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1010::DEBUG::2013-03-01 13:58:09,214::task::568::TaskManager.Task::(_updateState) Task=`8a0a020b-fe54-4a66-bd60-078993814dd4`::moving from state init -> state preparing >Thread-1010::INFO::2013-03-01 13:58:09,214::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-1010::INFO::2013-03-01 13:58:09,215::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1010::DEBUG::2013-03-01 13:58:09,215::task::1151::TaskManager.Task::(prepare) Task=`8a0a020b-fe54-4a66-bd60-078993814dd4`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1010::DEBUG::2013-03-01 13:58:09,215::task::568::TaskManager.Task::(_updateState) Task=`8a0a020b-fe54-4a66-bd60-078993814dd4`::moving from state preparing -> state finished >Thread-1010::DEBUG::2013-03-01 13:58:09,215::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1010::DEBUG::2013-03-01 13:58:09,216::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1010::DEBUG::2013-03-01 13:58:09,216::task::957::TaskManager.Task::(_decref) Task=`8a0a020b-fe54-4a66-bd60-078993814dd4`::ref 0 aborting False >Thread-1011::DEBUG::2013-03-01 13:58:09,247::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1011::DEBUG::2013-03-01 13:58:09,248::task::568::TaskManager.Task::(_updateState) Task=`27845a3c-c39f-4f1f-b08a-dfe18eea4abe`::moving from state init -> state preparing >Thread-1011::INFO::2013-03-01 13:58:09,248::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-1011::DEBUG::2013-03-01 13:58:09,253::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-1011::INFO::2013-03-01 13:58:09,316::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1011::DEBUG::2013-03-01 13:58:09,316::task::1151::TaskManager.Task::(prepare) Task=`27845a3c-c39f-4f1f-b08a-dfe18eea4abe`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1011::DEBUG::2013-03-01 13:58:09,316::task::568::TaskManager.Task::(_updateState) Task=`27845a3c-c39f-4f1f-b08a-dfe18eea4abe`::moving from state preparing -> state finished >Thread-1011::DEBUG::2013-03-01 13:58:09,317::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1011::DEBUG::2013-03-01 13:58:09,317::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1011::DEBUG::2013-03-01 13:58:09,317::task::957::TaskManager.Task::(_decref) Task=`27845a3c-c39f-4f1f-b08a-dfe18eea4abe`::ref 0 aborting False >Thread-1012::DEBUG::2013-03-01 13:58:09,351::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1012::DEBUG::2013-03-01 13:58:09,351::task::568::TaskManager.Task::(_updateState) Task=`c325c407-caa9-4f78-9d3e-e7941e589ef1`::moving from state init -> state preparing >Thread-1012::INFO::2013-03-01 13:58:09,352::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', autoDetach=False, options=None) >Thread-1012::DEBUG::2013-03-01 13:58:09,352::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1012::DEBUG::2013-03-01 13:58:09,352::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1012::DEBUG::2013-03-01 13:58:09,353::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1012::DEBUG::2013-03-01 13:58:09,369::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1012::DEBUG::2013-03-01 13:58:09,369::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:09,372::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:10,376::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:11,381::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:12,385::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:13,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:13,392::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:14,396::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1012::DEBUG::2013-03-01 13:58:16,400::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1012::DEBUG::2013-03-01 13:58:17,486::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1012::DEBUG::2013-03-01 13:58:17,487::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`164c161d-75df-47c0-9e05-96d056b9de99`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1012::DEBUG::2013-03-01 13:58:17,487::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' for lock type 'exclusive' >Thread-1012::DEBUG::2013-03-01 13:58:17,488::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free. Now locking as 'exclusive' (1 active user) >Thread-1012::DEBUG::2013-03-01 13:58:17,488::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c`ReqID=`164c161d-75df-47c0-9e05-96d056b9de99`::Granted request >Thread-1012::DEBUG::2013-03-01 13:58:17,489::task::794::TaskManager.Task::(resourceAcquired) Task=`c325c407-caa9-4f78-9d3e-e7941e589ef1`::_resourcesAcquired: Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c (exclusive) >Thread-1012::DEBUG::2013-03-01 13:58:17,489::task::957::TaskManager.Task::(_decref) Task=`c325c407-caa9-4f78-9d3e-e7941e589ef1`::ref 1 aborting False >Thread-1012::DEBUG::2013-03-01 13:58:17,496::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4b27eef13f184a08d51d40ee19754e2ac3545a4b'] >Thread-1012::DEBUG::2013-03-01 13:58:17,496::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1012::DEBUG::2013-03-01 13:58:17,497::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1012::DEBUG::2013-03-01 13:58:17,497::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1012::DEBUG::2013-03-01 13:58:17,497::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1012::DEBUG::2013-03-01 13:58:17,498::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1012::DEBUG::2013-03-01 13:58:17,514::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1012::DEBUG::2013-03-01 13:58:17,514::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:17,515::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:18,520::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:18,523::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:18,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:19,530::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:19,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1012::DEBUG::2013-03-01 13:58:20,583::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1012::DEBUG::2013-03-01 13:58:22,586::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1017::DEBUG::2013-03-01 13:58:22,821::task::568::TaskManager.Task::(_updateState) Task=`afd00814-77c0-486d-b837-f2ef3366fca9`::moving from state init -> state preparing >Thread-1017::INFO::2013-03-01 13:58:22,821::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1017::INFO::2013-03-01 13:58:22,821::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1017::DEBUG::2013-03-01 13:58:22,822::task::1151::TaskManager.Task::(prepare) Task=`afd00814-77c0-486d-b837-f2ef3366fca9`::finished: {} >Thread-1017::DEBUG::2013-03-01 13:58:22,822::task::568::TaskManager.Task::(_updateState) Task=`afd00814-77c0-486d-b837-f2ef3366fca9`::moving from state preparing -> state finished >Thread-1017::DEBUG::2013-03-01 13:58:22,822::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1017::DEBUG::2013-03-01 13:58:22,822::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1017::DEBUG::2013-03-01 13:58:22,822::task::957::TaskManager.Task::(_decref) Task=`afd00814-77c0-486d-b837-f2ef3366fca9`::ref 0 aborting False >Thread-1012::DEBUG::2013-03-01 13:58:23,653::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1012::DEBUG::2013-03-01 13:58:23,654::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,654::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,655::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,655::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,655::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,656::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,656::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1012::DEBUG::2013-03-01 13:58:23,657::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,658::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (cwd None) >Thread-1012::DEBUG::2013-03-01 13:58:23,918::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found\n'; <rc> = 5 >Thread-1012::WARNING::2013-03-01 13:58:23,919::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "ea6b50ab-6bf1-46b8-bdd7-c762d569c49c" not found'] >Thread-1012::DEBUG::2013-03-01 13:58:23,921::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1012::DEBUG::2013-03-01 13:58:23,969::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-1012::DEBUG::2013-03-01 13:58:23,969::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1012::DEBUG::2013-03-01 13:58:23,973::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4b27eef13f184a08d51d40ee19754e2ac3545a4b'] >Thread-1012::DEBUG::2013-03-01 13:58:23,975::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1012::WARNING::2013-03-01 13:58:23,976::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_imageNS already registered >Thread-1012::WARNING::2013-03-01 13:58:23,976::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace ea6b50ab-6bf1-46b8-bdd7-c762d569c49c_volumeNS already registered >Thread-1012::INFO::2013-03-01 13:58:23,976::fileSD::404::Storage.StorageDomain::(format) Formatting domain ea6b50ab-6bf1-46b8-bdd7-c762d569c49c >Thread-1012::INFO::2013-03-01 13:58:24,191::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-1012::DEBUG::2013-03-01 13:58:24,191::task::1151::TaskManager.Task::(prepare) Task=`c325c407-caa9-4f78-9d3e-e7941e589ef1`::finished: None >Thread-1012::DEBUG::2013-03-01 13:58:24,191::task::568::TaskManager.Task::(_updateState) Task=`c325c407-caa9-4f78-9d3e-e7941e589ef1`::moving from state preparing -> state finished >Thread-1012::DEBUG::2013-03-01 13:58:24,191::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c': < ResourceRef 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', isValid: 'True' obj: 'None'>} >Thread-1012::DEBUG::2013-03-01 13:58:24,192::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1012::DEBUG::2013-03-01 13:58:24,192::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' >Thread-1012::DEBUG::2013-03-01 13:58:24,192::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' (0 active users) >Thread-1012::DEBUG::2013-03-01 13:58:24,193::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c' is free, finding out if anyone is waiting for it. >Thread-1012::DEBUG::2013-03-01 13:58:24,193::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ea6b50ab-6bf1-46b8-bdd7-c762d569c49c', Clearing records. >Thread-1012::DEBUG::2013-03-01 13:58:24,193::task::957::TaskManager.Task::(_decref) Task=`c325c407-caa9-4f78-9d3e-e7941e589ef1`::ref 0 aborting False >Thread-1051::DEBUG::2013-03-01 13:58:24,227::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1051::DEBUG::2013-03-01 13:58:24,228::task::568::TaskManager.Task::(_updateState) Task=`ad1cb0de-0542-4b95-89f8-2a6bae3bf780`::moving from state init -> state preparing >Thread-1051::INFO::2013-03-01 13:58:24,228::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a', 'port': ''}], options=None) >Thread-1051::DEBUG::2013-03-01 13:58:24,229::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-1051::DEBUG::2013-03-01 13:58:24,273::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1051::DEBUG::2013-03-01 13:58:24,274::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1051::DEBUG::2013-03-01 13:58:24,274::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1051::DEBUG::2013-03-01 13:58:24,274::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1051::DEBUG::2013-03-01 13:58:24,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1051::DEBUG::2013-03-01 13:58:24,290::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1051::DEBUG::2013-03-01 13:58:24,290::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:24,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:25,297::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:26,301::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:26,305::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:26,307::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:26,310::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1051::DEBUG::2013-03-01 13:58:27,314::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1051::DEBUG::2013-03-01 13:58:29,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1051::DEBUG::2013-03-01 13:58:30,411::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1051::DEBUG::2013-03-01 13:58:30,412::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1051::DEBUG::2013-03-01 13:58:30,412::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1051::DEBUG::2013-03-01 13:58:30,413::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1051::DEBUG::2013-03-01 13:58:30,413::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1051::DEBUG::2013-03-01 13:58:30,414::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1051::DEBUG::2013-03-01 13:58:30,414::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1051::DEBUG::2013-03-01 13:58:30,414::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1051::INFO::2013-03-01 13:58:30,415::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1051::DEBUG::2013-03-01 13:58:30,415::task::1151::TaskManager.Task::(prepare) Task=`ad1cb0de-0542-4b95-89f8-2a6bae3bf780`::finished: {'statuslist': [{'status': 0, 'id': '21098d91-5f31-4bdf-9e1c-2c634d9f932a'}]} >Thread-1051::DEBUG::2013-03-01 13:58:30,415::task::568::TaskManager.Task::(_updateState) Task=`ad1cb0de-0542-4b95-89f8-2a6bae3bf780`::moving from state preparing -> state finished >Thread-1051::DEBUG::2013-03-01 13:58:30,415::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1051::DEBUG::2013-03-01 13:58:30,416::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1051::DEBUG::2013-03-01 13:58:30,416::task::957::TaskManager.Task::(_decref) Task=`ad1cb0de-0542-4b95-89f8-2a6bae3bf780`::ref 0 aborting False >Thread-1054::DEBUG::2013-03-01 13:58:31,659::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1054::DEBUG::2013-03-01 13:58:31,660::task::568::TaskManager.Task::(_updateState) Task=`61f060e4-a93e-4f0c-8c45-151e77feff8e`::moving from state init -> state preparing >Thread-1054::INFO::2013-03-01 13:58:31,660::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-1054::INFO::2013-03-01 13:58:31,660::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-1054::DEBUG::2013-03-01 13:58:31,660::task::1151::TaskManager.Task::(prepare) Task=`61f060e4-a93e-4f0c-8c45-151e77feff8e`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-1054::DEBUG::2013-03-01 13:58:31,661::task::568::TaskManager.Task::(_updateState) Task=`61f060e4-a93e-4f0c-8c45-151e77feff8e`::moving from state preparing -> state finished >Thread-1054::DEBUG::2013-03-01 13:58:31,661::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1054::DEBUG::2013-03-01 13:58:31,661::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1054::DEBUG::2013-03-01 13:58:31,661::task::957::TaskManager.Task::(_decref) Task=`61f060e4-a93e-4f0c-8c45-151e77feff8e`::ref 0 aborting False >Thread-1055::DEBUG::2013-03-01 13:58:31,701::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1055::DEBUG::2013-03-01 13:58:31,701::task::568::TaskManager.Task::(_updateState) Task=`3e69277e-ec9d-43e3-b255-dc5306cc53cd`::moving from state init -> state preparing >Thread-1055::INFO::2013-03-01 13:58:31,702::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-1055::DEBUG::2013-03-01 13:58:31,704::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-1055::INFO::2013-03-01 13:58:31,757::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-1055::DEBUG::2013-03-01 13:58:31,757::task::1151::TaskManager.Task::(prepare) Task=`3e69277e-ec9d-43e3-b255-dc5306cc53cd`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-1055::DEBUG::2013-03-01 13:58:31,758::task::568::TaskManager.Task::(_updateState) Task=`3e69277e-ec9d-43e3-b255-dc5306cc53cd`::moving from state preparing -> state finished >Thread-1055::DEBUG::2013-03-01 13:58:31,758::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1055::DEBUG::2013-03-01 13:58:31,758::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1055::DEBUG::2013-03-01 13:58:31,758::task::957::TaskManager.Task::(_decref) Task=`3e69277e-ec9d-43e3-b255-dc5306cc53cd`::ref 0 aborting False >Thread-1056::DEBUG::2013-03-01 13:58:31,790::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1056::DEBUG::2013-03-01 13:58:31,790::task::568::TaskManager.Task::(_updateState) Task=`35d3aea8-cdaa-4a59-a3e3-a76058786333`::moving from state init -> state preparing >Thread-1056::INFO::2013-03-01 13:58:31,791::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='352c3a1d-5473-41a5-9693-3da8286df38d', autoDetach=False, options=None) >Thread-1056::DEBUG::2013-03-01 13:58:31,791::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1056::DEBUG::2013-03-01 13:58:31,791::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1056::DEBUG::2013-03-01 13:58:31,792::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1056::DEBUG::2013-03-01 13:58:31,808::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1056::DEBUG::2013-03-01 13:58:31,808::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:31,811::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:32,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:33,820::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:34,824::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:35,828::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:36,832::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:37,837::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1059::DEBUG::2013-03-01 13:58:38,039::task::568::TaskManager.Task::(_updateState) Task=`4076d95f-804f-4a73-856f-a193d72550d2`::moving from state init -> state preparing >Thread-1059::INFO::2013-03-01 13:58:38,039::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1059::INFO::2013-03-01 13:58:38,040::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1059::DEBUG::2013-03-01 13:58:38,040::task::1151::TaskManager.Task::(prepare) Task=`4076d95f-804f-4a73-856f-a193d72550d2`::finished: {} >Thread-1059::DEBUG::2013-03-01 13:58:38,040::task::568::TaskManager.Task::(_updateState) Task=`4076d95f-804f-4a73-856f-a193d72550d2`::moving from state preparing -> state finished >Thread-1059::DEBUG::2013-03-01 13:58:38,040::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1059::DEBUG::2013-03-01 13:58:38,040::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1059::DEBUG::2013-03-01 13:58:38,041::task::957::TaskManager.Task::(_decref) Task=`4076d95f-804f-4a73-856f-a193d72550d2`::ref 0 aborting False >Thread-1056::DEBUG::2013-03-01 13:58:39,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1056::DEBUG::2013-03-01 13:58:40,881::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1056::DEBUG::2013-03-01 13:58:40,882::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`0e841cd3-7704-4a3b-8b0c-1bb6337269bb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1056::DEBUG::2013-03-01 13:58:40,882::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' for lock type 'exclusive' >Thread-1056::DEBUG::2013-03-01 13:58:40,883::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free. Now locking as 'exclusive' (1 active user) >Thread-1056::DEBUG::2013-03-01 13:58:40,883::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.352c3a1d-5473-41a5-9693-3da8286df38d`ReqID=`0e841cd3-7704-4a3b-8b0c-1bb6337269bb`::Granted request >Thread-1056::DEBUG::2013-03-01 13:58:40,884::task::794::TaskManager.Task::(resourceAcquired) Task=`35d3aea8-cdaa-4a59-a3e3-a76058786333`::_resourcesAcquired: Storage.352c3a1d-5473-41a5-9693-3da8286df38d (exclusive) >Thread-1056::DEBUG::2013-03-01 13:58:40,884::task::957::TaskManager.Task::(_decref) Task=`35d3aea8-cdaa-4a59-a3e3-a76058786333`::ref 1 aborting False >Thread-1056::DEBUG::2013-03-01 13:58:40,884::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1056::DEBUG::2013-03-01 13:58:40,884::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1056::DEBUG::2013-03-01 13:58:40,885::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1056::DEBUG::2013-03-01 13:58:40,885::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1056::DEBUG::2013-03-01 13:58:40,885::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1056::DEBUG::2013-03-01 13:58:40,900::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1056::DEBUG::2013-03-01 13:58:40,901::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:40,902::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:41,907::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:42,911::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:43,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:44,919::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:45,924::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1056::DEBUG::2013-03-01 13:58:46,928::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1056::DEBUG::2013-03-01 13:58:48,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1056::DEBUG::2013-03-01 13:58:50,000::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1056::DEBUG::2013-03-01 13:58:50,001::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,001::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,002::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,002::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,002::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,003::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,003::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1056::DEBUG::2013-03-01 13:58:50,003::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,005::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-1056::DEBUG::2013-03-01 13:58:50,242::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-1056::WARNING::2013-03-01 13:58:50,243::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-1056::DEBUG::2013-03-01 13:58:50,244::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,276::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-1056::DEBUG::2013-03-01 13:58:50,276::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1056::DEBUG::2013-03-01 13:58:50,280::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c07ec8aef5484bc9911a04baa0f89a159dc8ca83'] >Thread-1056::DEBUG::2013-03-01 13:58:50,282::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1056::WARNING::2013-03-01 13:58:50,282::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-1056::WARNING::2013-03-01 13:58:50,283::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-1056::DEBUG::2013-03-01 13:58:50,286::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c07ec8aef5484bc9911a04baa0f89a159dc8ca83'] >Thread-1056::DEBUG::2013-03-01 13:58:50,286::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,287::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 352c3a1d-5473-41a5-9693-3da8286df38d' (cwd None) >Thread-1056::DEBUG::2013-03-01 13:58:50,504::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found\n'; <rc> = 5 >Thread-1056::WARNING::2013-03-01 13:58:50,505::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "352c3a1d-5473-41a5-9693-3da8286df38d" not found'] >Thread-1056::DEBUG::2013-03-01 13:58:50,505::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1056::DEBUG::2013-03-01 13:58:50,537::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/352c3a1d-5473-41a5-9693-3da8286df38d >Thread-1056::DEBUG::2013-03-01 13:58:50,538::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1056::DEBUG::2013-03-01 13:58:50,542::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=352c3a1d-5473-41a5-9693-3da8286df38d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c07ec8aef5484bc9911a04baa0f89a159dc8ca83'] >Thread-1056::DEBUG::2013-03-01 13:58:50,544::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1056::WARNING::2013-03-01 13:58:50,544::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_imageNS already registered >Thread-1056::WARNING::2013-03-01 13:58:50,544::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 352c3a1d-5473-41a5-9693-3da8286df38d_volumeNS already registered >Thread-1056::INFO::2013-03-01 13:58:50,545::fileSD::404::Storage.StorageDomain::(format) Formatting domain 352c3a1d-5473-41a5-9693-3da8286df38d >Thread-1056::INFO::2013-03-01 13:58:50,722::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-1056::DEBUG::2013-03-01 13:58:50,722::task::1151::TaskManager.Task::(prepare) Task=`35d3aea8-cdaa-4a59-a3e3-a76058786333`::finished: None >Thread-1056::DEBUG::2013-03-01 13:58:50,722::task::568::TaskManager.Task::(_updateState) Task=`35d3aea8-cdaa-4a59-a3e3-a76058786333`::moving from state preparing -> state finished >Thread-1056::DEBUG::2013-03-01 13:58:50,723::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.352c3a1d-5473-41a5-9693-3da8286df38d': < ResourceRef 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', isValid: 'True' obj: 'None'>} >Thread-1056::DEBUG::2013-03-01 13:58:50,723::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1056::DEBUG::2013-03-01 13:58:50,723::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' >Thread-1056::DEBUG::2013-03-01 13:58:50,724::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' (0 active users) >Thread-1056::DEBUG::2013-03-01 13:58:50,724::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d' is free, finding out if anyone is waiting for it. >Thread-1056::DEBUG::2013-03-01 13:58:50,724::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.352c3a1d-5473-41a5-9693-3da8286df38d', Clearing records. >Thread-1056::DEBUG::2013-03-01 13:58:50,725::task::957::TaskManager.Task::(_decref) Task=`35d3aea8-cdaa-4a59-a3e3-a76058786333`::ref 0 aborting False >Thread-1099::DEBUG::2013-03-01 13:58:50,759::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1099::DEBUG::2013-03-01 13:58:50,759::task::568::TaskManager.Task::(_updateState) Task=`8a8ccfa0-a13d-470d-9221-f2ddcddcb193`::moving from state init -> state preparing >Thread-1099::INFO::2013-03-01 13:58:50,760::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28', 'port': ''}], options=None) >Thread-1099::DEBUG::2013-03-01 13:58:50,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-1099::DEBUG::2013-03-01 13:58:50,795::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1099::DEBUG::2013-03-01 13:58:50,796::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1099::DEBUG::2013-03-01 13:58:50,796::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1099::DEBUG::2013-03-01 13:58:50,796::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1099::DEBUG::2013-03-01 13:58:50,797::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1099::DEBUG::2013-03-01 13:58:50,812::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1099::DEBUG::2013-03-01 13:58:50,812::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:50,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:51,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:52,824::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-1100::DEBUG::2013-03-01 13:58:53,258::task::568::TaskManager.Task::(_updateState) Task=`7954767b-9263-4477-9f1e-7d2245b25e21`::moving from state init -> state preparing >Thread-1100::INFO::2013-03-01 13:58:53,259::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1100::INFO::2013-03-01 13:58:53,259::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1100::DEBUG::2013-03-01 13:58:53,259::task::1151::TaskManager.Task::(prepare) Task=`7954767b-9263-4477-9f1e-7d2245b25e21`::finished: {} >Thread-1100::DEBUG::2013-03-01 13:58:53,259::task::568::TaskManager.Task::(_updateState) Task=`7954767b-9263-4477-9f1e-7d2245b25e21`::moving from state preparing -> state finished >Thread-1100::DEBUG::2013-03-01 13:58:53,260::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1100::DEBUG::2013-03-01 13:58:53,260::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1100::DEBUG::2013-03-01 13:58:53,260::task::957::TaskManager.Task::(_decref) Task=`7954767b-9263-4477-9f1e-7d2245b25e21`::ref 0 aborting False >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:53,828::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:53,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:53,834::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1099::DEBUG::2013-03-01 13:58:53,837::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1099::DEBUG::2013-03-01 13:58:55,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1099::DEBUG::2013-03-01 13:58:56,885::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1099::DEBUG::2013-03-01 13:58:56,886::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1099::DEBUG::2013-03-01 13:58:56,886::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1099::DEBUG::2013-03-01 13:58:56,886::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1099::DEBUG::2013-03-01 13:58:56,887::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1099::DEBUG::2013-03-01 13:58:56,887::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1099::DEBUG::2013-03-01 13:58:56,887::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1099::DEBUG::2013-03-01 13:58:56,888::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1099::INFO::2013-03-01 13:58:56,888::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-1099::DEBUG::2013-03-01 13:58:56,888::task::1151::TaskManager.Task::(prepare) Task=`8a8ccfa0-a13d-470d-9221-f2ddcddcb193`::finished: {'statuslist': [{'status': 0, 'id': '6c1b49d5-e67a-40c8-96d5-96008ddb3f28'}]} >Thread-1099::DEBUG::2013-03-01 13:58:56,889::task::568::TaskManager.Task::(_updateState) Task=`8a8ccfa0-a13d-470d-9221-f2ddcddcb193`::moving from state preparing -> state finished >Thread-1099::DEBUG::2013-03-01 13:58:56,889::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1099::DEBUG::2013-03-01 13:58:56,889::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1099::DEBUG::2013-03-01 13:58:56,890::task::957::TaskManager.Task::(_decref) Task=`8a8ccfa0-a13d-470d-9221-f2ddcddcb193`::ref 0 aborting False >Thread-1103::DEBUG::2013-03-01 13:58:57,897::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1103::DEBUG::2013-03-01 13:58:57,897::task::568::TaskManager.Task::(_updateState) Task=`07816838-9553-4488-835f-3a6d10144ff9`::moving from state init -> state preparing >Thread-1103::INFO::2013-03-01 13:58:57,898::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-1103::INFO::2013-03-01 13:58:57,898::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-1103::DEBUG::2013-03-01 13:58:57,898::task::1151::TaskManager.Task::(prepare) Task=`07816838-9553-4488-835f-3a6d10144ff9`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-1103::DEBUG::2013-03-01 13:58:57,898::task::568::TaskManager.Task::(_updateState) Task=`07816838-9553-4488-835f-3a6d10144ff9`::moving from state preparing -> state finished >Thread-1103::DEBUG::2013-03-01 13:58:57,899::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1103::DEBUG::2013-03-01 13:58:57,899::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1103::DEBUG::2013-03-01 13:58:57,899::task::957::TaskManager.Task::(_decref) Task=`07816838-9553-4488-835f-3a6d10144ff9`::ref 0 aborting False >Thread-1104::DEBUG::2013-03-01 13:58:57,934::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1104::DEBUG::2013-03-01 13:58:57,934::task::568::TaskManager.Task::(_updateState) Task=`051f73b7-5ccd-4d08-b41a-ea68110084d0`::moving from state init -> state preparing >Thread-1104::INFO::2013-03-01 13:58:57,934::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-1104::DEBUG::2013-03-01 13:58:57,937::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-1104::INFO::2013-03-01 13:58:57,976::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-1104::DEBUG::2013-03-01 13:58:57,976::task::1151::TaskManager.Task::(prepare) Task=`051f73b7-5ccd-4d08-b41a-ea68110084d0`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-1104::DEBUG::2013-03-01 13:58:57,977::task::568::TaskManager.Task::(_updateState) Task=`051f73b7-5ccd-4d08-b41a-ea68110084d0`::moving from state preparing -> state finished >Thread-1104::DEBUG::2013-03-01 13:58:57,977::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1104::DEBUG::2013-03-01 13:58:57,977::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1104::DEBUG::2013-03-01 13:58:57,977::task::957::TaskManager.Task::(_decref) Task=`051f73b7-5ccd-4d08-b41a-ea68110084d0`::ref 0 aborting False >Thread-1105::DEBUG::2013-03-01 13:58:58,009::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1105::DEBUG::2013-03-01 13:58:58,010::task::568::TaskManager.Task::(_updateState) Task=`0b54037f-767f-495f-ada1-9fd648523fe3`::moving from state init -> state preparing >Thread-1105::INFO::2013-03-01 13:58:58,010::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='28973299-9d17-4683-a64e-9a5cec830fcd', autoDetach=False, options=None) >Thread-1105::DEBUG::2013-03-01 13:58:58,010::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1105::DEBUG::2013-03-01 13:58:58,011::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1105::DEBUG::2013-03-01 13:58:58,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1105::DEBUG::2013-03-01 13:58:58,026::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1105::DEBUG::2013-03-01 13:58:58,027::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1105::DEBUG::2013-03-01 13:58:58,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:58:59,034::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:58:59,037::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:00,041::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:00,044::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:00,047::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:01,051::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1105::DEBUG::2013-03-01 13:59:03,055::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1105::DEBUG::2013-03-01 13:59:04,136::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1105::DEBUG::2013-03-01 13:59:04,137::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`5882ef37-4094-4060-a50b-0cff9ad31a40`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1105::DEBUG::2013-03-01 13:59:04,137::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' for lock type 'exclusive' >Thread-1105::DEBUG::2013-03-01 13:59:04,138::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free. Now locking as 'exclusive' (1 active user) >Thread-1105::DEBUG::2013-03-01 13:59:04,138::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.28973299-9d17-4683-a64e-9a5cec830fcd`ReqID=`5882ef37-4094-4060-a50b-0cff9ad31a40`::Granted request >Thread-1105::DEBUG::2013-03-01 13:59:04,138::task::794::TaskManager.Task::(resourceAcquired) Task=`0b54037f-767f-495f-ada1-9fd648523fe3`::_resourcesAcquired: Storage.28973299-9d17-4683-a64e-9a5cec830fcd (exclusive) >Thread-1105::DEBUG::2013-03-01 13:59:04,139::task::957::TaskManager.Task::(_decref) Task=`0b54037f-767f-495f-ada1-9fd648523fe3`::ref 1 aborting False >Thread-1105::DEBUG::2013-03-01 13:59:04,139::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1105::DEBUG::2013-03-01 13:59:04,139::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1105::DEBUG::2013-03-01 13:59:04,140::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1105::DEBUG::2013-03-01 13:59:04,140::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1105::DEBUG::2013-03-01 13:59:04,140::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1105::DEBUG::2013-03-01 13:59:04,155::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1105::DEBUG::2013-03-01 13:59:04,156::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:04,157::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:05,162::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:06,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:07,170::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:08,175::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-1109::DEBUG::2013-03-01 13:59:08,497::task::568::TaskManager.Task::(_updateState) Task=`bbc90788-19b1-41b3-ba73-969c381a1985`::moving from state init -> state preparing >Thread-1109::INFO::2013-03-01 13:59:08,498::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1109::INFO::2013-03-01 13:59:08,498::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1109::DEBUG::2013-03-01 13:59:08,498::task::1151::TaskManager.Task::(prepare) Task=`bbc90788-19b1-41b3-ba73-969c381a1985`::finished: {} >Thread-1109::DEBUG::2013-03-01 13:59:08,498::task::568::TaskManager.Task::(_updateState) Task=`bbc90788-19b1-41b3-ba73-969c381a1985`::moving from state preparing -> state finished >Thread-1109::DEBUG::2013-03-01 13:59:08,499::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1109::DEBUG::2013-03-01 13:59:08,499::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1109::DEBUG::2013-03-01 13:59:08,499::task::957::TaskManager.Task::(_decref) Task=`bbc90788-19b1-41b3-ba73-969c381a1985`::ref 0 aborting False >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:09,179::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1105::DEBUG::2013-03-01 13:59:09,182::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1105::DEBUG::2013-03-01 13:59:11,185::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1105::DEBUG::2013-03-01 13:59:12,257::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1105::DEBUG::2013-03-01 13:59:12,258::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,258::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,258::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,259::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,259::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,259::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,260::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1105::DEBUG::2013-03-01 13:59:12,260::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-1105::DEBUG::2013-03-01 13:59:12,484::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-1105::WARNING::2013-03-01 13:59:12,485::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-1105::DEBUG::2013-03-01 13:59:12,486::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,527::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-1105::DEBUG::2013-03-01 13:59:12,528::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1105::DEBUG::2013-03-01 13:59:12,532::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=7a156f011db95d975c61210334f11a818450ba65'] >Thread-1105::DEBUG::2013-03-01 13:59:12,535::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1105::WARNING::2013-03-01 13:59:12,535::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_imageNS already registered >Thread-1105::WARNING::2013-03-01 13:59:12,536::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS already registered >Thread-1105::DEBUG::2013-03-01 13:59:12,539::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=7a156f011db95d975c61210334f11a818450ba65'] >Thread-1105::DEBUG::2013-03-01 13:59:12,540::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,541::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 28973299-9d17-4683-a64e-9a5cec830fcd' (cwd None) >Thread-1105::DEBUG::2013-03-01 13:59:12,710::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found\n'; <rc> = 5 >Thread-1105::WARNING::2013-03-01 13:59:12,711::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "28973299-9d17-4683-a64e-9a5cec830fcd" not found'] >Thread-1105::DEBUG::2013-03-01 13:59:12,711::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1105::DEBUG::2013-03-01 13:59:12,757::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/28973299-9d17-4683-a64e-9a5cec830fcd >Thread-1105::DEBUG::2013-03-01 13:59:12,757::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1105::DEBUG::2013-03-01 13:59:12,761::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=28973299-9d17-4683-a64e-9a5cec830fcd', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=7a156f011db95d975c61210334f11a818450ba65'] >Thread-1105::DEBUG::2013-03-01 13:59:12,763::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1105::WARNING::2013-03-01 13:59:12,764::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_imageNS already registered >Thread-1105::WARNING::2013-03-01 13:59:12,764::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 28973299-9d17-4683-a64e-9a5cec830fcd_volumeNS already registered >Thread-1105::INFO::2013-03-01 13:59:12,764::fileSD::404::Storage.StorageDomain::(format) Formatting domain 28973299-9d17-4683-a64e-9a5cec830fcd >Thread-1105::INFO::2013-03-01 13:59:12,955::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-1105::DEBUG::2013-03-01 13:59:12,956::task::1151::TaskManager.Task::(prepare) Task=`0b54037f-767f-495f-ada1-9fd648523fe3`::finished: None >Thread-1105::DEBUG::2013-03-01 13:59:12,956::task::568::TaskManager.Task::(_updateState) Task=`0b54037f-767f-495f-ada1-9fd648523fe3`::moving from state preparing -> state finished >Thread-1105::DEBUG::2013-03-01 13:59:12,956::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.28973299-9d17-4683-a64e-9a5cec830fcd': < ResourceRef 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', isValid: 'True' obj: 'None'>} >Thread-1105::DEBUG::2013-03-01 13:59:12,956::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1105::DEBUG::2013-03-01 13:59:12,957::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' >Thread-1105::DEBUG::2013-03-01 13:59:12,957::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' (0 active users) >Thread-1105::DEBUG::2013-03-01 13:59:12,957::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd' is free, finding out if anyone is waiting for it. >Thread-1105::DEBUG::2013-03-01 13:59:12,958::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.28973299-9d17-4683-a64e-9a5cec830fcd', Clearing records. >Thread-1105::DEBUG::2013-03-01 13:59:12,958::task::957::TaskManager.Task::(_decref) Task=`0b54037f-767f-495f-ada1-9fd648523fe3`::ref 0 aborting False >Thread-1162::DEBUG::2013-03-01 13:59:12,992::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1162::DEBUG::2013-03-01 13:59:12,992::task::568::TaskManager.Task::(_updateState) Task=`f3c3a73b-916c-412a-8298-2847b6336771`::moving from state init -> state preparing >Thread-1162::INFO::2013-03-01 13:59:12,993::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '302598a3-f86f-4b91-af52-4f916b24bf45', 'port': ''}], options=None) >Thread-1162::DEBUG::2013-03-01 13:59:12,993::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-1162::DEBUG::2013-03-01 13:59:13,026::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1162::DEBUG::2013-03-01 13:59:13,026::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1162::DEBUG::2013-03-01 13:59:13,026::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1162::DEBUG::2013-03-01 13:59:13,027::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1162::DEBUG::2013-03-01 13:59:13,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1162::DEBUG::2013-03-01 13:59:13,042::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1162::DEBUG::2013-03-01 13:59:13,043::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:13,046::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:14,051::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:15,055::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:16,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:17,064::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:18,068::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1162::DEBUG::2013-03-01 13:59:19,073::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1162::DEBUG::2013-03-01 13:59:21,076::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1162::DEBUG::2013-03-01 13:59:22,154::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1162::DEBUG::2013-03-01 13:59:22,155::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1162::DEBUG::2013-03-01 13:59:22,155::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1162::DEBUG::2013-03-01 13:59:22,155::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1162::DEBUG::2013-03-01 13:59:22,156::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1162::DEBUG::2013-03-01 13:59:22,156::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1162::DEBUG::2013-03-01 13:59:22,156::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1162::DEBUG::2013-03-01 13:59:22,157::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1162::INFO::2013-03-01 13:59:22,157::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-1162::DEBUG::2013-03-01 13:59:22,157::task::1151::TaskManager.Task::(prepare) Task=`f3c3a73b-916c-412a-8298-2847b6336771`::finished: {'statuslist': [{'status': 0, 'id': '302598a3-f86f-4b91-af52-4f916b24bf45'}]} >Thread-1162::DEBUG::2013-03-01 13:59:22,158::task::568::TaskManager.Task::(_updateState) Task=`f3c3a73b-916c-412a-8298-2847b6336771`::moving from state preparing -> state finished >Thread-1162::DEBUG::2013-03-01 13:59:22,158::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1162::DEBUG::2013-03-01 13:59:22,158::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1162::DEBUG::2013-03-01 13:59:22,159::task::957::TaskManager.Task::(_decref) Task=`f3c3a73b-916c-412a-8298-2847b6336771`::ref 0 aborting False >Thread-1166::DEBUG::2013-03-01 13:59:23,713::task::568::TaskManager.Task::(_updateState) Task=`aba8fb9d-a3a2-486d-bbac-24fceb43b988`::moving from state init -> state preparing >Thread-1166::INFO::2013-03-01 13:59:23,713::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1166::INFO::2013-03-01 13:59:23,713::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1166::DEBUG::2013-03-01 13:59:23,714::task::1151::TaskManager.Task::(prepare) Task=`aba8fb9d-a3a2-486d-bbac-24fceb43b988`::finished: {} >Thread-1166::DEBUG::2013-03-01 13:59:23,714::task::568::TaskManager.Task::(_updateState) Task=`aba8fb9d-a3a2-486d-bbac-24fceb43b988`::moving from state preparing -> state finished >Thread-1166::DEBUG::2013-03-01 13:59:23,714::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1166::DEBUG::2013-03-01 13:59:23,714::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1166::DEBUG::2013-03-01 13:59:23,715::task::957::TaskManager.Task::(_decref) Task=`aba8fb9d-a3a2-486d-bbac-24fceb43b988`::ref 0 aborting False >Thread-1168::DEBUG::2013-03-01 13:59:26,810::task::568::TaskManager.Task::(_updateState) Task=`a8b5d3c8-55f1-48cd-ae86-5d6296a54954`::moving from state init -> state preparing >Thread-1168::INFO::2013-03-01 13:59:26,811::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1168::INFO::2013-03-01 13:59:26,811::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1168::DEBUG::2013-03-01 13:59:26,811::task::1151::TaskManager.Task::(prepare) Task=`a8b5d3c8-55f1-48cd-ae86-5d6296a54954`::finished: {} >Thread-1168::DEBUG::2013-03-01 13:59:26,811::task::568::TaskManager.Task::(_updateState) Task=`a8b5d3c8-55f1-48cd-ae86-5d6296a54954`::moving from state preparing -> state finished >Thread-1168::DEBUG::2013-03-01 13:59:26,812::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1168::DEBUG::2013-03-01 13:59:26,812::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1168::DEBUG::2013-03-01 13:59:26,812::task::957::TaskManager.Task::(_decref) Task=`a8b5d3c8-55f1-48cd-ae86-5d6296a54954`::ref 0 aborting False >Thread-1170::DEBUG::2013-03-01 13:59:35,870::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-1170::DEBUG::2013-03-01 13:59:35,906::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >Thread-1171::DEBUG::2013-03-01 13:59:35,949::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-1171::DEBUG::2013-03-01 13:59:35,951::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-1172::DEBUG::2013-03-01 13:59:36,060::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getCapabilities with () {} >Thread-1172::DEBUG::2013-03-01 13:59:36,093::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >Thread-1173::DEBUG::2013-03-01 13:59:36,137::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.2]::call getHardwareInfo with () {} >Thread-1173::DEBUG::2013-03-01 13:59:36,138::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-1175::DEBUG::2013-03-01 13:59:39,341::task::568::TaskManager.Task::(_updateState) Task=`4c3df25b-2a36-4738-99f8-57f3bb632ec8`::moving from state init -> state preparing >Thread-1175::INFO::2013-03-01 13:59:39,341::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1175::INFO::2013-03-01 13:59:39,341::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1175::DEBUG::2013-03-01 13:59:39,341::task::1151::TaskManager.Task::(prepare) Task=`4c3df25b-2a36-4738-99f8-57f3bb632ec8`::finished: {} >Thread-1175::DEBUG::2013-03-01 13:59:39,342::task::568::TaskManager.Task::(_updateState) Task=`4c3df25b-2a36-4738-99f8-57f3bb632ec8`::moving from state preparing -> state finished >Thread-1175::DEBUG::2013-03-01 13:59:39,342::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1175::DEBUG::2013-03-01 13:59:39,342::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1175::DEBUG::2013-03-01 13:59:39,342::task::957::TaskManager.Task::(_decref) Task=`4c3df25b-2a36-4738-99f8-57f3bb632ec8`::ref 0 aborting False >Thread-1179::DEBUG::2013-03-01 13:59:47,197::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1179::DEBUG::2013-03-01 13:59:47,198::task::568::TaskManager.Task::(_updateState) Task=`5198ff4a-a90d-4345-b895-7ca84926863a`::moving from state init -> state preparing >Thread-1179::INFO::2013-03-01 13:59:47,198::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-1179::INFO::2013-03-01 13:59:47,198::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1179::DEBUG::2013-03-01 13:59:47,199::task::1151::TaskManager.Task::(prepare) Task=`5198ff4a-a90d-4345-b895-7ca84926863a`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1179::DEBUG::2013-03-01 13:59:47,199::task::568::TaskManager.Task::(_updateState) Task=`5198ff4a-a90d-4345-b895-7ca84926863a`::moving from state preparing -> state finished >Thread-1179::DEBUG::2013-03-01 13:59:47,199::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1179::DEBUG::2013-03-01 13:59:47,199::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1179::DEBUG::2013-03-01 13:59:47,200::task::957::TaskManager.Task::(_decref) Task=`5198ff4a-a90d-4345-b895-7ca84926863a`::ref 0 aborting False >Thread-1180::DEBUG::2013-03-01 13:59:47,240::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1180::DEBUG::2013-03-01 13:59:47,240::task::568::TaskManager.Task::(_updateState) Task=`4988f38f-bbbc-4873-a677-bcc71b36f419`::moving from state init -> state preparing >Thread-1180::INFO::2013-03-01 13:59:47,241::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-1180::DEBUG::2013-03-01 13:59:47,243::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-1180::INFO::2013-03-01 13:59:47,288::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1180::DEBUG::2013-03-01 13:59:47,288::task::1151::TaskManager.Task::(prepare) Task=`4988f38f-bbbc-4873-a677-bcc71b36f419`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1180::DEBUG::2013-03-01 13:59:47,288::task::568::TaskManager.Task::(_updateState) Task=`4988f38f-bbbc-4873-a677-bcc71b36f419`::moving from state preparing -> state finished >Thread-1180::DEBUG::2013-03-01 13:59:47,289::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1180::DEBUG::2013-03-01 13:59:47,289::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1180::DEBUG::2013-03-01 13:59:47,289::task::957::TaskManager.Task::(_decref) Task=`4988f38f-bbbc-4873-a677-bcc71b36f419`::ref 0 aborting False >Thread-1181::DEBUG::2013-03-01 13:59:47,329::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1181::DEBUG::2013-03-01 13:59:47,330::task::568::TaskManager.Task::(_updateState) Task=`ced6df79-f3ba-4ea5-9238-c255fbe36a87`::moving from state init -> state preparing >Thread-1181::INFO::2013-03-01 13:59:47,330::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', options=None) >Thread-1181::DEBUG::2013-03-01 13:59:47,331::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1181::DEBUG::2013-03-01 13:59:47,331::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1181::DEBUG::2013-03-01 13:59:47,331::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1181::DEBUG::2013-03-01 13:59:47,331::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1181::DEBUG::2013-03-01 13:59:47,332::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1181::DEBUG::2013-03-01 13:59:47,347::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1181::DEBUG::2013-03-01 13:59:47,348::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:47,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:48,355::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:49,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:49,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:49,365::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:50,369::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1181::DEBUG::2013-03-01 13:59:51,373::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1181::DEBUG::2013-03-01 13:59:53,377::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1181::DEBUG::2013-03-01 13:59:54,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1181::DEBUG::2013-03-01 13:59:54,460::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,461::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,461::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,461::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,462::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,462::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,462::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1181::DEBUG::2013-03-01 13:59:54,463::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1181::DEBUG::2013-03-01 13:59:54,465::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-1184::DEBUG::2013-03-01 13:59:54,649::task::568::TaskManager.Task::(_updateState) Task=`69687d76-ef2e-4515-8af6-63454eb121d8`::moving from state init -> state preparing >Thread-1184::INFO::2013-03-01 13:59:54,650::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1184::INFO::2013-03-01 13:59:54,650::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1184::DEBUG::2013-03-01 13:59:54,650::task::1151::TaskManager.Task::(prepare) Task=`69687d76-ef2e-4515-8af6-63454eb121d8`::finished: {} >Thread-1184::DEBUG::2013-03-01 13:59:54,651::task::568::TaskManager.Task::(_updateState) Task=`69687d76-ef2e-4515-8af6-63454eb121d8`::moving from state preparing -> state finished >Thread-1184::DEBUG::2013-03-01 13:59:54,651::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1184::DEBUG::2013-03-01 13:59:54,651::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1184::DEBUG::2013-03-01 13:59:54,651::task::957::TaskManager.Task::(_decref) Task=`69687d76-ef2e-4515-8af6-63454eb121d8`::ref 0 aborting False >Thread-1181::DEBUG::2013-03-01 13:59:54,676::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-1181::DEBUG::2013-03-01 13:59:54,677::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1181::INFO::2013-03-01 13:59:54,748::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-1181::DEBUG::2013-03-01 13:59:54,748::task::1151::TaskManager.Task::(prepare) Task=`ced6df79-f3ba-4ea5-9238-c255fbe36a87`::finished: {'domlist': []} >Thread-1181::DEBUG::2013-03-01 13:59:54,749::task::568::TaskManager.Task::(_updateState) Task=`ced6df79-f3ba-4ea5-9238-c255fbe36a87`::moving from state preparing -> state finished >Thread-1181::DEBUG::2013-03-01 13:59:54,749::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1181::DEBUG::2013-03-01 13:59:54,749::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1181::DEBUG::2013-03-01 13:59:54,750::task::957::TaskManager.Task::(_decref) Task=`ced6df79-f3ba-4ea5-9238-c255fbe36a87`::ref 0 aborting False >Thread-1210::DEBUG::2013-03-01 13:59:54,837::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1210::DEBUG::2013-03-01 13:59:54,837::task::568::TaskManager.Task::(_updateState) Task=`429387ec-61ff-4722-ac84-aba7384d5396`::moving from state init -> state preparing >Thread-1210::INFO::2013-03-01 13:59:54,838::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', domainName='nfsStorageTest_data_domain_0', typeSpecificArg='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', domClass=1, domVersion='0', options=None) >Thread-1210::DEBUG::2013-03-01 13:59:54,838::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1210::DEBUG::2013-03-01 13:59:54,839::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1210::DEBUG::2013-03-01 13:59:55,009::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1210::WARNING::2013-03-01 13:59:55,010::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1210::DEBUG::2013-03-01 13:59:55,010::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1210::INFO::2013-03-01 13:59:55,066::nfsSD::68::Storage.StorageDomain::(create) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc domainName=nfsStorageTest_data_domain_0 remotePath=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 domClass=1 >Thread-1210::DEBUG::2013-03-01 13:59:55,407::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1210::DEBUG::2013-03-01 13:59:55,423::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-1210::WARNING::2013-03-01 13:59:55,425::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1210::DEBUG::2013-03-01 13:59:55,429::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1210::DEBUG::2013-03-01 13:59:55,432::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1210::DEBUG::2013-03-01 13:59:55,436::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=af66143c6cb039037d135e1d91f071d381176329'] >Thread-1210::DEBUG::2013-03-01 13:59:55,519::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1210::DEBUG::2013-03-01 13:59:55,544::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1210::DEBUG::2013-03-01 13:59:55,547::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1210::DEBUG::2013-03-01 13:59:55,588::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=af66143c6cb039037d135e1d91f071d381176329'] >Thread-1210::DEBUG::2013-03-01 13:59:55,612::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1210::DEBUG::2013-03-01 13:59:55,619::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS' >Thread-1210::DEBUG::2013-03-01 13:59:55,625::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS' >Thread-1210::DEBUG::2013-03-01 13:59:55,631::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-1210::DEBUG::2013-03-01 13:59:55,803::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1210::DEBUG::2013-03-01 13:59:55,815::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-1210::INFO::2013-03-01 13:59:55,819::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-1210::DEBUG::2013-03-01 13:59:55,823::task::1151::TaskManager.Task::(prepare) Task=`429387ec-61ff-4722-ac84-aba7384d5396`::finished: None >Thread-1210::DEBUG::2013-03-01 13:59:55,827::task::568::TaskManager.Task::(_updateState) Task=`429387ec-61ff-4722-ac84-aba7384d5396`::moving from state preparing -> state finished >Thread-1210::DEBUG::2013-03-01 13:59:55,831::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1210::DEBUG::2013-03-01 13:59:55,834::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1210::DEBUG::2013-03-01 13:59:55,838::task::957::TaskManager.Task::(_decref) Task=`429387ec-61ff-4722-ac84-aba7384d5396`::ref 0 aborting False >Thread-1235::DEBUG::2013-03-01 13:59:56,062::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1235::DEBUG::2013-03-01 13:59:56,070::task::568::TaskManager.Task::(_updateState) Task=`17910ddd-9abd-41ca-b761-f45250028ca2`::moving from state init -> state preparing >Thread-1235::INFO::2013-03-01 13:59:56,074::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', options=None) >Thread-1235::DEBUG::2013-03-01 13:59:56,082::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`b427282c-b01d-4f56-a4e2-a4be010e98f0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1235::DEBUG::2013-03-01 13:59:56,085::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'shared' >Thread-1235::DEBUG::2013-03-01 13:59:56,095::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'shared' (1 active user) >Thread-1235::DEBUG::2013-03-01 13:59:56,101::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`b427282c-b01d-4f56-a4e2-a4be010e98f0`::Granted request >Thread-1235::DEBUG::2013-03-01 13:59:56,109::task::794::TaskManager.Task::(resourceAcquired) Task=`17910ddd-9abd-41ca-b761-f45250028ca2`::_resourcesAcquired: Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc (shared) >Thread-1235::DEBUG::2013-03-01 13:59:56,112::task::957::TaskManager.Task::(_decref) Task=`17910ddd-9abd-41ca-b761-f45250028ca2`::ref 1 aborting False >Thread-1235::INFO::2013-03-01 13:59:56,131::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '943044165632', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-1235::DEBUG::2013-03-01 13:59:56,134::task::1151::TaskManager.Task::(prepare) Task=`17910ddd-9abd-41ca-b761-f45250028ca2`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '943044165632', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-1235::DEBUG::2013-03-01 13:59:56,137::task::568::TaskManager.Task::(_updateState) Task=`17910ddd-9abd-41ca-b761-f45250028ca2`::moving from state preparing -> state finished >Thread-1235::DEBUG::2013-03-01 13:59:56,141::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc': < ResourceRef 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', isValid: 'True' obj: 'None'>} >Thread-1235::DEBUG::2013-03-01 13:59:56,144::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1235::DEBUG::2013-03-01 13:59:56,148::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >Thread-1235::DEBUG::2013-03-01 13:59:56,152::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >Thread-1235::DEBUG::2013-03-01 13:59:56,154::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >Thread-1235::DEBUG::2013-03-01 13:59:56,157::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >Thread-1235::DEBUG::2013-03-01 13:59:56,161::task::957::TaskManager.Task::(_decref) Task=`17910ddd-9abd-41ca-b761-f45250028ca2`::ref 0 aborting False >Thread-1236::DEBUG::2013-03-01 13:59:57,426::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1236::DEBUG::2013-03-01 13:59:57,432::task::568::TaskManager.Task::(_updateState) Task=`37de7cb1-a882-4884-8fe1-bef3a542aa99`::moving from state init -> state preparing >Thread-1236::INFO::2013-03-01 13:59:57,437::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-1236::INFO::2013-03-01 13:59:57,440::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1236::DEBUG::2013-03-01 13:59:57,443::task::1151::TaskManager.Task::(prepare) Task=`37de7cb1-a882-4884-8fe1-bef3a542aa99`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1236::DEBUG::2013-03-01 13:59:57,446::task::568::TaskManager.Task::(_updateState) Task=`37de7cb1-a882-4884-8fe1-bef3a542aa99`::moving from state preparing -> state finished >Thread-1236::DEBUG::2013-03-01 13:59:57,449::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1236::DEBUG::2013-03-01 13:59:57,452::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1236::DEBUG::2013-03-01 13:59:57,456::task::957::TaskManager.Task::(_decref) Task=`37de7cb1-a882-4884-8fe1-bef3a542aa99`::ref 0 aborting False >Thread-1237::DEBUG::2013-03-01 13:59:57,579::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1237::DEBUG::2013-03-01 13:59:57,585::task::568::TaskManager.Task::(_updateState) Task=`ae26920c-3850-46e5-952d-d2e269943cf9`::moving from state init -> state preparing >Thread-1237::INFO::2013-03-01 13:59:57,589::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-1237::DEBUG::2013-03-01 13:59:57,656::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-1237::INFO::2013-03-01 13:59:58,072::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1237::DEBUG::2013-03-01 13:59:58,079::task::1151::TaskManager.Task::(prepare) Task=`ae26920c-3850-46e5-952d-d2e269943cf9`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1237::DEBUG::2013-03-01 13:59:58,083::task::568::TaskManager.Task::(_updateState) Task=`ae26920c-3850-46e5-952d-d2e269943cf9`::moving from state preparing -> state finished >Thread-1237::DEBUG::2013-03-01 13:59:58,087::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1237::DEBUG::2013-03-01 13:59:58,090::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1237::DEBUG::2013-03-01 13:59:58,093::task::957::TaskManager.Task::(_decref) Task=`ae26920c-3850-46e5-952d-d2e269943cf9`::ref 0 aborting False >Thread-1239::DEBUG::2013-03-01 13:59:58,225::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1239::DEBUG::2013-03-01 13:59:58,233::task::568::TaskManager.Task::(_updateState) Task=`e7dfe9a5-293f-4de6-96e5-7834023380df`::moving from state init -> state preparing >Thread-1239::INFO::2013-03-01 13:59:58,238::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', options=None) >Thread-1239::DEBUG::2013-03-01 13:59:58,241::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1239::DEBUG::2013-03-01 13:59:58,244::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1239::DEBUG::2013-03-01 13:59:58,248::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1239::DEBUG::2013-03-01 13:59:58,251::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1239::DEBUG::2013-03-01 13:59:58,256::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1239::DEBUG::2013-03-01 13:59:58,480::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1239::DEBUG::2013-03-01 13:59:58,491::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1239::DEBUG::2013-03-01 13:59:58,607::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1239::DEBUG::2013-03-01 13:59:59,660::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1239::DEBUG::2013-03-01 14:00:00,690::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1239::DEBUG::2013-03-01 14:00:01,694::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1239::DEBUG::2013-03-01 14:00:01,716::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1239::DEBUG::2013-03-01 14:00:02,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1239::DEBUG::2013-03-01 14:00:03,724::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1239::DEBUG::2013-03-01 14:00:05,728::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1239::DEBUG::2013-03-01 14:00:06,370::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1239::DEBUG::2013-03-01 14:00:06,372::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,378::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,378::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,378::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,379::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,379::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,379::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1239::DEBUG::2013-03-01 14:00:06,380::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1239::DEBUG::2013-03-01 14:00:06,381::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-1239::DEBUG::2013-03-01 14:00:06,624::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-1239::DEBUG::2013-03-01 14:00:06,625::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1239::INFO::2013-03-01 14:00:06,686::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-1239::DEBUG::2013-03-01 14:00:06,686::task::1151::TaskManager.Task::(prepare) Task=`e7dfe9a5-293f-4de6-96e5-7834023380df`::finished: {'domlist': []} >Thread-1239::DEBUG::2013-03-01 14:00:06,687::task::568::TaskManager.Task::(_updateState) Task=`e7dfe9a5-293f-4de6-96e5-7834023380df`::moving from state preparing -> state finished >Thread-1239::DEBUG::2013-03-01 14:00:06,687::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1239::DEBUG::2013-03-01 14:00:06,687::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1239::DEBUG::2013-03-01 14:00:06,687::task::957::TaskManager.Task::(_decref) Task=`e7dfe9a5-293f-4de6-96e5-7834023380df`::ref 0 aborting False >Thread-1267::DEBUG::2013-03-01 14:00:06,762::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1267::DEBUG::2013-03-01 14:00:06,762::task::568::TaskManager.Task::(_updateState) Task=`eb3b4e40-61c7-4609-9d6b-0b7e61c1835c`::moving from state init -> state preparing >Thread-1267::INFO::2013-03-01 14:00:06,763::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', domainName='nfsStorageTest_data_domain_1', typeSpecificArg='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', domClass=1, domVersion='0', options=None) >Thread-1267::DEBUG::2013-03-01 14:00:06,763::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1267::DEBUG::2013-03-01 14:00:06,764::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1267::DEBUG::2013-03-01 14:00:06,931::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1267::WARNING::2013-03-01 14:00:06,932::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1267::DEBUG::2013-03-01 14:00:06,934::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1267::INFO::2013-03-01 14:00:06,995::nfsSD::68::Storage.StorageDomain::(create) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 domainName=nfsStorageTest_data_domain_1 remotePath=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 domClass=1 >Thread-1267::DEBUG::2013-03-01 14:00:07,328::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1267::DEBUG::2013-03-01 14:00:07,330::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-1267::WARNING::2013-03-01 14:00:07,330::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1267::DEBUG::2013-03-01 14:00:07,330::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1267::DEBUG::2013-03-01 14:00:07,331::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1267::DEBUG::2013-03-01 14:00:07,331::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a1b8b7f06ddbd9ea1b5f79bea19785f032bf8f73'] >Thread-1267::DEBUG::2013-03-01 14:00:07,414::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1267::DEBUG::2013-03-01 14:00:07,431::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1267::DEBUG::2013-03-01 14:00:07,431::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1267::DEBUG::2013-03-01 14:00:07,436::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a1b8b7f06ddbd9ea1b5f79bea19785f032bf8f73'] >Thread-1267::DEBUG::2013-03-01 14:00:07,439::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1267::DEBUG::2013-03-01 14:00:07,439::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS' >Thread-1267::DEBUG::2013-03-01 14:00:07,440::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS' >Thread-1267::DEBUG::2013-03-01 14:00:07,440::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-1267::DEBUG::2013-03-01 14:00:07,473::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1267::DEBUG::2013-03-01 14:00:07,474::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-1267::INFO::2013-03-01 14:00:07,474::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-1267::DEBUG::2013-03-01 14:00:07,475::task::1151::TaskManager.Task::(prepare) Task=`eb3b4e40-61c7-4609-9d6b-0b7e61c1835c`::finished: None >Thread-1267::DEBUG::2013-03-01 14:00:07,475::task::568::TaskManager.Task::(_updateState) Task=`eb3b4e40-61c7-4609-9d6b-0b7e61c1835c`::moving from state preparing -> state finished >Thread-1267::DEBUG::2013-03-01 14:00:07,475::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1267::DEBUG::2013-03-01 14:00:07,475::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1267::DEBUG::2013-03-01 14:00:07,476::task::957::TaskManager.Task::(_decref) Task=`eb3b4e40-61c7-4609-9d6b-0b7e61c1835c`::ref 0 aborting False >Thread-1294::DEBUG::2013-03-01 14:00:07,506::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1294::DEBUG::2013-03-01 14:00:07,506::task::568::TaskManager.Task::(_updateState) Task=`e2423e78-5f86-4929-8e67-7c2204346f74`::moving from state init -> state preparing >Thread-1294::INFO::2013-03-01 14:00:07,507::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', options=None) >Thread-1294::DEBUG::2013-03-01 14:00:07,507::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`eaae31b8-45c3-4759-817a-50d03c09c37a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1294::DEBUG::2013-03-01 14:00:07,507::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'shared' >Thread-1294::DEBUG::2013-03-01 14:00:07,508::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'shared' (1 active user) >Thread-1294::DEBUG::2013-03-01 14:00:07,508::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`eaae31b8-45c3-4759-817a-50d03c09c37a`::Granted request >Thread-1294::DEBUG::2013-03-01 14:00:07,509::task::794::TaskManager.Task::(resourceAcquired) Task=`e2423e78-5f86-4929-8e67-7c2204346f74`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (shared) >Thread-1294::DEBUG::2013-03-01 14:00:07,509::task::957::TaskManager.Task::(_decref) Task=`e2423e78-5f86-4929-8e67-7c2204346f74`::ref 1 aborting False >Thread-1294::INFO::2013-03-01 14:00:07,511::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942999076864', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-1294::DEBUG::2013-03-01 14:00:07,511::task::1151::TaskManager.Task::(prepare) Task=`e2423e78-5f86-4929-8e67-7c2204346f74`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942999076864', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-1294::DEBUG::2013-03-01 14:00:07,511::task::568::TaskManager.Task::(_updateState) Task=`e2423e78-5f86-4929-8e67-7c2204346f74`::moving from state preparing -> state finished >Thread-1294::DEBUG::2013-03-01 14:00:07,511::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-1294::DEBUG::2013-03-01 14:00:07,512::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1294::DEBUG::2013-03-01 14:00:07,512::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-1294::DEBUG::2013-03-01 14:00:07,512::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-1294::DEBUG::2013-03-01 14:00:07,513::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-1294::DEBUG::2013-03-01 14:00:07,513::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-1294::DEBUG::2013-03-01 14:00:07,513::task::957::TaskManager.Task::(_decref) Task=`e2423e78-5f86-4929-8e67-7c2204346f74`::ref 0 aborting False >Thread-1295::DEBUG::2013-03-01 14:00:08,762::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1295::DEBUG::2013-03-01 14:00:08,762::task::568::TaskManager.Task::(_updateState) Task=`7aaa38ec-45d2-4c73-bb40-765bc188f425`::moving from state init -> state preparing >Thread-1295::INFO::2013-03-01 14:00:08,829::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-1295::INFO::2013-03-01 14:00:08,829::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1295::DEBUG::2013-03-01 14:00:08,830::task::1151::TaskManager.Task::(prepare) Task=`7aaa38ec-45d2-4c73-bb40-765bc188f425`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1295::DEBUG::2013-03-01 14:00:08,830::task::568::TaskManager.Task::(_updateState) Task=`7aaa38ec-45d2-4c73-bb40-765bc188f425`::moving from state preparing -> state finished >Thread-1295::DEBUG::2013-03-01 14:00:08,830::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1295::DEBUG::2013-03-01 14:00:08,830::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1295::DEBUG::2013-03-01 14:00:08,830::task::957::TaskManager.Task::(_decref) Task=`7aaa38ec-45d2-4c73-bb40-765bc188f425`::ref 0 aborting False >Thread-1296::DEBUG::2013-03-01 14:00:08,875::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1296::DEBUG::2013-03-01 14:00:08,875::task::568::TaskManager.Task::(_updateState) Task=`fbacffc3-1065-43f9-ad3d-1fdf806078d5`::moving from state init -> state preparing >Thread-1296::INFO::2013-03-01 14:00:08,876::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-1296::DEBUG::2013-03-01 14:00:08,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-1296::INFO::2013-03-01 14:00:08,952::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1296::DEBUG::2013-03-01 14:00:08,953::task::1151::TaskManager.Task::(prepare) Task=`fbacffc3-1065-43f9-ad3d-1fdf806078d5`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-1296::DEBUG::2013-03-01 14:00:08,953::task::568::TaskManager.Task::(_updateState) Task=`fbacffc3-1065-43f9-ad3d-1fdf806078d5`::moving from state preparing -> state finished >Thread-1296::DEBUG::2013-03-01 14:00:08,953::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1296::DEBUG::2013-03-01 14:00:08,953::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1296::DEBUG::2013-03-01 14:00:08,954::task::957::TaskManager.Task::(_decref) Task=`fbacffc3-1065-43f9-ad3d-1fdf806078d5`::ref 0 aborting False >Thread-1297::DEBUG::2013-03-01 14:00:08,999::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1297::DEBUG::2013-03-01 14:00:09,000::task::568::TaskManager.Task::(_updateState) Task=`1fe4ec61-7c0f-4276-a4a8-60a18fbd4f0f`::moving from state init -> state preparing >Thread-1297::INFO::2013-03-01 14:00:09,000::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', options=None) >Thread-1297::DEBUG::2013-03-01 14:00:09,000::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1297::DEBUG::2013-03-01 14:00:09,001::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1297::DEBUG::2013-03-01 14:00:09,001::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1297::DEBUG::2013-03-01 14:00:09,001::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1297::DEBUG::2013-03-01 14:00:09,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1297::DEBUG::2013-03-01 14:00:09,017::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1297::DEBUG::2013-03-01 14:00:09,017::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:09,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:10,024::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:10,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:10,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-1298::DEBUG::2013-03-01 14:00:10,040::task::568::TaskManager.Task::(_updateState) Task=`3c12a87e-169e-46f8-8e29-3423bd75e631`::moving from state init -> state preparing >Thread-1298::INFO::2013-03-01 14:00:10,041::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1298::INFO::2013-03-01 14:00:10,041::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1298::DEBUG::2013-03-01 14:00:10,041::task::1151::TaskManager.Task::(prepare) Task=`3c12a87e-169e-46f8-8e29-3423bd75e631`::finished: {} >Thread-1298::DEBUG::2013-03-01 14:00:10,041::task::568::TaskManager.Task::(_updateState) Task=`3c12a87e-169e-46f8-8e29-3423bd75e631`::moving from state preparing -> state finished >Thread-1298::DEBUG::2013-03-01 14:00:10,042::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1298::DEBUG::2013-03-01 14:00:10,042::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1298::DEBUG::2013-03-01 14:00:10,042::task::957::TaskManager.Task::(_decref) Task=`3c12a87e-169e-46f8-8e29-3423bd75e631`::ref 0 aborting False >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:11,034::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:12,038::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1297::DEBUG::2013-03-01 14:00:13,043::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1297::DEBUG::2013-03-01 14:00:15,046::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1297::DEBUG::2013-03-01 14:00:16,168::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1297::DEBUG::2013-03-01 14:00:16,171::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,171::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,172::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,172::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,172::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,173::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,173::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1297::DEBUG::2013-03-01 14:00:16,173::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1297::DEBUG::2013-03-01 14:00:16,175::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-1297::DEBUG::2013-03-01 14:00:16,358::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-1297::DEBUG::2013-03-01 14:00:16,358::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1297::INFO::2013-03-01 14:00:16,419::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-1297::DEBUG::2013-03-01 14:00:16,419::task::1151::TaskManager.Task::(prepare) Task=`1fe4ec61-7c0f-4276-a4a8-60a18fbd4f0f`::finished: {'domlist': []} >Thread-1297::DEBUG::2013-03-01 14:00:16,420::task::568::TaskManager.Task::(_updateState) Task=`1fe4ec61-7c0f-4276-a4a8-60a18fbd4f0f`::moving from state preparing -> state finished >Thread-1297::DEBUG::2013-03-01 14:00:16,420::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1297::DEBUG::2013-03-01 14:00:16,420::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1297::DEBUG::2013-03-01 14:00:16,421::task::957::TaskManager.Task::(_decref) Task=`1fe4ec61-7c0f-4276-a4a8-60a18fbd4f0f`::ref 0 aborting False >Thread-1328::DEBUG::2013-03-01 14:00:16,501::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1328::DEBUG::2013-03-01 14:00:16,501::task::568::TaskManager.Task::(_updateState) Task=`191f60c5-513c-40de-aff6-ca122432e639`::moving from state init -> state preparing >Thread-1328::INFO::2013-03-01 14:00:16,501::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', domainName='nfsStorageTest_ISO', typeSpecificArg='10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', domClass=2, domVersion='0', options=None) >Thread-1328::DEBUG::2013-03-01 14:00:16,502::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1328::DEBUG::2013-03-01 14:00:16,503::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1328::DEBUG::2013-03-01 14:00:16,669::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1328::WARNING::2013-03-01 14:00:16,670::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1328::DEBUG::2013-03-01 14:00:16,671::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1328::INFO::2013-03-01 14:00:16,733::nfsSD::68::Storage.StorageDomain::(create) sdUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc domainName=nfsStorageTest_ISO remotePath=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 domClass=2 >Thread-1328::DEBUG::2013-03-01 14:00:17,062::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1328::DEBUG::2013-03-01 14:00:17,064::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-1328::WARNING::2013-03-01 14:00:17,064::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1328::DEBUG::2013-03-01 14:00:17,064::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1328::DEBUG::2013-03-01 14:00:17,065::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1328::DEBUG::2013-03-01 14:00:17,065::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4a9fb07ec343ed4427fda9d0a28490e08d742c40'] >Thread-1328::DEBUG::2013-03-01 14:00:17,137::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1328::DEBUG::2013-03-01 14:00:17,163::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1328::DEBUG::2013-03-01 14:00:17,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1328::DEBUG::2013-03-01 14:00:17,168::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4a9fb07ec343ed4427fda9d0a28490e08d742c40'] >Thread-1328::DEBUG::2013-03-01 14:00:17,170::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1328::DEBUG::2013-03-01 14:00:17,171::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS' >Thread-1328::DEBUG::2013-03-01 14:00:17,171::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS' >Thread-1328::DEBUG::2013-03-01 14:00:17,172::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-1328::DEBUG::2013-03-01 14:00:17,213::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1328::DEBUG::2013-03-01 14:00:17,214::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-1328::INFO::2013-03-01 14:00:17,214::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-1328::DEBUG::2013-03-01 14:00:17,215::task::1151::TaskManager.Task::(prepare) Task=`191f60c5-513c-40de-aff6-ca122432e639`::finished: None >Thread-1328::DEBUG::2013-03-01 14:00:17,215::task::568::TaskManager.Task::(_updateState) Task=`191f60c5-513c-40de-aff6-ca122432e639`::moving from state preparing -> state finished >Thread-1328::DEBUG::2013-03-01 14:00:17,215::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1328::DEBUG::2013-03-01 14:00:17,215::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1328::DEBUG::2013-03-01 14:00:17,216::task::957::TaskManager.Task::(_decref) Task=`191f60c5-513c-40de-aff6-ca122432e639`::ref 0 aborting False >Thread-1355::DEBUG::2013-03-01 14:00:17,250::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1355::DEBUG::2013-03-01 14:00:17,250::task::568::TaskManager.Task::(_updateState) Task=`40c5ba6d-a6f6-426d-b3c3-c3e3f43c7f20`::moving from state init -> state preparing >Thread-1355::INFO::2013-03-01 14:00:17,251::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', options=None) >Thread-1355::DEBUG::2013-03-01 14:00:17,251::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`5db7d86c-9336-48b4-8547-3600ea5d4a79`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1355::DEBUG::2013-03-01 14:00:17,252::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' for lock type 'shared' >Thread-1355::DEBUG::2013-03-01 14:00:17,252::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free. Now locking as 'shared' (1 active user) >Thread-1355::DEBUG::2013-03-01 14:00:17,252::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`5db7d86c-9336-48b4-8547-3600ea5d4a79`::Granted request >Thread-1355::DEBUG::2013-03-01 14:00:17,253::task::794::TaskManager.Task::(resourceAcquired) Task=`40c5ba6d-a6f6-426d-b3c3-c3e3f43c7f20`::_resourcesAcquired: Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc (shared) >Thread-1355::DEBUG::2013-03-01 14:00:17,253::task::957::TaskManager.Task::(_decref) Task=`40c5ba6d-a6f6-426d-b3c3-c3e3f43c7f20`::ref 1 aborting False >Thread-1355::INFO::2013-03-01 14:00:17,255::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942991736832', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-1355::DEBUG::2013-03-01 14:00:17,255::task::1151::TaskManager.Task::(prepare) Task=`40c5ba6d-a6f6-426d-b3c3-c3e3f43c7f20`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '942991736832', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-1355::DEBUG::2013-03-01 14:00:17,255::task::568::TaskManager.Task::(_updateState) Task=`40c5ba6d-a6f6-426d-b3c3-c3e3f43c7f20`::moving from state preparing -> state finished >Thread-1355::DEBUG::2013-03-01 14:00:17,256::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc': < ResourceRef 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', isValid: 'True' obj: 'None'>} >Thread-1355::DEBUG::2013-03-01 14:00:17,256::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1355::DEBUG::2013-03-01 14:00:17,256::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' >Thread-1355::DEBUG::2013-03-01 14:00:17,257::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (0 active users) >Thread-1355::DEBUG::2013-03-01 14:00:17,257::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free, finding out if anyone is waiting for it. >Thread-1355::DEBUG::2013-03-01 14:00:17,257::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', Clearing records. >Thread-1355::DEBUG::2013-03-01 14:00:17,257::task::957::TaskManager.Task::(_decref) Task=`40c5ba6d-a6f6-426d-b3c3-c3e3f43c7f20`::ref 0 aborting False >Thread-1356::DEBUG::2013-03-01 14:00:18,552::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1356::DEBUG::2013-03-01 14:00:18,553::task::568::TaskManager.Task::(_updateState) Task=`c0da80dd-792d-44d7-a419-62242dfcb0b9`::moving from state init -> state preparing >Thread-1356::INFO::2013-03-01 14:00:18,553::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-1356::INFO::2013-03-01 14:00:18,553::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1356::DEBUG::2013-03-01 14:00:18,554::task::1151::TaskManager.Task::(prepare) Task=`c0da80dd-792d-44d7-a419-62242dfcb0b9`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1356::DEBUG::2013-03-01 14:00:18,554::task::568::TaskManager.Task::(_updateState) Task=`c0da80dd-792d-44d7-a419-62242dfcb0b9`::moving from state preparing -> state finished >Thread-1356::DEBUG::2013-03-01 14:00:18,554::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1356::DEBUG::2013-03-01 14:00:18,554::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1356::DEBUG::2013-03-01 14:00:18,555::task::957::TaskManager.Task::(_decref) Task=`c0da80dd-792d-44d7-a419-62242dfcb0b9`::ref 0 aborting False >Thread-1357::DEBUG::2013-03-01 14:00:18,585::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1357::DEBUG::2013-03-01 14:00:18,586::task::568::TaskManager.Task::(_updateState) Task=`363c30c7-aae7-46e5-8859-ea7a4e704b35`::moving from state init -> state preparing >Thread-1357::INFO::2013-03-01 14:00:18,586::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-1357::INFO::2013-03-01 14:00:18,589::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1357::DEBUG::2013-03-01 14:00:18,590::task::1151::TaskManager.Task::(prepare) Task=`363c30c7-aae7-46e5-8859-ea7a4e704b35`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1357::DEBUG::2013-03-01 14:00:18,590::task::568::TaskManager.Task::(_updateState) Task=`363c30c7-aae7-46e5-8859-ea7a4e704b35`::moving from state preparing -> state finished >Thread-1357::DEBUG::2013-03-01 14:00:18,590::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1357::DEBUG::2013-03-01 14:00:18,590::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1357::DEBUG::2013-03-01 14:00:18,591::task::957::TaskManager.Task::(_decref) Task=`363c30c7-aae7-46e5-8859-ea7a4e704b35`::ref 0 aborting False >Thread-1358::DEBUG::2013-03-01 14:00:18,621::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1358::DEBUG::2013-03-01 14:00:18,621::task::568::TaskManager.Task::(_updateState) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::moving from state init -> state preparing >Thread-1358::INFO::2013-03-01 14:00:18,621::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', poolName='nfsStorageTest', masterDom='0de0ade6-8103-4d0e-b5cc-88c1447338cc', domList=['0de0ade6-8103-4d0e-b5cc-88c1447338cc'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-1358::INFO::2013-03-01 14:00:18,622::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::DEBUG::2013-03-01 14:00:18,626::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=af66143c6cb039037d135e1d91f071d381176329'] >Thread-1358::DEBUG::2013-03-01 14:00:18,627::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`d253106f-4051-45a4-8f97-78f46b6923c9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1358::DEBUG::2013-03-01 14:00:18,628::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1358::DEBUG::2013-03-01 14:00:18,628::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1358::DEBUG::2013-03-01 14:00:18,628::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`d253106f-4051-45a4-8f97-78f46b6923c9`::Granted request >Thread-1358::DEBUG::2013-03-01 14:00:18,629::task::794::TaskManager.Task::(resourceAcquired) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1358::DEBUG::2013-03-01 14:00:18,629::task::957::TaskManager.Task::(_decref) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::ref 1 aborting False >Thread-1358::DEBUG::2013-03-01 14:00:18,630::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`f5dc51ff-abe0-4e39-99d1-f643046c3399`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1358::DEBUG::2013-03-01 14:00:18,630::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >Thread-1358::DEBUG::2013-03-01 14:00:18,630::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >Thread-1358::DEBUG::2013-03-01 14:00:18,630::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`f5dc51ff-abe0-4e39-99d1-f643046c3399`::Granted request >Thread-1358::DEBUG::2013-03-01 14:00:18,631::task::794::TaskManager.Task::(resourceAcquired) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::_resourcesAcquired: Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc (exclusive) >Thread-1358::DEBUG::2013-03-01 14:00:18,631::task::957::TaskManager.Task::(_decref) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::ref 1 aborting False >Thread-1358::INFO::2013-03-01 14:00:18,632::sp::543::Storage.StoragePool::(create) spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d poolName=nfsStorageTest master_sd=0de0ade6-8103-4d0e-b5cc-88c1447338cc domList=['0de0ade6-8103-4d0e-b5cc-88c1447338cc'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-1358::INFO::2013-03-01 14:00:18,632::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::DEBUG::2013-03-01 14:00:18,635::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=af66143c6cb039037d135e1d91f071d381176329'] >Thread-1358::DEBUG::2013-03-01 14:00:18,639::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=af66143c6cb039037d135e1d91f071d381176329'] >Thread-1358::DEBUG::2013-03-01 14:00:18,640::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1358::DEBUG::2013-03-01 14:00:18,640::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1358::DEBUG::2013-03-01 14:00:18,641::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=e09af47a18d4c33a46c260c841b2252b20585d5b'] >Thread-1358::DEBUG::2013-03-01 14:00:18,686::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1358::DEBUG::2013-03-01 14:00:18,686::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1000) >Thread-1358::DEBUG::2013-03-01 14:00:18,687::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::DEBUG::2013-03-01 14:00:18,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 0de0ade6-8103-4d0e-b5cc-88c1447338cc 1000 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-1361::DEBUG::2013-03-01 14:00:25,277::task::568::TaskManager.Task::(_updateState) Task=`2cc9013e-a395-4440-bf4e-3381aa3225e8`::moving from state init -> state preparing >Thread-1361::INFO::2013-03-01 14:00:25,278::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1361::INFO::2013-03-01 14:00:25,278::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1361::DEBUG::2013-03-01 14:00:25,278::task::1151::TaskManager.Task::(prepare) Task=`2cc9013e-a395-4440-bf4e-3381aa3225e8`::finished: {} >Thread-1361::DEBUG::2013-03-01 14:00:25,279::task::568::TaskManager.Task::(_updateState) Task=`2cc9013e-a395-4440-bf4e-3381aa3225e8`::moving from state preparing -> state finished >Thread-1361::DEBUG::2013-03-01 14:00:25,279::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1361::DEBUG::2013-03-01 14:00:25,279::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1361::DEBUG::2013-03-01 14:00:25,279::task::957::TaskManager.Task::(_decref) Task=`2cc9013e-a395-4440-bf4e-3381aa3225e8`::ref 0 aborting False >Thread-1358::DEBUG::2013-03-01 14:00:38,776::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1358::DEBUG::2013-03-01 14:00:38,776::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-1358::INFO::2013-03-01 14:00:38,777::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 35b6dfb7-cf75-44b4-9bc5-c190faab989d on sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::DEBUG::2013-03-01 14:00:38,777::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1358::DEBUG::2013-03-01 14:00:38,778::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1358::DEBUG::2013-03-01 14:00:38,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=e09af47a18d4c33a46c260c841b2252b20585d5b'] >Thread-1358::DEBUG::2013-03-01 14:00:38,784::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1358::DEBUG::2013-03-01 14:00:38,784::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1358::DEBUG::2013-03-01 14:00:38,784::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1358::DEBUG::2013-03-01 14:00:38,784::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1358::DEBUG::2013-03-01 14:00:38,785::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >Thread-1358::DEBUG::2013-03-01 14:00:38,838::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1358::DEBUG::2013-03-01 14:00:38,838::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1358::DEBUG::2013-03-01 14:00:38,839::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1358::DEBUG::2013-03-01 14:00:38,839::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1358::DEBUG::2013-03-01 14:00:38,844::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >Thread-1367::DEBUG::2013-03-01 14:00:38,845::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::DEBUG::2013-03-01 14:00:38,845::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` started monitoring domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >Thread-1358::DEBUG::2013-03-01 14:00:38,847::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1358::WARNING::2013-03-01 14:00:38,849::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1358::DEBUG::2013-03-01 14:00:38,855::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1358::DEBUG::2013-03-01 14:00:38,866::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-1358::DEBUG::2013-03-01 14:00:39,075::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-1358::DEBUG::2013-03-01 14:00:39,076::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1358::INFO::2013-03-01 14:00:39,138::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::INFO::2013-03-01 14:00:39,139::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1358::INFO::2013-03-01 14:00:39,139::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1358::DEBUG::2013-03-01 14:00:39,140::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd /usr/libexec/vdsm) >Thread-1358::DEBUG::2013-03-01 14:00:40,275::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1358::DEBUG::2013-03-01 14:00:40,283::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-1358::DEBUG::2013-03-01 14:00:40,287::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc released successfully (id: 1000) >Thread-1367::DEBUG::2013-03-01 14:00:40,294::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1367::DEBUG::2013-03-01 14:00:40,297::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc released successfully (id: 1000) >Thread-1358::INFO::2013-03-01 14:00:40,305::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-1358::DEBUG::2013-03-01 14:00:40,309::task::1151::TaskManager.Task::(prepare) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::finished: True >Thread-1358::DEBUG::2013-03-01 14:00:40,312::task::568::TaskManager.Task::(_updateState) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::moving from state preparing -> state finished >Thread-1358::DEBUG::2013-03-01 14:00:40,316::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc': < ResourceRef 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', isValid: 'True' obj: 'None'>} >Thread-1358::DEBUG::2013-03-01 14:00:40,320::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1358::DEBUG::2013-03-01 14:00:40,327::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1358::DEBUG::2013-03-01 14:00:40,332::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1358::DEBUG::2013-03-01 14:00:40,334::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1358::DEBUG::2013-03-01 14:00:40,337::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1358::DEBUG::2013-03-01 14:00:40,344::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >Thread-1358::DEBUG::2013-03-01 14:00:40,348::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >Thread-1358::DEBUG::2013-03-01 14:00:40,350::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >Thread-1358::DEBUG::2013-03-01 14:00:40,353::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >Thread-1358::DEBUG::2013-03-01 14:00:40,358::task::957::TaskManager.Task::(_decref) Task=`0d5a614e-c964-46c6-918d-74f741b0204f`::ref 0 aborting False >Thread-1394::DEBUG::2013-03-01 14:00:40,516::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1394::DEBUG::2013-03-01 14:00:40,524::task::568::TaskManager.Task::(_updateState) Task=`03a47a6a-a20f-4816-8ca2-0e18e54683ad`::moving from state init -> state preparing >Thread-1394::INFO::2013-03-01 14:00:40,529::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-1394::INFO::2013-03-01 14:00:40,532::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1394::DEBUG::2013-03-01 14:00:40,535::task::1151::TaskManager.Task::(prepare) Task=`03a47a6a-a20f-4816-8ca2-0e18e54683ad`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1394::DEBUG::2013-03-01 14:00:40,539::task::568::TaskManager.Task::(_updateState) Task=`03a47a6a-a20f-4816-8ca2-0e18e54683ad`::moving from state preparing -> state finished >Thread-1394::DEBUG::2013-03-01 14:00:40,542::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1394::DEBUG::2013-03-01 14:00:40,544::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1394::DEBUG::2013-03-01 14:00:40,548::task::957::TaskManager.Task::(_decref) Task=`03a47a6a-a20f-4816-8ca2-0e18e54683ad`::ref 0 aborting False >Thread-1395::DEBUG::2013-03-01 14:00:40,663::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1395::DEBUG::2013-03-01 14:00:40,671::task::568::TaskManager.Task::(_updateState) Task=`277c3303-6677-4c78-815f-ffeb4daf59a9`::moving from state init -> state preparing >Thread-1395::INFO::2013-03-01 14:00:40,688::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-1396::DEBUG::2013-03-01 14:00:40,714::task::568::TaskManager.Task::(_updateState) Task=`1400eb25-5004-470a-a862-5d4110070c87`::moving from state init -> state preparing >Thread-1396::INFO::2013-03-01 14:00:40,729::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1396::INFO::2013-03-01 14:00:40,738::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1396::DEBUG::2013-03-01 14:00:40,747::task::1151::TaskManager.Task::(prepare) Task=`1400eb25-5004-470a-a862-5d4110070c87`::finished: {} >Thread-1396::DEBUG::2013-03-01 14:00:40,759::task::568::TaskManager.Task::(_updateState) Task=`1400eb25-5004-470a-a862-5d4110070c87`::moving from state preparing -> state finished >Thread-1396::DEBUG::2013-03-01 14:00:40,771::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1396::DEBUG::2013-03-01 14:00:40,779::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1396::DEBUG::2013-03-01 14:00:40,782::task::957::TaskManager.Task::(_decref) Task=`1400eb25-5004-470a-a862-5d4110070c87`::ref 0 aborting False >Thread-1395::INFO::2013-03-01 14:00:40,896::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1395::DEBUG::2013-03-01 14:00:40,913::task::1151::TaskManager.Task::(prepare) Task=`277c3303-6677-4c78-815f-ffeb4daf59a9`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-1395::DEBUG::2013-03-01 14:00:40,931::task::568::TaskManager.Task::(_updateState) Task=`277c3303-6677-4c78-815f-ffeb4daf59a9`::moving from state preparing -> state finished >Thread-1395::DEBUG::2013-03-01 14:00:40,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1395::DEBUG::2013-03-01 14:00:40,972::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1395::DEBUG::2013-03-01 14:00:41,006::task::957::TaskManager.Task::(_decref) Task=`277c3303-6677-4c78-815f-ffeb4daf59a9`::ref 0 aborting False >Thread-1398::DEBUG::2013-03-01 14:00:41,226::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1398::DEBUG::2013-03-01 14:00:41,232::task::568::TaskManager.Task::(_updateState) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::moving from state init -> state preparing >Thread-1398::INFO::2013-03-01 14:00:41,235::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1398::ERROR::2013-03-01 14:00:41,239::task::833::TaskManager.Task::(_setError) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 603, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 313, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('35b6dfb7-cf75-44b4-9bc5-c190faab989d',) >Thread-1398::DEBUG::2013-03-01 14:00:41,322::task::852::TaskManager.Task::(_run) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::Task._run: 5b955d0c-2e4b-4436-a5ed-e98f124abe8e ('35b6dfb7-cf75-44b4-9bc5-c190faab989d',) {} failed - stopping task >Thread-1398::DEBUG::2013-03-01 14:00:41,325::task::1177::TaskManager.Task::(stop) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::stopping in state preparing (force False) >Thread-1398::DEBUG::2013-03-01 14:00:41,328::task::957::TaskManager.Task::(_decref) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::ref 1 aborting True >Thread-1398::INFO::2013-03-01 14:00:41,331::task::1134::TaskManager.Task::(prepare) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-1398::DEBUG::2013-03-01 14:00:41,334::task::1139::TaskManager.Task::(prepare) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::Prepare: aborted: Unknown pool id, pool not connected >Thread-1398::DEBUG::2013-03-01 14:00:41,337::task::957::TaskManager.Task::(_decref) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::ref 0 aborting True >Thread-1398::DEBUG::2013-03-01 14:00:41,340::task::892::TaskManager.Task::(_doAbort) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::Task._doAbort: force False >Thread-1398::DEBUG::2013-03-01 14:00:41,343::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1398::DEBUG::2013-03-01 14:00:41,346::task::568::TaskManager.Task::(_updateState) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::moving from state preparing -> state aborting >Thread-1398::DEBUG::2013-03-01 14:00:41,349::task::523::TaskManager.Task::(__state_aborting) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::_aborting: recover policy none >Thread-1398::DEBUG::2013-03-01 14:00:41,351::task::568::TaskManager.Task::(_updateState) Task=`5b955d0c-2e4b-4436-a5ed-e98f124abe8e`::moving from state aborting -> state failed >Thread-1398::DEBUG::2013-03-01 14:00:41,354::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1398::DEBUG::2013-03-01 14:00:41,357::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1398::ERROR::2013-03-01 14:00:41,360::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('35b6dfb7-cf75-44b4-9bc5-c190faab989d',)", 'code': 309}} >Thread-1399::DEBUG::2013-03-01 14:00:41,468::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1399::DEBUG::2013-03-01 14:00:41,473::task::568::TaskManager.Task::(_updateState) Task=`516d6995-130e-4485-80eb-e292c41a7737`::moving from state init -> state preparing >Thread-1399::INFO::2013-03-01 14:00:41,477::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', hostID=1, scsiKey='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1399::DEBUG::2013-03-01 14:00:41,484::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`a43f36e9-ef32-4bf8-a7eb-1be6c9f5630d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1399::DEBUG::2013-03-01 14:00:41,487::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1399::DEBUG::2013-03-01 14:00:41,491::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1399::DEBUG::2013-03-01 14:00:41,494::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`a43f36e9-ef32-4bf8-a7eb-1be6c9f5630d`::Granted request >Thread-1399::INFO::2013-03-01 14:00:41,502::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 35b6dfb7-cf75-44b4-9bc5-c190faab989d with master domain: 0de0ade6-8103-4d0e-b5cc-88c1447338cc (ver = 1) >Thread-1399::DEBUG::2013-03-01 14:00:41,509::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:41,513::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:41,517::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:41,520::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:41,524::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:41,528::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:41,534::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1399::DEBUG::2013-03-01 14:00:41,537::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1399::DEBUG::2013-03-01 14:00:41,540::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1399::DEBUG::2013-03-01 14:00:41,543::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1399::DEBUG::2013-03-01 14:00:41,547::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1399::DEBUG::2013-03-01 14:00:41,773::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1399::DEBUG::2013-03-01 14:00:41,783::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:41,820::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:42,871::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:42,875::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:43,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:44,883::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:45,887::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1399::DEBUG::2013-03-01 14:00:46,892::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1399::DEBUG::2013-03-01 14:00:48,895::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1399::DEBUG::2013-03-01 14:00:49,980::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1399::DEBUG::2013-03-01 14:00:49,981::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,981::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,981::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,982::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,982::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,983::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,983::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1399::DEBUG::2013-03-01 14:00:49,983::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:49,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1399::DEBUG::2013-03-01 14:00:50,207::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1399::WARNING::2013-03-01 14:00:50,208::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1399::DEBUG::2013-03-01 14:00:50,209::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:50,349::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1399::DEBUG::2013-03-01 14:00:50,349::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1399::DEBUG::2013-03-01 14:00:50,353::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >Thread-1399::DEBUG::2013-03-01 14:00:50,355::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1399::WARNING::2013-03-01 14:00:50,355::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-1399::WARNING::2013-03-01 14:00:50,356::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-1399::DEBUG::2013-03-01 14:00:50,356::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1399::DEBUG::2013-03-01 14:00:50,356::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1399::DEBUG::2013-03-01 14:00:50,357::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1399::DEBUG::2013-03-01 14:00:50,360::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >Thread-1399::DEBUG::2013-03-01 14:00:50,361::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` started monitoring domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >Thread-1429::DEBUG::2013-03-01 14:00:50,361::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1399::DEBUG::2013-03-01 14:00:50,362::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1399::WARNING::2013-03-01 14:00:50,363::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1399::DEBUG::2013-03-01 14:00:50,367::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1399::DEBUG::2013-03-01 14:00:50,372::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-1399::DEBUG::2013-03-01 14:00:50,550::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-1399::DEBUG::2013-03-01 14:00:50,550::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1399::INFO::2013-03-01 14:00:50,609::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1399::INFO::2013-03-01 14:00:50,610::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1399::DEBUG::2013-03-01 14:00:50,610::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1399::DEBUG::2013-03-01 14:00:50,611::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1399::DEBUG::2013-03-01 14:00:50,611::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1399::DEBUG::2013-03-01 14:00:50,611::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1399::INFO::2013-03-01 14:00:50,612::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-1399::DEBUG::2013-03-01 14:00:50,612::task::1151::TaskManager.Task::(prepare) Task=`516d6995-130e-4485-80eb-e292c41a7737`::finished: True >Thread-1399::DEBUG::2013-03-01 14:00:50,612::task::568::TaskManager.Task::(_updateState) Task=`516d6995-130e-4485-80eb-e292c41a7737`::moving from state preparing -> state finished >Thread-1399::DEBUG::2013-03-01 14:00:50,613::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1399::DEBUG::2013-03-01 14:00:50,613::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1399::DEBUG::2013-03-01 14:00:50,613::task::957::TaskManager.Task::(_decref) Task=`516d6995-130e-4485-80eb-e292c41a7737`::ref 0 aborting False >Thread-1456::DEBUG::2013-03-01 14:00:50,638::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1456::DEBUG::2013-03-01 14:00:50,639::task::568::TaskManager.Task::(_updateState) Task=`76cc432a-4f7c-48ad-9fa3-115ef8fbbf57`::moving from state init -> state preparing >Thread-1456::INFO::2013-03-01 14:00:50,639::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1456::INFO::2013-03-01 14:00:50,640::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-1456::DEBUG::2013-03-01 14:00:50,640::task::1151::TaskManager.Task::(prepare) Task=`76cc432a-4f7c-48ad-9fa3-115ef8fbbf57`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-1456::DEBUG::2013-03-01 14:00:50,640::task::568::TaskManager.Task::(_updateState) Task=`76cc432a-4f7c-48ad-9fa3-115ef8fbbf57`::moving from state preparing -> state finished >Thread-1456::DEBUG::2013-03-01 14:00:50,640::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1456::DEBUG::2013-03-01 14:00:50,641::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1456::DEBUG::2013-03-01 14:00:50,641::task::957::TaskManager.Task::(_decref) Task=`76cc432a-4f7c-48ad-9fa3-115ef8fbbf57`::ref 0 aborting False >Thread-1457::DEBUG::2013-03-01 14:00:50,677::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1457::DEBUG::2013-03-01 14:00:50,677::task::568::TaskManager.Task::(_updateState) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::moving from state init -> state preparing >Thread-1457::INFO::2013-03-01 14:00:50,677::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-1457::DEBUG::2013-03-01 14:00:50,678::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`2a517b1b-dd09-46bd-9a7f-5907cd0e5802`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1457::DEBUG::2013-03-01 14:00:50,678::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1457::DEBUG::2013-03-01 14:00:50,679::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1457::DEBUG::2013-03-01 14:00:50,679::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`2a517b1b-dd09-46bd-9a7f-5907cd0e5802`::Granted request >Thread-1457::DEBUG::2013-03-01 14:00:50,680::task::794::TaskManager.Task::(resourceAcquired) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1457::DEBUG::2013-03-01 14:00:50,680::task::957::TaskManager.Task::(_decref) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::ref 1 aborting False >Thread-1457::INFO::2013-03-01 14:00:50,680::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-1457::DEBUG::2013-03-01 14:00:50,680::task::1146::TaskManager.Task::(prepare) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::Prepare: 1 jobs exist, move to acquiring >Thread-1457::DEBUG::2013-03-01 14:00:50,681::task::568::TaskManager.Task::(_updateState) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::moving from state preparing -> state acquiring >Thread-1457::DEBUG::2013-03-01 14:00:50,681::task::568::TaskManager.Task::(_updateState) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::moving from state acquiring -> state queued >Thread-1457::DEBUG::2013-03-01 14:00:50,681::taskManager::50::TaskManager::(_queueTask) queuing task: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1457::DEBUG::2013-03-01 14:00:50,681::taskManager::56::TaskManager::(_queueTask) task queued: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-9::DEBUG::2013-03-01 14:00:50,682::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-1457::DEBUG::2013-03-01 14:00:50,683::task::1148::TaskManager.Task::(prepare) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::returning >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,683::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 running: <bound method Task.commit of <storage.task.Task instance at 0x7fbb6813f488>> with: None >Thread-1457::DEBUG::2013-03-01 14:00:50,684::task::957::TaskManager.Task::(_decref) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::ref 0 aborting False >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,684::task::1159::TaskManager.Task::(commit) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::committing task: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,685::task::568::TaskManager.Task::(_updateState) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::moving from state queued -> state running >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,686::task::872::TaskManager.Task::(_runJobs) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fbb6828b550>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,688::task::304::TaskManager.Task::(run) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fbb6828b550>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,688::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,688::misc::1055::SamplingMethod::(__call__) Got in to sampling method >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,692::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,692::misc::1063::SamplingMethod::(__call__) Returning last result >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,696::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,697::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,697::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:00:50,698::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 0de0ade6-8103-4d0e-b5cc-88c1447338cc 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-1458::DEBUG::2013-03-01 14:00:51,720::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1458::DEBUG::2013-03-01 14:00:51,720::task::568::TaskManager.Task::(_updateState) Task=`8262edee-9abb-4909-808d-32f486aabd0f`::moving from state init -> state preparing >Thread-1458::INFO::2013-03-01 14:00:51,721::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1458::DEBUG::2013-03-01 14:00:51,721::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1458::DEBUG::2013-03-01 14:00:51,721::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1458::INFO::2013-03-01 14:00:51,721::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1458::DEBUG::2013-03-01 14:00:51,722::task::1151::TaskManager.Task::(prepare) Task=`8262edee-9abb-4909-808d-32f486aabd0f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1458::DEBUG::2013-03-01 14:00:51,722::task::568::TaskManager.Task::(_updateState) Task=`8262edee-9abb-4909-808d-32f486aabd0f`::moving from state preparing -> state finished >Thread-1458::DEBUG::2013-03-01 14:00:51,722::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1458::DEBUG::2013-03-01 14:00:51,723::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1458::DEBUG::2013-03-01 14:00:51,723::task::957::TaskManager.Task::(_decref) Task=`8262edee-9abb-4909-808d-32f486aabd0f`::ref 0 aborting False >Thread-1459::DEBUG::2013-03-01 14:00:52,751::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1459::DEBUG::2013-03-01 14:00:52,751::task::568::TaskManager.Task::(_updateState) Task=`4617eed2-ef0e-4702-bc5e-d2a1d7fa62cd`::moving from state init -> state preparing >Thread-1459::INFO::2013-03-01 14:00:52,752::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1459::DEBUG::2013-03-01 14:00:52,752::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1459::DEBUG::2013-03-01 14:00:52,752::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1459::INFO::2013-03-01 14:00:52,752::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1459::DEBUG::2013-03-01 14:00:52,753::task::1151::TaskManager.Task::(prepare) Task=`4617eed2-ef0e-4702-bc5e-d2a1d7fa62cd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1459::DEBUG::2013-03-01 14:00:52,753::task::568::TaskManager.Task::(_updateState) Task=`4617eed2-ef0e-4702-bc5e-d2a1d7fa62cd`::moving from state preparing -> state finished >Thread-1459::DEBUG::2013-03-01 14:00:52,753::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1459::DEBUG::2013-03-01 14:00:52,753::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1459::DEBUG::2013-03-01 14:00:52,754::task::957::TaskManager.Task::(_decref) Task=`4617eed2-ef0e-4702-bc5e-d2a1d7fa62cd`::ref 0 aborting False >Thread-1461::DEBUG::2013-03-01 14:00:53,781::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1461::DEBUG::2013-03-01 14:00:53,782::task::568::TaskManager.Task::(_updateState) Task=`5b5c587f-49e8-4d38-a065-37c5ffbdc83d`::moving from state init -> state preparing >Thread-1461::INFO::2013-03-01 14:00:53,782::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1461::DEBUG::2013-03-01 14:00:53,782::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1461::DEBUG::2013-03-01 14:00:53,783::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1461::INFO::2013-03-01 14:00:53,783::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1461::DEBUG::2013-03-01 14:00:53,783::task::1151::TaskManager.Task::(prepare) Task=`5b5c587f-49e8-4d38-a065-37c5ffbdc83d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1461::DEBUG::2013-03-01 14:00:53,783::task::568::TaskManager.Task::(_updateState) Task=`5b5c587f-49e8-4d38-a065-37c5ffbdc83d`::moving from state preparing -> state finished >Thread-1461::DEBUG::2013-03-01 14:00:53,784::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1461::DEBUG::2013-03-01 14:00:53,784::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1461::DEBUG::2013-03-01 14:00:53,784::task::957::TaskManager.Task::(_decref) Task=`5b5c587f-49e8-4d38-a065-37c5ffbdc83d`::ref 0 aborting False >Thread-1462::DEBUG::2013-03-01 14:00:54,812::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1462::DEBUG::2013-03-01 14:00:54,812::task::568::TaskManager.Task::(_updateState) Task=`5b4a24f9-7ff1-4726-82ee-2b009f639f65`::moving from state init -> state preparing >Thread-1462::INFO::2013-03-01 14:00:54,813::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1462::DEBUG::2013-03-01 14:00:54,813::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1462::DEBUG::2013-03-01 14:00:54,813::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1462::INFO::2013-03-01 14:00:54,813::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1462::DEBUG::2013-03-01 14:00:54,814::task::1151::TaskManager.Task::(prepare) Task=`5b4a24f9-7ff1-4726-82ee-2b009f639f65`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1462::DEBUG::2013-03-01 14:00:54,814::task::568::TaskManager.Task::(_updateState) Task=`5b4a24f9-7ff1-4726-82ee-2b009f639f65`::moving from state preparing -> state finished >Thread-1462::DEBUG::2013-03-01 14:00:54,814::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1462::DEBUG::2013-03-01 14:00:54,814::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1462::DEBUG::2013-03-01 14:00:54,815::task::957::TaskManager.Task::(_decref) Task=`5b4a24f9-7ff1-4726-82ee-2b009f639f65`::ref 0 aborting False >Thread-1463::DEBUG::2013-03-01 14:00:55,843::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1463::DEBUG::2013-03-01 14:00:55,843::task::568::TaskManager.Task::(_updateState) Task=`69d46dc2-c01c-42d0-a009-4e948af3a335`::moving from state init -> state preparing >Thread-1463::INFO::2013-03-01 14:00:55,843::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1463::DEBUG::2013-03-01 14:00:55,844::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1463::DEBUG::2013-03-01 14:00:55,844::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1463::INFO::2013-03-01 14:00:55,844::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1463::DEBUG::2013-03-01 14:00:55,844::task::1151::TaskManager.Task::(prepare) Task=`69d46dc2-c01c-42d0-a009-4e948af3a335`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1463::DEBUG::2013-03-01 14:00:55,845::task::568::TaskManager.Task::(_updateState) Task=`69d46dc2-c01c-42d0-a009-4e948af3a335`::moving from state preparing -> state finished >Thread-1463::DEBUG::2013-03-01 14:00:55,845::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1463::DEBUG::2013-03-01 14:00:55,845::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1463::DEBUG::2013-03-01 14:00:55,845::task::957::TaskManager.Task::(_decref) Task=`69d46dc2-c01c-42d0-a009-4e948af3a335`::ref 0 aborting False >Thread-1464::DEBUG::2013-03-01 14:00:56,390::task::568::TaskManager.Task::(_updateState) Task=`c134d65c-a4ef-41c9-b704-84bdc612e343`::moving from state init -> state preparing >Thread-1464::INFO::2013-03-01 14:00:56,391::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1464::INFO::2013-03-01 14:00:56,391::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00280690193176', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-1464::DEBUG::2013-03-01 14:00:56,391::task::1151::TaskManager.Task::(prepare) Task=`c134d65c-a4ef-41c9-b704-84bdc612e343`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00280690193176', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-1464::DEBUG::2013-03-01 14:00:56,391::task::568::TaskManager.Task::(_updateState) Task=`c134d65c-a4ef-41c9-b704-84bdc612e343`::moving from state preparing -> state finished >Thread-1464::DEBUG::2013-03-01 14:00:56,392::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1464::DEBUG::2013-03-01 14:00:56,392::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1464::DEBUG::2013-03-01 14:00:56,392::task::957::TaskManager.Task::(_decref) Task=`c134d65c-a4ef-41c9-b704-84bdc612e343`::ref 0 aborting False >Thread-1466::DEBUG::2013-03-01 14:00:56,874::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1466::DEBUG::2013-03-01 14:00:56,874::task::568::TaskManager.Task::(_updateState) Task=`33d06ded-8b28-41d9-873c-7ab5a39be549`::moving from state init -> state preparing >Thread-1466::INFO::2013-03-01 14:00:56,874::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1466::DEBUG::2013-03-01 14:00:56,875::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1466::DEBUG::2013-03-01 14:00:56,875::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1466::INFO::2013-03-01 14:00:56,875::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1466::DEBUG::2013-03-01 14:00:56,875::task::1151::TaskManager.Task::(prepare) Task=`33d06ded-8b28-41d9-873c-7ab5a39be549`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1466::DEBUG::2013-03-01 14:00:56,876::task::568::TaskManager.Task::(_updateState) Task=`33d06ded-8b28-41d9-873c-7ab5a39be549`::moving from state preparing -> state finished >Thread-1466::DEBUG::2013-03-01 14:00:56,876::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1466::DEBUG::2013-03-01 14:00:56,876::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1466::DEBUG::2013-03-01 14:00:56,876::task::957::TaskManager.Task::(_decref) Task=`33d06ded-8b28-41d9-873c-7ab5a39be549`::ref 0 aborting False >Thread-1467::DEBUG::2013-03-01 14:00:57,908::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1467::DEBUG::2013-03-01 14:00:57,908::task::568::TaskManager.Task::(_updateState) Task=`3662bb63-1c4b-4207-a0f2-c100d361a333`::moving from state init -> state preparing >Thread-1467::INFO::2013-03-01 14:00:57,909::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1467::DEBUG::2013-03-01 14:00:57,909::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1467::DEBUG::2013-03-01 14:00:57,909::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1467::INFO::2013-03-01 14:00:57,909::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1467::DEBUG::2013-03-01 14:00:57,910::task::1151::TaskManager.Task::(prepare) Task=`3662bb63-1c4b-4207-a0f2-c100d361a333`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1467::DEBUG::2013-03-01 14:00:57,910::task::568::TaskManager.Task::(_updateState) Task=`3662bb63-1c4b-4207-a0f2-c100d361a333`::moving from state preparing -> state finished >Thread-1467::DEBUG::2013-03-01 14:00:57,910::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1467::DEBUG::2013-03-01 14:00:57,910::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1467::DEBUG::2013-03-01 14:00:57,911::task::957::TaskManager.Task::(_decref) Task=`3662bb63-1c4b-4207-a0f2-c100d361a333`::ref 0 aborting False >Thread-1468::DEBUG::2013-03-01 14:00:58,938::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1468::DEBUG::2013-03-01 14:00:58,939::task::568::TaskManager.Task::(_updateState) Task=`fe57e4ce-004e-4cc4-adca-ea12913bb588`::moving from state init -> state preparing >Thread-1468::INFO::2013-03-01 14:00:58,939::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1468::DEBUG::2013-03-01 14:00:58,939::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1468::DEBUG::2013-03-01 14:00:58,939::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1468::INFO::2013-03-01 14:00:58,940::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1468::DEBUG::2013-03-01 14:00:58,940::task::1151::TaskManager.Task::(prepare) Task=`fe57e4ce-004e-4cc4-adca-ea12913bb588`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1468::DEBUG::2013-03-01 14:00:58,940::task::568::TaskManager.Task::(_updateState) Task=`fe57e4ce-004e-4cc4-adca-ea12913bb588`::moving from state preparing -> state finished >Thread-1468::DEBUG::2013-03-01 14:00:58,940::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1468::DEBUG::2013-03-01 14:00:58,941::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1468::DEBUG::2013-03-01 14:00:58,941::task::957::TaskManager.Task::(_decref) Task=`fe57e4ce-004e-4cc4-adca-ea12913bb588`::ref 0 aborting False >Thread-1470::DEBUG::2013-03-01 14:00:59,969::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1470::DEBUG::2013-03-01 14:00:59,970::task::568::TaskManager.Task::(_updateState) Task=`2056e143-0071-4381-8716-1bcb5a6dfe2f`::moving from state init -> state preparing >Thread-1470::INFO::2013-03-01 14:00:59,970::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1470::DEBUG::2013-03-01 14:00:59,970::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1470::DEBUG::2013-03-01 14:00:59,970::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1470::INFO::2013-03-01 14:00:59,970::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1470::DEBUG::2013-03-01 14:00:59,971::task::1151::TaskManager.Task::(prepare) Task=`2056e143-0071-4381-8716-1bcb5a6dfe2f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1470::DEBUG::2013-03-01 14:00:59,971::task::568::TaskManager.Task::(_updateState) Task=`2056e143-0071-4381-8716-1bcb5a6dfe2f`::moving from state preparing -> state finished >Thread-1470::DEBUG::2013-03-01 14:00:59,971::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1470::DEBUG::2013-03-01 14:00:59,971::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1470::DEBUG::2013-03-01 14:00:59,972::task::957::TaskManager.Task::(_decref) Task=`2056e143-0071-4381-8716-1bcb5a6dfe2f`::ref 0 aborting False >Thread-1471::DEBUG::2013-03-01 14:01:01,000::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1471::DEBUG::2013-03-01 14:01:01,000::task::568::TaskManager.Task::(_updateState) Task=`fd6e886f-77c0-4b76-a2e9-24e6d0f33fea`::moving from state init -> state preparing >Thread-1471::INFO::2013-03-01 14:01:01,001::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1471::DEBUG::2013-03-01 14:01:01,001::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1471::DEBUG::2013-03-01 14:01:01,001::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1471::INFO::2013-03-01 14:01:01,001::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1471::DEBUG::2013-03-01 14:01:01,002::task::1151::TaskManager.Task::(prepare) Task=`fd6e886f-77c0-4b76-a2e9-24e6d0f33fea`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1471::DEBUG::2013-03-01 14:01:01,002::task::568::TaskManager.Task::(_updateState) Task=`fd6e886f-77c0-4b76-a2e9-24e6d0f33fea`::moving from state preparing -> state finished >Thread-1471::DEBUG::2013-03-01 14:01:01,002::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1471::DEBUG::2013-03-01 14:01:01,002::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1471::DEBUG::2013-03-01 14:01:01,003::task::957::TaskManager.Task::(_decref) Task=`fd6e886f-77c0-4b76-a2e9-24e6d0f33fea`::ref 0 aborting False >Thread-1472::DEBUG::2013-03-01 14:01:02,117::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1472::DEBUG::2013-03-01 14:01:02,135::task::568::TaskManager.Task::(_updateState) Task=`8e1b550d-8d03-43b0-9775-24a03a7f43a4`::moving from state init -> state preparing >Thread-1472::INFO::2013-03-01 14:01:02,138::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1472::DEBUG::2013-03-01 14:01:02,141::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1472::DEBUG::2013-03-01 14:01:02,143::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1472::INFO::2013-03-01 14:01:02,146::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1472::DEBUG::2013-03-01 14:01:02,148::task::1151::TaskManager.Task::(prepare) Task=`8e1b550d-8d03-43b0-9775-24a03a7f43a4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1472::DEBUG::2013-03-01 14:01:02,151::task::568::TaskManager.Task::(_updateState) Task=`8e1b550d-8d03-43b0-9775-24a03a7f43a4`::moving from state preparing -> state finished >Thread-1472::DEBUG::2013-03-01 14:01:02,154::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1472::DEBUG::2013-03-01 14:01:02,156::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1472::DEBUG::2013-03-01 14:01:02,159::task::957::TaskManager.Task::(_decref) Task=`8e1b550d-8d03-43b0-9775-24a03a7f43a4`::ref 0 aborting False >Thread-1474::DEBUG::2013-03-01 14:01:03,269::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1474::DEBUG::2013-03-01 14:01:03,278::task::568::TaskManager.Task::(_updateState) Task=`ac056065-d453-4a42-9d2c-16895bc9ee8f`::moving from state init -> state preparing >Thread-1474::INFO::2013-03-01 14:01:03,282::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1474::DEBUG::2013-03-01 14:01:03,284::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1474::DEBUG::2013-03-01 14:01:03,287::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1474::INFO::2013-03-01 14:01:03,289::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1474::DEBUG::2013-03-01 14:01:03,292::task::1151::TaskManager.Task::(prepare) Task=`ac056065-d453-4a42-9d2c-16895bc9ee8f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1474::DEBUG::2013-03-01 14:01:03,295::task::568::TaskManager.Task::(_updateState) Task=`ac056065-d453-4a42-9d2c-16895bc9ee8f`::moving from state preparing -> state finished >Thread-1474::DEBUG::2013-03-01 14:01:03,297::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1474::DEBUG::2013-03-01 14:01:03,300::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1474::DEBUG::2013-03-01 14:01:03,302::task::957::TaskManager.Task::(_decref) Task=`ac056065-d453-4a42-9d2c-16895bc9ee8f`::ref 0 aborting False >Thread-1475::DEBUG::2013-03-01 14:01:04,339::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1475::DEBUG::2013-03-01 14:01:04,340::task::568::TaskManager.Task::(_updateState) Task=`6ef392a5-6b4e-48a5-ba50-e3c11d7455da`::moving from state init -> state preparing >Thread-1475::INFO::2013-03-01 14:01:04,340::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1475::DEBUG::2013-03-01 14:01:04,340::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1475::DEBUG::2013-03-01 14:01:04,341::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1475::INFO::2013-03-01 14:01:04,341::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1475::DEBUG::2013-03-01 14:01:04,341::task::1151::TaskManager.Task::(prepare) Task=`6ef392a5-6b4e-48a5-ba50-e3c11d7455da`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1475::DEBUG::2013-03-01 14:01:04,341::task::568::TaskManager.Task::(_updateState) Task=`6ef392a5-6b4e-48a5-ba50-e3c11d7455da`::moving from state preparing -> state finished >Thread-1475::DEBUG::2013-03-01 14:01:04,342::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1475::DEBUG::2013-03-01 14:01:04,342::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1475::DEBUG::2013-03-01 14:01:04,342::task::957::TaskManager.Task::(_decref) Task=`6ef392a5-6b4e-48a5-ba50-e3c11d7455da`::ref 0 aborting False >Thread-1476::DEBUG::2013-03-01 14:01:05,434::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1476::DEBUG::2013-03-01 14:01:05,439::task::568::TaskManager.Task::(_updateState) Task=`5438f3a3-7627-46cc-a1f0-7e62cc49a39e`::moving from state init -> state preparing >Thread-1476::INFO::2013-03-01 14:01:05,442::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1476::DEBUG::2013-03-01 14:01:05,444::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1476::DEBUG::2013-03-01 14:01:05,447::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1476::INFO::2013-03-01 14:01:05,450::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1476::DEBUG::2013-03-01 14:01:05,453::task::1151::TaskManager.Task::(prepare) Task=`5438f3a3-7627-46cc-a1f0-7e62cc49a39e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1476::DEBUG::2013-03-01 14:01:05,456::task::568::TaskManager.Task::(_updateState) Task=`5438f3a3-7627-46cc-a1f0-7e62cc49a39e`::moving from state preparing -> state finished >Thread-1476::DEBUG::2013-03-01 14:01:05,458::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1476::DEBUG::2013-03-01 14:01:05,461::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1476::DEBUG::2013-03-01 14:01:05,464::task::957::TaskManager.Task::(_decref) Task=`5438f3a3-7627-46cc-a1f0-7e62cc49a39e`::ref 0 aborting False >Thread-1478::DEBUG::2013-03-01 14:01:06,564::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1478::DEBUG::2013-03-01 14:01:06,568::task::568::TaskManager.Task::(_updateState) Task=`41aa8f2f-f959-4b05-bfa7-314ad84bc72c`::moving from state init -> state preparing >Thread-1478::INFO::2013-03-01 14:01:06,571::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1478::DEBUG::2013-03-01 14:01:06,573::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1478::DEBUG::2013-03-01 14:01:06,576::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1478::INFO::2013-03-01 14:01:06,578::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1478::DEBUG::2013-03-01 14:01:06,581::task::1151::TaskManager.Task::(prepare) Task=`41aa8f2f-f959-4b05-bfa7-314ad84bc72c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1478::DEBUG::2013-03-01 14:01:06,583::task::568::TaskManager.Task::(_updateState) Task=`41aa8f2f-f959-4b05-bfa7-314ad84bc72c`::moving from state preparing -> state finished >Thread-1478::DEBUG::2013-03-01 14:01:06,586::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1478::DEBUG::2013-03-01 14:01:06,588::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1478::DEBUG::2013-03-01 14:01:06,591::task::957::TaskManager.Task::(_decref) Task=`41aa8f2f-f959-4b05-bfa7-314ad84bc72c`::ref 0 aborting False >Thread-1479::DEBUG::2013-03-01 14:01:07,667::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1479::DEBUG::2013-03-01 14:01:07,668::task::568::TaskManager.Task::(_updateState) Task=`a8d9db2c-a62f-4579-b86d-17ae22710ce3`::moving from state init -> state preparing >Thread-1479::INFO::2013-03-01 14:01:07,689::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1479::DEBUG::2013-03-01 14:01:07,689::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1479::DEBUG::2013-03-01 14:01:07,690::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1479::INFO::2013-03-01 14:01:07,690::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1479::DEBUG::2013-03-01 14:01:07,690::task::1151::TaskManager.Task::(prepare) Task=`a8d9db2c-a62f-4579-b86d-17ae22710ce3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1479::DEBUG::2013-03-01 14:01:07,690::task::568::TaskManager.Task::(_updateState) Task=`a8d9db2c-a62f-4579-b86d-17ae22710ce3`::moving from state preparing -> state finished >Thread-1479::DEBUG::2013-03-01 14:01:07,691::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1479::DEBUG::2013-03-01 14:01:07,691::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1479::DEBUG::2013-03-01 14:01:07,691::task::957::TaskManager.Task::(_decref) Task=`a8d9db2c-a62f-4579-b86d-17ae22710ce3`::ref 0 aborting False >Thread-1480::DEBUG::2013-03-01 14:01:08,719::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1480::DEBUG::2013-03-01 14:01:08,720::task::568::TaskManager.Task::(_updateState) Task=`ea05938e-da29-48a0-9fc5-058e48fcef71`::moving from state init -> state preparing >Thread-1480::INFO::2013-03-01 14:01:08,720::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1480::DEBUG::2013-03-01 14:01:08,720::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1480::DEBUG::2013-03-01 14:01:08,721::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1480::INFO::2013-03-01 14:01:08,721::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1480::DEBUG::2013-03-01 14:01:08,721::task::1151::TaskManager.Task::(prepare) Task=`ea05938e-da29-48a0-9fc5-058e48fcef71`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1480::DEBUG::2013-03-01 14:01:08,721::task::568::TaskManager.Task::(_updateState) Task=`ea05938e-da29-48a0-9fc5-058e48fcef71`::moving from state preparing -> state finished >Thread-1480::DEBUG::2013-03-01 14:01:08,721::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1480::DEBUG::2013-03-01 14:01:08,722::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1480::DEBUG::2013-03-01 14:01:08,722::task::957::TaskManager.Task::(_decref) Task=`ea05938e-da29-48a0-9fc5-058e48fcef71`::ref 0 aborting False >Thread-1482::DEBUG::2013-03-01 14:01:09,758::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1482::DEBUG::2013-03-01 14:01:09,758::task::568::TaskManager.Task::(_updateState) Task=`93c6b02c-4bb5-46d0-86dc-1b0acec245aa`::moving from state init -> state preparing >Thread-1482::INFO::2013-03-01 14:01:09,759::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1482::DEBUG::2013-03-01 14:01:09,759::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1482::DEBUG::2013-03-01 14:01:09,759::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1482::INFO::2013-03-01 14:01:09,759::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1482::DEBUG::2013-03-01 14:01:09,760::task::1151::TaskManager.Task::(prepare) Task=`93c6b02c-4bb5-46d0-86dc-1b0acec245aa`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1482::DEBUG::2013-03-01 14:01:09,760::task::568::TaskManager.Task::(_updateState) Task=`93c6b02c-4bb5-46d0-86dc-1b0acec245aa`::moving from state preparing -> state finished >Thread-1482::DEBUG::2013-03-01 14:01:09,760::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1482::DEBUG::2013-03-01 14:01:09,760::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1482::DEBUG::2013-03-01 14:01:09,760::task::957::TaskManager.Task::(_decref) Task=`93c6b02c-4bb5-46d0-86dc-1b0acec245aa`::ref 0 aborting False >Thread-1483::DEBUG::2013-03-01 14:01:10,789::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1483::DEBUG::2013-03-01 14:01:10,790::task::568::TaskManager.Task::(_updateState) Task=`7ac0a001-b666-44aa-a91d-fc44bb8bf95e`::moving from state init -> state preparing >Thread-1483::INFO::2013-03-01 14:01:10,790::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1483::DEBUG::2013-03-01 14:01:10,790::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1483::DEBUG::2013-03-01 14:01:10,790::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1483::INFO::2013-03-01 14:01:10,791::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1483::DEBUG::2013-03-01 14:01:10,791::task::1151::TaskManager.Task::(prepare) Task=`7ac0a001-b666-44aa-a91d-fc44bb8bf95e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1483::DEBUG::2013-03-01 14:01:10,793::task::568::TaskManager.Task::(_updateState) Task=`7ac0a001-b666-44aa-a91d-fc44bb8bf95e`::moving from state preparing -> state finished >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,794::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1483::DEBUG::2013-03-01 14:01:10,794::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,795::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-1483::DEBUG::2013-03-01 14:01:10,796::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,797::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >Thread-1483::DEBUG::2013-03-01 14:01:10,798::task::957::TaskManager.Task::(_decref) Task=`7ac0a001-b666-44aa-a91d-fc44bb8bf95e`::ref 0 aborting False >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,804::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2eda5525dbd0ce63281ec73b781a1cb830f05e84'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,805::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,805::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,806::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=184826796c09bb18a4b4dfc09dc6b930fca4c5b0'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,873::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,874::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`94ebab94-bd46-44ca-a487-b01882c6712b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,874::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,874::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,875::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`94ebab94-bd46-44ca-a487-b01882c6712b`::Granted request >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::INFO::2013-03-01 14:01:10,875::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,876::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`5345510f-e139-405b-b1e6-fb9fcbadfd74`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,876::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,876::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,877::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`5345510f-e139-405b-b1e6-fb9fcbadfd74`::Granted request >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,877::formatConverter::98::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc from version 0 to version 3 >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,878::formatConverter::118::Storage.v3DomainConverter::(v3DomainConverter) Setting permissions for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,937::formatConverter::121::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:10,938::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:11,058::formatConverter::125::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::INFO::2013-03-01 14:01:11,058::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >Thread-1484::DEBUG::2013-03-01 14:01:11,772::task::568::TaskManager.Task::(_updateState) Task=`0dc7fdd7-05b9-48ee-99b8-b20391843bdd`::moving from state init -> state preparing >Thread-1484::INFO::2013-03-01 14:01:11,772::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1484::INFO::2013-03-01 14:01:11,772::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00354814529419', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-1484::DEBUG::2013-03-01 14:01:11,773::task::1151::TaskManager.Task::(prepare) Task=`0dc7fdd7-05b9-48ee-99b8-b20391843bdd`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00354814529419', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-1484::DEBUG::2013-03-01 14:01:11,773::task::568::TaskManager.Task::(_updateState) Task=`0dc7fdd7-05b9-48ee-99b8-b20391843bdd`::moving from state preparing -> state finished >Thread-1484::DEBUG::2013-03-01 14:01:11,773::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1484::DEBUG::2013-03-01 14:01:11,773::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1484::DEBUG::2013-03-01 14:01:11,774::task::957::TaskManager.Task::(_decref) Task=`0dc7fdd7-05b9-48ee-99b8-b20391843bdd`::ref 0 aborting False >Thread-1485::DEBUG::2013-03-01 14:01:11,859::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1485::DEBUG::2013-03-01 14:01:11,862::task::568::TaskManager.Task::(_updateState) Task=`c3861283-4401-469a-a0b7-cd4e8afb24b9`::moving from state init -> state preparing >Thread-1485::INFO::2013-03-01 14:01:11,865::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1485::DEBUG::2013-03-01 14:01:11,866::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1485::DEBUG::2013-03-01 14:01:11,866::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1485::INFO::2013-03-01 14:01:11,866::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1485::DEBUG::2013-03-01 14:01:11,866::task::1151::TaskManager.Task::(prepare) Task=`c3861283-4401-469a-a0b7-cd4e8afb24b9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1485::DEBUG::2013-03-01 14:01:11,867::task::568::TaskManager.Task::(_updateState) Task=`c3861283-4401-469a-a0b7-cd4e8afb24b9`::moving from state preparing -> state finished >Thread-1485::DEBUG::2013-03-01 14:01:11,867::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1485::DEBUG::2013-03-01 14:01:11,867::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1485::DEBUG::2013-03-01 14:01:11,868::task::957::TaskManager.Task::(_decref) Task=`c3861283-4401-469a-a0b7-cd4e8afb24b9`::ref 0 aborting False >Thread-1487::DEBUG::2013-03-01 14:01:12,895::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1487::DEBUG::2013-03-01 14:01:12,896::task::568::TaskManager.Task::(_updateState) Task=`6cd6b4c2-eadf-4174-8f8d-05201d5c0a0a`::moving from state init -> state preparing >Thread-1487::INFO::2013-03-01 14:01:12,896::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1487::DEBUG::2013-03-01 14:01:12,896::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1487::DEBUG::2013-03-01 14:01:12,897::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1487::INFO::2013-03-01 14:01:12,897::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1487::DEBUG::2013-03-01 14:01:12,897::task::1151::TaskManager.Task::(prepare) Task=`6cd6b4c2-eadf-4174-8f8d-05201d5c0a0a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1487::DEBUG::2013-03-01 14:01:12,897::task::568::TaskManager.Task::(_updateState) Task=`6cd6b4c2-eadf-4174-8f8d-05201d5c0a0a`::moving from state preparing -> state finished >Thread-1487::DEBUG::2013-03-01 14:01:12,898::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1487::DEBUG::2013-03-01 14:01:12,898::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1487::DEBUG::2013-03-01 14:01:12,898::task::957::TaskManager.Task::(_decref) Task=`6cd6b4c2-eadf-4174-8f8d-05201d5c0a0a`::ref 0 aborting False >Thread-1488::DEBUG::2013-03-01 14:01:13,926::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1488::DEBUG::2013-03-01 14:01:13,926::task::568::TaskManager.Task::(_updateState) Task=`0e307d3e-d04a-4684-8444-a5c25d5861f1`::moving from state init -> state preparing >Thread-1488::INFO::2013-03-01 14:01:13,926::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1488::DEBUG::2013-03-01 14:01:13,927::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1488::DEBUG::2013-03-01 14:01:13,927::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1488::INFO::2013-03-01 14:01:13,927::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1488::DEBUG::2013-03-01 14:01:13,927::task::1151::TaskManager.Task::(prepare) Task=`0e307d3e-d04a-4684-8444-a5c25d5861f1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1488::DEBUG::2013-03-01 14:01:13,928::task::568::TaskManager.Task::(_updateState) Task=`0e307d3e-d04a-4684-8444-a5c25d5861f1`::moving from state preparing -> state finished >Thread-1488::DEBUG::2013-03-01 14:01:13,928::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1488::DEBUG::2013-03-01 14:01:13,928::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1488::DEBUG::2013-03-01 14:01:13,928::task::957::TaskManager.Task::(_decref) Task=`0e307d3e-d04a-4684-8444-a5c25d5861f1`::ref 0 aborting False >Thread-1490::DEBUG::2013-03-01 14:01:14,956::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1490::DEBUG::2013-03-01 14:01:14,956::task::568::TaskManager.Task::(_updateState) Task=`4e9779de-893a-44b8-951b-ddd4de3d9192`::moving from state init -> state preparing >Thread-1490::INFO::2013-03-01 14:01:14,957::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1490::DEBUG::2013-03-01 14:01:14,957::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1490::DEBUG::2013-03-01 14:01:14,957::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1490::INFO::2013-03-01 14:01:14,957::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1490::DEBUG::2013-03-01 14:01:14,957::task::1151::TaskManager.Task::(prepare) Task=`4e9779de-893a-44b8-951b-ddd4de3d9192`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1490::DEBUG::2013-03-01 14:01:14,958::task::568::TaskManager.Task::(_updateState) Task=`4e9779de-893a-44b8-951b-ddd4de3d9192`::moving from state preparing -> state finished >Thread-1490::DEBUG::2013-03-01 14:01:14,958::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1490::DEBUG::2013-03-01 14:01:14,958::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1490::DEBUG::2013-03-01 14:01:14,958::task::957::TaskManager.Task::(_decref) Task=`4e9779de-893a-44b8-951b-ddd4de3d9192`::ref 0 aborting False >Thread-1491::DEBUG::2013-03-01 14:01:15,986::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1491::DEBUG::2013-03-01 14:01:15,987::task::568::TaskManager.Task::(_updateState) Task=`d27b5191-c27d-40b6-afd1-06da5023896a`::moving from state init -> state preparing >Thread-1491::INFO::2013-03-01 14:01:15,987::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1491::DEBUG::2013-03-01 14:01:15,987::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1491::DEBUG::2013-03-01 14:01:15,987::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1491::INFO::2013-03-01 14:01:15,987::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1491::DEBUG::2013-03-01 14:01:15,987::task::1151::TaskManager.Task::(prepare) Task=`d27b5191-c27d-40b6-afd1-06da5023896a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1491::DEBUG::2013-03-01 14:01:15,988::task::568::TaskManager.Task::(_updateState) Task=`d27b5191-c27d-40b6-afd1-06da5023896a`::moving from state preparing -> state finished >Thread-1491::DEBUG::2013-03-01 14:01:15,988::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1491::DEBUG::2013-03-01 14:01:15,988::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1491::DEBUG::2013-03-01 14:01:15,988::task::957::TaskManager.Task::(_decref) Task=`d27b5191-c27d-40b6-afd1-06da5023896a`::ref 0 aborting False >Thread-1492::DEBUG::2013-03-01 14:01:17,016::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1492::DEBUG::2013-03-01 14:01:17,017::task::568::TaskManager.Task::(_updateState) Task=`f69d1da4-4497-4e51-873b-17100f0f131e`::moving from state init -> state preparing >Thread-1492::INFO::2013-03-01 14:01:17,017::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1492::DEBUG::2013-03-01 14:01:17,017::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1492::DEBUG::2013-03-01 14:01:17,017::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1492::INFO::2013-03-01 14:01:17,018::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1492::DEBUG::2013-03-01 14:01:17,018::task::1151::TaskManager.Task::(prepare) Task=`f69d1da4-4497-4e51-873b-17100f0f131e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1492::DEBUG::2013-03-01 14:01:17,018::task::568::TaskManager.Task::(_updateState) Task=`f69d1da4-4497-4e51-873b-17100f0f131e`::moving from state preparing -> state finished >Thread-1492::DEBUG::2013-03-01 14:01:17,018::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1492::DEBUG::2013-03-01 14:01:17,018::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1492::DEBUG::2013-03-01 14:01:17,019::task::957::TaskManager.Task::(_decref) Task=`f69d1da4-4497-4e51-873b-17100f0f131e`::ref 0 aborting False >Thread-1494::DEBUG::2013-03-01 14:01:18,047::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1494::DEBUG::2013-03-01 14:01:18,048::task::568::TaskManager.Task::(_updateState) Task=`7952d4d6-13a4-47da-9fe2-a0e8707e5e79`::moving from state init -> state preparing >Thread-1494::INFO::2013-03-01 14:01:18,048::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1494::DEBUG::2013-03-01 14:01:18,048::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1494::DEBUG::2013-03-01 14:01:18,048::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1494::INFO::2013-03-01 14:01:18,049::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1494::DEBUG::2013-03-01 14:01:18,049::task::1151::TaskManager.Task::(prepare) Task=`7952d4d6-13a4-47da-9fe2-a0e8707e5e79`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1494::DEBUG::2013-03-01 14:01:18,049::task::568::TaskManager.Task::(_updateState) Task=`7952d4d6-13a4-47da-9fe2-a0e8707e5e79`::moving from state preparing -> state finished >Thread-1494::DEBUG::2013-03-01 14:01:18,049::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1494::DEBUG::2013-03-01 14:01:18,049::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1494::DEBUG::2013-03-01 14:01:18,050::task::957::TaskManager.Task::(_decref) Task=`7952d4d6-13a4-47da-9fe2-a0e8707e5e79`::ref 0 aborting False >Thread-1495::DEBUG::2013-03-01 14:01:19,079::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1495::DEBUG::2013-03-01 14:01:19,079::task::568::TaskManager.Task::(_updateState) Task=`bee51df7-b333-44d6-8a90-d2a3b19ececd`::moving from state init -> state preparing >Thread-1495::INFO::2013-03-01 14:01:19,079::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1495::DEBUG::2013-03-01 14:01:19,080::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1495::DEBUG::2013-03-01 14:01:19,080::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1495::INFO::2013-03-01 14:01:19,080::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1495::DEBUG::2013-03-01 14:01:19,080::task::1151::TaskManager.Task::(prepare) Task=`bee51df7-b333-44d6-8a90-d2a3b19ececd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1495::DEBUG::2013-03-01 14:01:19,081::task::568::TaskManager.Task::(_updateState) Task=`bee51df7-b333-44d6-8a90-d2a3b19ececd`::moving from state preparing -> state finished >Thread-1495::DEBUG::2013-03-01 14:01:19,081::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1495::DEBUG::2013-03-01 14:01:19,081::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1495::DEBUG::2013-03-01 14:01:19,081::task::957::TaskManager.Task::(_decref) Task=`bee51df7-b333-44d6-8a90-d2a3b19ececd`::ref 0 aborting False >Thread-1496::DEBUG::2013-03-01 14:01:20,110::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1496::DEBUG::2013-03-01 14:01:20,110::task::568::TaskManager.Task::(_updateState) Task=`2cb9368e-d499-49b9-862f-0487d3a5b77e`::moving from state init -> state preparing >Thread-1496::INFO::2013-03-01 14:01:20,111::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1496::DEBUG::2013-03-01 14:01:20,111::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1496::DEBUG::2013-03-01 14:01:20,111::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1496::INFO::2013-03-01 14:01:20,111::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1496::DEBUG::2013-03-01 14:01:20,112::task::1151::TaskManager.Task::(prepare) Task=`2cb9368e-d499-49b9-862f-0487d3a5b77e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1496::DEBUG::2013-03-01 14:01:20,112::task::568::TaskManager.Task::(_updateState) Task=`2cb9368e-d499-49b9-862f-0487d3a5b77e`::moving from state preparing -> state finished >Thread-1496::DEBUG::2013-03-01 14:01:20,112::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1496::DEBUG::2013-03-01 14:01:20,112::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1496::DEBUG::2013-03-01 14:01:20,113::task::957::TaskManager.Task::(_decref) Task=`2cb9368e-d499-49b9-862f-0487d3a5b77e`::ref 0 aborting False >Thread-1498::DEBUG::2013-03-01 14:01:21,141::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1498::DEBUG::2013-03-01 14:01:21,141::task::568::TaskManager.Task::(_updateState) Task=`8819083a-2ecc-4ecc-92b7-1ab39166f574`::moving from state init -> state preparing >Thread-1498::INFO::2013-03-01 14:01:21,141::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1498::DEBUG::2013-03-01 14:01:21,142::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1498::DEBUG::2013-03-01 14:01:21,142::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1498::INFO::2013-03-01 14:01:21,142::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1498::DEBUG::2013-03-01 14:01:21,142::task::1151::TaskManager.Task::(prepare) Task=`8819083a-2ecc-4ecc-92b7-1ab39166f574`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1498::DEBUG::2013-03-01 14:01:21,143::task::568::TaskManager.Task::(_updateState) Task=`8819083a-2ecc-4ecc-92b7-1ab39166f574`::moving from state preparing -> state finished >Thread-1498::DEBUG::2013-03-01 14:01:21,143::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1498::DEBUG::2013-03-01 14:01:21,143::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1498::DEBUG::2013-03-01 14:01:21,143::task::957::TaskManager.Task::(_decref) Task=`8819083a-2ecc-4ecc-92b7-1ab39166f574`::ref 0 aborting False >Thread-1499::DEBUG::2013-03-01 14:01:22,172::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1499::DEBUG::2013-03-01 14:01:22,172::task::568::TaskManager.Task::(_updateState) Task=`b206cc88-df4a-4089-babb-6a593a13dd20`::moving from state init -> state preparing >Thread-1499::INFO::2013-03-01 14:01:22,173::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1499::DEBUG::2013-03-01 14:01:22,173::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1499::DEBUG::2013-03-01 14:01:22,173::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1499::INFO::2013-03-01 14:01:22,173::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1499::DEBUG::2013-03-01 14:01:22,173::task::1151::TaskManager.Task::(prepare) Task=`b206cc88-df4a-4089-babb-6a593a13dd20`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1499::DEBUG::2013-03-01 14:01:22,174::task::568::TaskManager.Task::(_updateState) Task=`b206cc88-df4a-4089-babb-6a593a13dd20`::moving from state preparing -> state finished >Thread-1499::DEBUG::2013-03-01 14:01:22,174::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1499::DEBUG::2013-03-01 14:01:22,174::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1499::DEBUG::2013-03-01 14:01:22,174::task::957::TaskManager.Task::(_decref) Task=`b206cc88-df4a-4089-babb-6a593a13dd20`::ref 0 aborting False >Thread-1500::DEBUG::2013-03-01 14:01:23,202::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1500::DEBUG::2013-03-01 14:01:23,203::task::568::TaskManager.Task::(_updateState) Task=`f7b36b94-7d48-4997-8938-f7ca842d5435`::moving from state init -> state preparing >Thread-1500::INFO::2013-03-01 14:01:23,203::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1500::DEBUG::2013-03-01 14:01:23,203::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1500::DEBUG::2013-03-01 14:01:23,204::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1500::INFO::2013-03-01 14:01:23,204::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1500::DEBUG::2013-03-01 14:01:23,204::task::1151::TaskManager.Task::(prepare) Task=`f7b36b94-7d48-4997-8938-f7ca842d5435`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1500::DEBUG::2013-03-01 14:01:23,204::task::568::TaskManager.Task::(_updateState) Task=`f7b36b94-7d48-4997-8938-f7ca842d5435`::moving from state preparing -> state finished >Thread-1500::DEBUG::2013-03-01 14:01:23,205::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1500::DEBUG::2013-03-01 14:01:23,205::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1500::DEBUG::2013-03-01 14:01:23,205::task::957::TaskManager.Task::(_decref) Task=`f7b36b94-7d48-4997-8938-f7ca842d5435`::ref 0 aborting False >Thread-1502::DEBUG::2013-03-01 14:01:24,234::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1502::DEBUG::2013-03-01 14:01:24,234::task::568::TaskManager.Task::(_updateState) Task=`91930ed2-df31-429f-b806-b9d974d90ada`::moving from state init -> state preparing >Thread-1502::INFO::2013-03-01 14:01:24,234::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1502::DEBUG::2013-03-01 14:01:24,235::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1502::DEBUG::2013-03-01 14:01:24,235::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1502::INFO::2013-03-01 14:01:24,235::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1502::DEBUG::2013-03-01 14:01:24,235::task::1151::TaskManager.Task::(prepare) Task=`91930ed2-df31-429f-b806-b9d974d90ada`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1502::DEBUG::2013-03-01 14:01:24,236::task::568::TaskManager.Task::(_updateState) Task=`91930ed2-df31-429f-b806-b9d974d90ada`::moving from state preparing -> state finished >Thread-1502::DEBUG::2013-03-01 14:01:24,236::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1502::DEBUG::2013-03-01 14:01:24,236::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1502::DEBUG::2013-03-01 14:01:24,236::task::957::TaskManager.Task::(_decref) Task=`91930ed2-df31-429f-b806-b9d974d90ada`::ref 0 aborting False >Thread-1503::DEBUG::2013-03-01 14:01:25,265::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1503::DEBUG::2013-03-01 14:01:25,265::task::568::TaskManager.Task::(_updateState) Task=`08a86640-16c9-4e7d-a7c2-1e73128ec973`::moving from state init -> state preparing >Thread-1503::INFO::2013-03-01 14:01:25,266::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1503::DEBUG::2013-03-01 14:01:25,266::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1503::DEBUG::2013-03-01 14:01:25,266::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1503::INFO::2013-03-01 14:01:25,266::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1503::DEBUG::2013-03-01 14:01:25,267::task::1151::TaskManager.Task::(prepare) Task=`08a86640-16c9-4e7d-a7c2-1e73128ec973`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1503::DEBUG::2013-03-01 14:01:25,267::task::568::TaskManager.Task::(_updateState) Task=`08a86640-16c9-4e7d-a7c2-1e73128ec973`::moving from state preparing -> state finished >Thread-1503::DEBUG::2013-03-01 14:01:25,267::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1503::DEBUG::2013-03-01 14:01:25,267::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1503::DEBUG::2013-03-01 14:01:25,268::task::957::TaskManager.Task::(_decref) Task=`08a86640-16c9-4e7d-a7c2-1e73128ec973`::ref 0 aborting False >Thread-1504::DEBUG::2013-03-01 14:01:26,296::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1504::DEBUG::2013-03-01 14:01:26,297::task::568::TaskManager.Task::(_updateState) Task=`e37a16b8-9806-4b84-ab25-b45075ef03e2`::moving from state init -> state preparing >Thread-1504::INFO::2013-03-01 14:01:26,297::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1504::DEBUG::2013-03-01 14:01:26,297::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1504::DEBUG::2013-03-01 14:01:26,297::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1504::INFO::2013-03-01 14:01:26,298::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1504::DEBUG::2013-03-01 14:01:26,298::task::1151::TaskManager.Task::(prepare) Task=`e37a16b8-9806-4b84-ab25-b45075ef03e2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1504::DEBUG::2013-03-01 14:01:26,298::task::568::TaskManager.Task::(_updateState) Task=`e37a16b8-9806-4b84-ab25-b45075ef03e2`::moving from state preparing -> state finished >Thread-1504::DEBUG::2013-03-01 14:01:26,298::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1504::DEBUG::2013-03-01 14:01:26,299::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1504::DEBUG::2013-03-01 14:01:26,299::task::957::TaskManager.Task::(_decref) Task=`e37a16b8-9806-4b84-ab25-b45075ef03e2`::ref 0 aborting False >Thread-1505::DEBUG::2013-03-01 14:01:27,049::task::568::TaskManager.Task::(_updateState) Task=`4ce5ffc8-5f3e-4fa7-b2fe-65901a9bcb00`::moving from state init -> state preparing >Thread-1505::INFO::2013-03-01 14:01:27,050::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1505::INFO::2013-03-01 14:01:27,050::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00310897827148', 'lastCheck': '6.6', 'code': 0, 'valid': True}} >Thread-1505::DEBUG::2013-03-01 14:01:27,050::task::1151::TaskManager.Task::(prepare) Task=`4ce5ffc8-5f3e-4fa7-b2fe-65901a9bcb00`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00310897827148', 'lastCheck': '6.6', 'code': 0, 'valid': True}} >Thread-1505::DEBUG::2013-03-01 14:01:27,050::task::568::TaskManager.Task::(_updateState) Task=`4ce5ffc8-5f3e-4fa7-b2fe-65901a9bcb00`::moving from state preparing -> state finished >Thread-1505::DEBUG::2013-03-01 14:01:27,051::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1505::DEBUG::2013-03-01 14:01:27,051::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1505::DEBUG::2013-03-01 14:01:27,051::task::957::TaskManager.Task::(_decref) Task=`4ce5ffc8-5f3e-4fa7-b2fe-65901a9bcb00`::ref 0 aborting False >Thread-1507::DEBUG::2013-03-01 14:01:27,327::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1507::DEBUG::2013-03-01 14:01:27,327::task::568::TaskManager.Task::(_updateState) Task=`c3e2ff73-f4ed-4315-8e5f-433140a14ff7`::moving from state init -> state preparing >Thread-1507::INFO::2013-03-01 14:01:27,328::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1507::DEBUG::2013-03-01 14:01:27,328::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1507::DEBUG::2013-03-01 14:01:27,328::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1507::INFO::2013-03-01 14:01:27,328::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1507::DEBUG::2013-03-01 14:01:27,329::task::1151::TaskManager.Task::(prepare) Task=`c3e2ff73-f4ed-4315-8e5f-433140a14ff7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1507::DEBUG::2013-03-01 14:01:27,329::task::568::TaskManager.Task::(_updateState) Task=`c3e2ff73-f4ed-4315-8e5f-433140a14ff7`::moving from state preparing -> state finished >Thread-1507::DEBUG::2013-03-01 14:01:27,329::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1507::DEBUG::2013-03-01 14:01:27,329::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1507::DEBUG::2013-03-01 14:01:27,329::task::957::TaskManager.Task::(_decref) Task=`c3e2ff73-f4ed-4315-8e5f-433140a14ff7`::ref 0 aborting False >Thread-1508::DEBUG::2013-03-01 14:01:28,357::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1508::DEBUG::2013-03-01 14:01:28,358::task::568::TaskManager.Task::(_updateState) Task=`380964ee-35d0-4043-a2b1-9a5555ac9678`::moving from state init -> state preparing >Thread-1508::INFO::2013-03-01 14:01:28,358::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1508::DEBUG::2013-03-01 14:01:28,358::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1508::DEBUG::2013-03-01 14:01:28,359::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1508::INFO::2013-03-01 14:01:28,359::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1508::DEBUG::2013-03-01 14:01:28,359::task::1151::TaskManager.Task::(prepare) Task=`380964ee-35d0-4043-a2b1-9a5555ac9678`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1508::DEBUG::2013-03-01 14:01:28,359::task::568::TaskManager.Task::(_updateState) Task=`380964ee-35d0-4043-a2b1-9a5555ac9678`::moving from state preparing -> state finished >Thread-1508::DEBUG::2013-03-01 14:01:28,360::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1508::DEBUG::2013-03-01 14:01:28,360::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1508::DEBUG::2013-03-01 14:01:28,360::task::957::TaskManager.Task::(_decref) Task=`380964ee-35d0-4043-a2b1-9a5555ac9678`::ref 0 aborting False >Thread-1509::DEBUG::2013-03-01 14:01:29,389::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1509::DEBUG::2013-03-01 14:01:29,390::task::568::TaskManager.Task::(_updateState) Task=`ffd708d2-30d3-460d-8e28-61978a5f552f`::moving from state init -> state preparing >Thread-1509::INFO::2013-03-01 14:01:29,390::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1509::DEBUG::2013-03-01 14:01:29,390::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1509::DEBUG::2013-03-01 14:01:29,390::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1509::INFO::2013-03-01 14:01:29,390::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1509::DEBUG::2013-03-01 14:01:29,391::task::1151::TaskManager.Task::(prepare) Task=`ffd708d2-30d3-460d-8e28-61978a5f552f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1509::DEBUG::2013-03-01 14:01:29,391::task::568::TaskManager.Task::(_updateState) Task=`ffd708d2-30d3-460d-8e28-61978a5f552f`::moving from state preparing -> state finished >Thread-1509::DEBUG::2013-03-01 14:01:29,391::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1509::DEBUG::2013-03-01 14:01:29,391::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1509::DEBUG::2013-03-01 14:01:29,392::task::957::TaskManager.Task::(_decref) Task=`ffd708d2-30d3-460d-8e28-61978a5f552f`::ref 0 aborting False >Thread-1511::DEBUG::2013-03-01 14:01:30,420::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1511::DEBUG::2013-03-01 14:01:30,422::task::568::TaskManager.Task::(_updateState) Task=`a904ffaa-d948-4991-bf96-6f538558763e`::moving from state init -> state preparing >Thread-1511::INFO::2013-03-01 14:01:30,423::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1511::DEBUG::2013-03-01 14:01:30,423::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1511::DEBUG::2013-03-01 14:01:30,424::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1511::INFO::2013-03-01 14:01:30,424::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1511::DEBUG::2013-03-01 14:01:30,425::task::1151::TaskManager.Task::(prepare) Task=`a904ffaa-d948-4991-bf96-6f538558763e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1511::DEBUG::2013-03-01 14:01:30,425::task::568::TaskManager.Task::(_updateState) Task=`a904ffaa-d948-4991-bf96-6f538558763e`::moving from state preparing -> state finished >Thread-1511::DEBUG::2013-03-01 14:01:30,425::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1511::DEBUG::2013-03-01 14:01:30,425::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1511::DEBUG::2013-03-01 14:01:30,426::task::957::TaskManager.Task::(_decref) Task=`a904ffaa-d948-4991-bf96-6f538558763e`::ref 0 aborting False >Thread-1512::DEBUG::2013-03-01 14:01:31,455::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1512::DEBUG::2013-03-01 14:01:31,455::task::568::TaskManager.Task::(_updateState) Task=`6b218cc8-2ed5-4cd5-9d2a-8635e2432b40`::moving from state init -> state preparing >Thread-1512::INFO::2013-03-01 14:01:31,455::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1512::DEBUG::2013-03-01 14:01:31,456::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1512::DEBUG::2013-03-01 14:01:31,456::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1512::INFO::2013-03-01 14:01:31,456::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1512::DEBUG::2013-03-01 14:01:31,456::task::1151::TaskManager.Task::(prepare) Task=`6b218cc8-2ed5-4cd5-9d2a-8635e2432b40`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1512::DEBUG::2013-03-01 14:01:31,457::task::568::TaskManager.Task::(_updateState) Task=`6b218cc8-2ed5-4cd5-9d2a-8635e2432b40`::moving from state preparing -> state finished >Thread-1512::DEBUG::2013-03-01 14:01:31,457::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1512::DEBUG::2013-03-01 14:01:31,457::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1512::DEBUG::2013-03-01 14:01:31,457::task::957::TaskManager.Task::(_decref) Task=`6b218cc8-2ed5-4cd5-9d2a-8635e2432b40`::ref 0 aborting False >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,063::clusterlock::191::SANLock::(acquireHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,063::formatConverter::202::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc with host id: 1 >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::INFO::2013-03-01 14:01:32,064::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,165::clusterlock::248::SANLock::(acquire) Cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,167::formatConverter::160::Storage.v3DomainConverter::(v3ReallocateMetadataSlot) The metadata reallocation check is not needed for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,167::formatConverter::298::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 0 to version 3 for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,167::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,167::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,167::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9c08a6cc1a00c49d606eac7bbde3046a27fcbe8d'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,207::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::INFO::2013-03-01 14:01:32,208::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:32,208::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd /usr/libexec/vdsm) >Thread-1513::DEBUG::2013-03-01 14:01:32,487::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1513::DEBUG::2013-03-01 14:01:32,488::task::568::TaskManager.Task::(_updateState) Task=`aac51192-688e-4ce3-8ad8-4cbe2cf270a9`::moving from state init -> state preparing >Thread-1513::INFO::2013-03-01 14:01:32,488::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1513::DEBUG::2013-03-01 14:01:32,489::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1513::DEBUG::2013-03-01 14:01:32,489::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1513::INFO::2013-03-01 14:01:32,489::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1513::DEBUG::2013-03-01 14:01:32,489::task::1151::TaskManager.Task::(prepare) Task=`aac51192-688e-4ce3-8ad8-4cbe2cf270a9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1513::DEBUG::2013-03-01 14:01:32,490::task::568::TaskManager.Task::(_updateState) Task=`aac51192-688e-4ce3-8ad8-4cbe2cf270a9`::moving from state preparing -> state finished >Thread-1513::DEBUG::2013-03-01 14:01:32,490::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1513::DEBUG::2013-03-01 14:01:32,490::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1513::DEBUG::2013-03-01 14:01:32,490::task::957::TaskManager.Task::(_decref) Task=`aac51192-688e-4ce3-8ad8-4cbe2cf270a9`::ref 0 aborting False >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,258::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,258::clusterlock::129::SafeLease::(release) Cluster lock released successfully >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,258::formatConverter::336::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,259::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,260::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,444::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::WARNING::2013-03-01 14:01:33,445::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,446::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,499::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,499::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,504::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9c08a6cc1a00c49d606eac7bbde3046a27fcbe8d'] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,506::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::WARNING::2013-03-01 14:01:33,506::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::WARNING::2013-03-01 14:01:33,507::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,507::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,508::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,508::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,509::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,509::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,510::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,510::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,510::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,511::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,511::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,512::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1533::DEBUG::2013-03-01 14:01:33,519::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1533::DEBUG::2013-03-01 14:01:33,520::task::568::TaskManager.Task::(_updateState) Task=`af7417a5-fbf4-4379-8962-ffde0833486a`::moving from state init -> state preparing >Thread-1533::INFO::2013-03-01 14:01:33,520::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1533::DEBUG::2013-03-01 14:01:33,520::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1533::DEBUG::2013-03-01 14:01:33,520::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1533::INFO::2013-03-01 14:01:33,521::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1533::DEBUG::2013-03-01 14:01:33,521::task::1151::TaskManager.Task::(prepare) Task=`af7417a5-fbf4-4379-8962-ffde0833486a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1533::DEBUG::2013-03-01 14:01:33,521::task::568::TaskManager.Task::(_updateState) Task=`af7417a5-fbf4-4379-8962-ffde0833486a`::moving from state preparing -> state finished >Thread-1533::DEBUG::2013-03-01 14:01:33,521::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1533::DEBUG::2013-03-01 14:01:33,522::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1533::DEBUG::2013-03-01 14:01:33,522::task::957::TaskManager.Task::(_decref) Task=`af7417a5-fbf4-4379-8962-ffde0833486a`::ref 0 aborting False >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::WARNING::2013-03-01 14:01:33,524::sd::600::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc/master/vms) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::WARNING::2013-03-01 14:01:33,531::sd::605::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc/master/tasks) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,541::sp::309::Storage.StoragePool::(startSpm) ended. >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,541::task::568::TaskManager.Task::(_updateState) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::moving from state running -> state finished >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,541::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,541::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,542::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,542::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,542::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,543::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,543::task::880::TaskManager.Task::(_runJobs) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::Task.run: exit - success: result >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,543::task::957::TaskManager.Task::(_decref) Task=`2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45`::ref 0 aborting False >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:01:33,543::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-1534::DEBUG::2013-03-01 14:01:34,550::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1534::DEBUG::2013-03-01 14:01:34,550::task::568::TaskManager.Task::(_updateState) Task=`79e78dbd-2c7e-4e95-a756-59509d424a06`::moving from state init -> state preparing >Thread-1534::INFO::2013-03-01 14:01:34,551::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1534::DEBUG::2013-03-01 14:01:34,551::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1534::DEBUG::2013-03-01 14:01:34,551::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'} >Thread-1534::INFO::2013-03-01 14:01:34,551::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1534::DEBUG::2013-03-01 14:01:34,552::task::1151::TaskManager.Task::(prepare) Task=`79e78dbd-2c7e-4e95-a756-59509d424a06`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45'}} >Thread-1534::DEBUG::2013-03-01 14:01:34,552::task::568::TaskManager.Task::(_updateState) Task=`79e78dbd-2c7e-4e95-a756-59509d424a06`::moving from state preparing -> state finished >Thread-1534::DEBUG::2013-03-01 14:01:34,552::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1534::DEBUG::2013-03-01 14:01:34,552::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1534::DEBUG::2013-03-01 14:01:34,553::task::957::TaskManager.Task::(_decref) Task=`79e78dbd-2c7e-4e95-a756-59509d424a06`::ref 0 aborting False >Thread-1535::DEBUG::2013-03-01 14:01:34,580::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1535::DEBUG::2013-03-01 14:01:34,580::task::568::TaskManager.Task::(_updateState) Task=`b14140de-4b21-4fc3-8272-fd963834a14d`::moving from state init -> state preparing >Thread-1535::INFO::2013-03-01 14:01:34,581::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1535::INFO::2013-03-01 14:01:34,581::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1535::DEBUG::2013-03-01 14:01:34,581::task::1151::TaskManager.Task::(prepare) Task=`b14140de-4b21-4fc3-8272-fd963834a14d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1535::DEBUG::2013-03-01 14:01:34,581::task::568::TaskManager.Task::(_updateState) Task=`b14140de-4b21-4fc3-8272-fd963834a14d`::moving from state preparing -> state finished >Thread-1535::DEBUG::2013-03-01 14:01:34,582::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1535::DEBUG::2013-03-01 14:01:34,582::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1535::DEBUG::2013-03-01 14:01:34,582::task::957::TaskManager.Task::(_decref) Task=`b14140de-4b21-4fc3-8272-fd963834a14d`::ref 0 aborting False >Thread-1536::DEBUG::2013-03-01 14:01:34,609::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1536::DEBUG::2013-03-01 14:01:34,610::task::568::TaskManager.Task::(_updateState) Task=`7403e2cb-3e8a-46c3-aea7-7a7db5d3476f`::moving from state init -> state preparing >Thread-1536::INFO::2013-03-01 14:01:34,610::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45', spUUID=None, options=None) >Thread-1536::DEBUG::2013-03-01 14:01:34,610::taskManager::161::TaskManager::(clearTask) Entry. taskID: 2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45 >Thread-1536::DEBUG::2013-03-01 14:01:34,611::taskManager::166::TaskManager::(clearTask) Return. >Thread-1536::INFO::2013-03-01 14:01:34,611::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-1536::DEBUG::2013-03-01 14:01:34,611::task::1151::TaskManager.Task::(prepare) Task=`7403e2cb-3e8a-46c3-aea7-7a7db5d3476f`::finished: None >Thread-1536::DEBUG::2013-03-01 14:01:34,611::task::568::TaskManager.Task::(_updateState) Task=`7403e2cb-3e8a-46c3-aea7-7a7db5d3476f`::moving from state preparing -> state finished >Thread-1536::DEBUG::2013-03-01 14:01:34,612::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1536::DEBUG::2013-03-01 14:01:34,612::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1536::DEBUG::2013-03-01 14:01:34,612::task::957::TaskManager.Task::(_decref) Task=`7403e2cb-3e8a-46c3-aea7-7a7db5d3476f`::ref 0 aborting False >Thread-1537::DEBUG::2013-03-01 14:01:34,649::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1537::DEBUG::2013-03-01 14:01:34,650::task::568::TaskManager.Task::(_updateState) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::moving from state init -> state preparing >Thread-1537::INFO::2013-03-01 14:01:34,650::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1537::DEBUG::2013-03-01 14:01:34,650::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`95c0f44b-588d-482f-8e89-e72c15b2b3d3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1537::DEBUG::2013-03-01 14:01:34,651::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1537::DEBUG::2013-03-01 14:01:34,651::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1537::DEBUG::2013-03-01 14:01:34,651::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`95c0f44b-588d-482f-8e89-e72c15b2b3d3`::Granted request >Thread-1537::DEBUG::2013-03-01 14:01:34,652::task::794::TaskManager.Task::(resourceAcquired) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1537::DEBUG::2013-03-01 14:01:34,652::task::957::TaskManager.Task::(_decref) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::ref 1 aborting False >Thread-1537::DEBUG::2013-03-01 14:01:34,652::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`e8b3239d-9539-40c8-9816-3f7e9ab18264`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1537::DEBUG::2013-03-01 14:01:34,652::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >Thread-1537::DEBUG::2013-03-01 14:01:34,653::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >Thread-1537::DEBUG::2013-03-01 14:01:34,653::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`e8b3239d-9539-40c8-9816-3f7e9ab18264`::Granted request >Thread-1537::DEBUG::2013-03-01 14:01:34,653::task::794::TaskManager.Task::(resourceAcquired) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::_resourcesAcquired: Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc (exclusive) >Thread-1537::DEBUG::2013-03-01 14:01:34,654::task::957::TaskManager.Task::(_decref) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::ref 1 aborting False >Thread-1537::INFO::2013-03-01 14:01:34,654::sp::1045::Storage.StoragePool::(activateSD) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1537::INFO::2013-03-01 14:01:34,654::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-1537::DEBUG::2013-03-01 14:01:34,654::task::1151::TaskManager.Task::(prepare) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::finished: None >Thread-1537::DEBUG::2013-03-01 14:01:34,655::task::568::TaskManager.Task::(_updateState) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::moving from state preparing -> state finished >Thread-1537::DEBUG::2013-03-01 14:01:34,655::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc': < ResourceRef 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', isValid: 'True' obj: 'None'>} >Thread-1537::DEBUG::2013-03-01 14:01:34,655::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1537::DEBUG::2013-03-01 14:01:34,655::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1537::DEBUG::2013-03-01 14:01:34,656::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1537::DEBUG::2013-03-01 14:01:34,656::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1537::DEBUG::2013-03-01 14:01:34,656::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1537::DEBUG::2013-03-01 14:01:34,657::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >Thread-1537::DEBUG::2013-03-01 14:01:34,657::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >Thread-1537::DEBUG::2013-03-01 14:01:34,657::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >Thread-1537::DEBUG::2013-03-01 14:01:34,657::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >Thread-1537::DEBUG::2013-03-01 14:01:34,658::task::957::TaskManager.Task::(_decref) Task=`d5742b9b-2936-44a4-b136-eceabb28e194`::ref 0 aborting False >Thread-1538::DEBUG::2013-03-01 14:01:34,693::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1538::DEBUG::2013-03-01 14:01:34,693::task::568::TaskManager.Task::(_updateState) Task=`0465bd00-d50f-4de0-a449-9b21da7d66a8`::moving from state init -> state preparing >Thread-1538::INFO::2013-03-01 14:01:34,694::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', hostID=1, scsiKey='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1538::DEBUG::2013-03-01 14:01:34,694::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`3a7746ab-6bc6-4a65-9398-e7c86169cdb6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1538::DEBUG::2013-03-01 14:01:34,695::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1538::DEBUG::2013-03-01 14:01:34,695::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1538::DEBUG::2013-03-01 14:01:34,695::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`3a7746ab-6bc6-4a65-9398-e7c86169cdb6`::Granted request >Thread-1538::DEBUG::2013-03-01 14:01:34,696::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1538::DEBUG::2013-03-01 14:01:34,696::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1538::DEBUG::2013-03-01 14:01:34,696::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1538::DEBUG::2013-03-01 14:01:34,696::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1538::DEBUG::2013-03-01 14:01:34,697::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1538::INFO::2013-03-01 14:01:34,697::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-1538::DEBUG::2013-03-01 14:01:34,697::task::1151::TaskManager.Task::(prepare) Task=`0465bd00-d50f-4de0-a449-9b21da7d66a8`::finished: None >Thread-1538::DEBUG::2013-03-01 14:01:34,698::task::568::TaskManager.Task::(_updateState) Task=`0465bd00-d50f-4de0-a449-9b21da7d66a8`::moving from state preparing -> state finished >Thread-1538::DEBUG::2013-03-01 14:01:34,698::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1538::DEBUG::2013-03-01 14:01:34,698::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1538::DEBUG::2013-03-01 14:01:34,698::task::957::TaskManager.Task::(_decref) Task=`0465bd00-d50f-4de0-a449-9b21da7d66a8`::ref 0 aborting False >Thread-1539::DEBUG::2013-03-01 14:01:35,967::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1539::DEBUG::2013-03-01 14:01:35,967::task::568::TaskManager.Task::(_updateState) Task=`e5e5f17e-3b91-4c01-b11e-2458a1c07789`::moving from state init -> state preparing >Thread-1539::INFO::2013-03-01 14:01:35,968::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1539::INFO::2013-03-01 14:01:35,968::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1539::DEBUG::2013-03-01 14:01:35,968::task::1151::TaskManager.Task::(prepare) Task=`e5e5f17e-3b91-4c01-b11e-2458a1c07789`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1539::DEBUG::2013-03-01 14:01:35,968::task::568::TaskManager.Task::(_updateState) Task=`e5e5f17e-3b91-4c01-b11e-2458a1c07789`::moving from state preparing -> state finished >Thread-1539::DEBUG::2013-03-01 14:01:35,968::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1539::DEBUG::2013-03-01 14:01:35,969::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1539::DEBUG::2013-03-01 14:01:35,969::task::957::TaskManager.Task::(_decref) Task=`e5e5f17e-3b91-4c01-b11e-2458a1c07789`::ref 0 aborting False >Thread-1540::DEBUG::2013-03-01 14:01:36,000::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1540::DEBUG::2013-03-01 14:01:36,001::task::568::TaskManager.Task::(_updateState) Task=`72798add-ea81-4960-84e3-4dd54bbfb8d6`::moving from state init -> state preparing >Thread-1540::INFO::2013-03-01 14:01:36,001::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1540::INFO::2013-03-01 14:01:36,004::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1540::DEBUG::2013-03-01 14:01:36,004::task::1151::TaskManager.Task::(prepare) Task=`72798add-ea81-4960-84e3-4dd54bbfb8d6`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1540::DEBUG::2013-03-01 14:01:36,004::task::568::TaskManager.Task::(_updateState) Task=`72798add-ea81-4960-84e3-4dd54bbfb8d6`::moving from state preparing -> state finished >Thread-1540::DEBUG::2013-03-01 14:01:36,004::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1540::DEBUG::2013-03-01 14:01:36,005::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1540::DEBUG::2013-03-01 14:01:36,005::task::957::TaskManager.Task::(_decref) Task=`72798add-ea81-4960-84e3-4dd54bbfb8d6`::ref 0 aborting False >Thread-1541::DEBUG::2013-03-01 14:01:36,031::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1541::DEBUG::2013-03-01 14:01:36,032::task::568::TaskManager.Task::(_updateState) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::moving from state init -> state preparing >Thread-1541::INFO::2013-03-01 14:01:36,032::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1541::DEBUG::2013-03-01 14:01:36,033::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`a0bffe90-5f1b-4594-8c51-d15c70bdf00d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1541::DEBUG::2013-03-01 14:01:36,033::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1541::DEBUG::2013-03-01 14:01:36,033::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1541::DEBUG::2013-03-01 14:01:36,033::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`a0bffe90-5f1b-4594-8c51-d15c70bdf00d`::Granted request >Thread-1541::DEBUG::2013-03-01 14:01:36,034::task::794::TaskManager.Task::(resourceAcquired) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1541::DEBUG::2013-03-01 14:01:36,034::task::957::TaskManager.Task::(_decref) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::ref 1 aborting False >Thread-1541::DEBUG::2013-03-01 14:01:36,035::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`e41d16bb-29d0-44a5-b738-a437a38d5a9d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1541::DEBUG::2013-03-01 14:01:36,035::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-1541::DEBUG::2013-03-01 14:01:36,035::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-1541::DEBUG::2013-03-01 14:01:36,035::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`e41d16bb-29d0-44a5-b738-a437a38d5a9d`::Granted request >Thread-1541::DEBUG::2013-03-01 14:01:36,036::task::794::TaskManager.Task::(resourceAcquired) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-1541::DEBUG::2013-03-01 14:01:36,036::task::957::TaskManager.Task::(_decref) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::ref 1 aborting False >Thread-1541::INFO::2013-03-01 14:01:36,036::sp::918::Storage.StoragePool::(attachSD) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1541::DEBUG::2013-03-01 14:01:36,039::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1541::DEBUG::2013-03-01 14:01:36,039::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1541::DEBUG::2013-03-01 14:01:36,039::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1541::DEBUG::2013-03-01 14:01:36,040::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1541::DEBUG::2013-03-01 14:01:36,040::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1541::DEBUG::2013-03-01 14:01:36,055::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1541::DEBUG::2013-03-01 14:01:36,056::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:36,058::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:37,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:38,067::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:39,072::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:40,076::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:41,080::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1541::DEBUG::2013-03-01 14:01:41,083::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1544::DEBUG::2013-03-01 14:01:42,297::task::568::TaskManager.Task::(_updateState) Task=`5cbc8ded-6515-42d5-b599-2bb21ffdae53`::moving from state init -> state preparing >Thread-1544::INFO::2013-03-01 14:01:42,297::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1544::INFO::2013-03-01 14:01:42,297::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0034351348877', 'lastCheck': '1.9', 'code': 0, 'valid': True}} >Thread-1544::DEBUG::2013-03-01 14:01:42,297::task::1151::TaskManager.Task::(prepare) Task=`5cbc8ded-6515-42d5-b599-2bb21ffdae53`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0034351348877', 'lastCheck': '1.9', 'code': 0, 'valid': True}} >Thread-1544::DEBUG::2013-03-01 14:01:42,298::task::568::TaskManager.Task::(_updateState) Task=`5cbc8ded-6515-42d5-b599-2bb21ffdae53`::moving from state preparing -> state finished >Thread-1544::DEBUG::2013-03-01 14:01:42,298::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1544::DEBUG::2013-03-01 14:01:42,298::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1544::DEBUG::2013-03-01 14:01:42,298::task::957::TaskManager.Task::(_decref) Task=`5cbc8ded-6515-42d5-b599-2bb21ffdae53`::ref 0 aborting False >Thread-1541::DEBUG::2013-03-01 14:01:43,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1541::DEBUG::2013-03-01 14:01:43,736::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1541::DEBUG::2013-03-01 14:01:43,736::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,737::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,737::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,737::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,738::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,738::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,738::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1541::DEBUG::2013-03-01 14:01:43,739::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,740::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1541::DEBUG::2013-03-01 14:01:43,949::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1541::WARNING::2013-03-01 14:01:43,950::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1541::DEBUG::2013-03-01 14:01:43,952::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1541::DEBUG::2013-03-01 14:01:43,983::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1541::DEBUG::2013-03-01 14:01:43,983::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1541::DEBUG::2013-03-01 14:01:43,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a1b8b7f06ddbd9ea1b5f79bea19785f032bf8f73'] >Thread-1541::DEBUG::2013-03-01 14:01:43,989::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1541::WARNING::2013-03-01 14:01:43,990::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1541::WARNING::2013-03-01 14:01:43,990::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-1541::DEBUG::2013-03-01 14:01:43,990::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 successfully acquired (id: 1) >Thread-1541::DEBUG::2013-03-01 14:01:43,991::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1541::DEBUG::2013-03-01 14:01:43,992::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-1541::DEBUG::2013-03-01 14:01:46,069::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1541::DEBUG::2013-03-01 14:01:46,069::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-1541::DEBUG::2013-03-01 14:01:46,074::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a1b8b7f06ddbd9ea1b5f79bea19785f032bf8f73'] >Thread-1541::DEBUG::2013-03-01 14:01:46,074::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1541::DEBUG::2013-03-01 14:01:46,074::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1541::DEBUG::2013-03-01 14:01:46,075::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=fff2f70245d430706c52ad79378397cd4a528308'] >Thread-1541::DEBUG::2013-03-01 14:01:46,116::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1541::DEBUG::2013-03-01 14:01:46,117::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1541::DEBUG::2013-03-01 14:01:46,117::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1541::DEBUG::2013-03-01 14:01:46,118::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=db8616f39f8d17b817a51bba78a1872bbfdfe140'] >Thread-1541::DEBUG::2013-03-01 14:01:46,158::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1541::INFO::2013-03-01 14:01:46,159::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1541::DEBUG::2013-03-01 14:01:46,159::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1541::DEBUG::2013-03-01 14:01:46,160::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1541::DEBUG::2013-03-01 14:01:46,160::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1541::DEBUG::2013-03-01 14:01:46,160::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1541::DEBUG::2013-03-01 14:01:46,160::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=95181e60cfd0f3b9853f7ffda29920f2e0b346b6'] >Thread-1541::DEBUG::2013-03-01 14:01:46,240::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1541::INFO::2013-03-01 14:01:46,240::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1541::DEBUG::2013-03-01 14:01:46,241::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd /usr/libexec/vdsm) >Thread-1541::DEBUG::2013-03-01 14:01:47,314::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1541::DEBUG::2013-03-01 14:01:47,314::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-1541::DEBUG::2013-03-01 14:01:47,315::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 released successfully (id: 1) >Thread-1541::DEBUG::2013-03-01 14:01:47,315::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1541::DEBUG::2013-03-01 14:01:47,315::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1541::DEBUG::2013-03-01 14:01:47,316::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1541::INFO::2013-03-01 14:01:47,316::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-1541::DEBUG::2013-03-01 14:01:47,316::task::1151::TaskManager.Task::(prepare) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::finished: None >Thread-1541::DEBUG::2013-03-01 14:01:47,317::task::568::TaskManager.Task::(_updateState) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::moving from state preparing -> state finished >Thread-1541::DEBUG::2013-03-01 14:01:47,317::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-1541::DEBUG::2013-03-01 14:01:47,317::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1541::DEBUG::2013-03-01 14:01:47,318::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1541::DEBUG::2013-03-01 14:01:47,318::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1541::DEBUG::2013-03-01 14:01:47,318::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1541::DEBUG::2013-03-01 14:01:47,319::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1541::DEBUG::2013-03-01 14:01:47,319::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-1541::DEBUG::2013-03-01 14:01:47,319::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-1541::DEBUG::2013-03-01 14:01:47,320::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-1541::DEBUG::2013-03-01 14:01:47,320::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-1541::DEBUG::2013-03-01 14:01:47,320::task::957::TaskManager.Task::(_decref) Task=`eb51b7cf-ca9c-47a6-804b-ceaadc8e9588`::ref 0 aborting False >Thread-1558::DEBUG::2013-03-01 14:01:47,349::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1558::DEBUG::2013-03-01 14:01:47,350::task::568::TaskManager.Task::(_updateState) Task=`393ca674-bb97-4ba2-a985-bd916052eb8e`::moving from state init -> state preparing >Thread-1558::INFO::2013-03-01 14:01:47,350::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1558::INFO::2013-03-01 14:01:47,351::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1558::DEBUG::2013-03-01 14:01:47,351::task::1151::TaskManager.Task::(prepare) Task=`393ca674-bb97-4ba2-a985-bd916052eb8e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1558::DEBUG::2013-03-01 14:01:47,351::task::568::TaskManager.Task::(_updateState) Task=`393ca674-bb97-4ba2-a985-bd916052eb8e`::moving from state preparing -> state finished >Thread-1558::DEBUG::2013-03-01 14:01:47,351::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1558::DEBUG::2013-03-01 14:01:47,352::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1558::DEBUG::2013-03-01 14:01:47,352::task::957::TaskManager.Task::(_decref) Task=`393ca674-bb97-4ba2-a985-bd916052eb8e`::ref 0 aborting False >Thread-1559::DEBUG::2013-03-01 14:01:47,384::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1559::DEBUG::2013-03-01 14:01:47,385::task::568::TaskManager.Task::(_updateState) Task=`41359bc4-a3b5-4d6e-8e01-dd76d0ca8c9e`::moving from state init -> state preparing >Thread-1559::INFO::2013-03-01 14:01:47,385::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1559::DEBUG::2013-03-01 14:01:47,386::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`fc9f3c78-2a2d-48bf-bfab-9b92de3c3c4b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1559::DEBUG::2013-03-01 14:01:47,386::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1559::DEBUG::2013-03-01 14:01:47,387::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1559::DEBUG::2013-03-01 14:01:47,387::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`fc9f3c78-2a2d-48bf-bfab-9b92de3c3c4b`::Granted request >Thread-1559::DEBUG::2013-03-01 14:01:47,387::task::794::TaskManager.Task::(resourceAcquired) Task=`41359bc4-a3b5-4d6e-8e01-dd76d0ca8c9e`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1559::DEBUG::2013-03-01 14:01:47,388::task::957::TaskManager.Task::(_decref) Task=`41359bc4-a3b5-4d6e-8e01-dd76d0ca8c9e`::ref 1 aborting False >Thread-1559::INFO::2013-03-01 14:01:47,392::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942838644736', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}}} >Thread-1559::DEBUG::2013-03-01 14:01:47,392::task::1151::TaskManager.Task::(prepare) Task=`41359bc4-a3b5-4d6e-8e01-dd76d0ca8c9e`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942838644736', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}}} >Thread-1559::DEBUG::2013-03-01 14:01:47,392::task::568::TaskManager.Task::(_updateState) Task=`41359bc4-a3b5-4d6e-8e01-dd76d0ca8c9e`::moving from state preparing -> state finished >Thread-1559::DEBUG::2013-03-01 14:01:47,392::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1559::DEBUG::2013-03-01 14:01:47,393::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1559::DEBUG::2013-03-01 14:01:47,393::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1559::DEBUG::2013-03-01 14:01:47,393::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1559::DEBUG::2013-03-01 14:01:47,394::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1559::DEBUG::2013-03-01 14:01:47,394::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1559::DEBUG::2013-03-01 14:01:47,394::task::957::TaskManager.Task::(_decref) Task=`41359bc4-a3b5-4d6e-8e01-dd76d0ca8c9e`::ref 0 aborting False >Thread-1561::DEBUG::2013-03-01 14:01:48,511::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1561::DEBUG::2013-03-01 14:01:48,512::task::568::TaskManager.Task::(_updateState) Task=`70246db4-7ed8-42c2-bc1a-9aa373510d8e`::moving from state init -> state preparing >Thread-1561::INFO::2013-03-01 14:01:48,564::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-1561::INFO::2013-03-01 14:01:48,564::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1561::DEBUG::2013-03-01 14:01:48,564::task::1151::TaskManager.Task::(prepare) Task=`70246db4-7ed8-42c2-bc1a-9aa373510d8e`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1561::DEBUG::2013-03-01 14:01:48,564::task::568::TaskManager.Task::(_updateState) Task=`70246db4-7ed8-42c2-bc1a-9aa373510d8e`::moving from state preparing -> state finished >Thread-1561::DEBUG::2013-03-01 14:01:48,564::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1561::DEBUG::2013-03-01 14:01:48,565::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1561::DEBUG::2013-03-01 14:01:48,565::task::957::TaskManager.Task::(_decref) Task=`70246db4-7ed8-42c2-bc1a-9aa373510d8e`::ref 0 aborting False >Thread-1562::DEBUG::2013-03-01 14:01:48,595::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1562::DEBUG::2013-03-01 14:01:48,595::task::568::TaskManager.Task::(_updateState) Task=`4e65b62a-b974-4c10-8717-d52aa8c43b3b`::moving from state init -> state preparing >Thread-1562::INFO::2013-03-01 14:01:48,596::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-1562::INFO::2013-03-01 14:01:48,598::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1562::DEBUG::2013-03-01 14:01:48,598::task::1151::TaskManager.Task::(prepare) Task=`4e65b62a-b974-4c10-8717-d52aa8c43b3b`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1562::DEBUG::2013-03-01 14:01:48,598::task::568::TaskManager.Task::(_updateState) Task=`4e65b62a-b974-4c10-8717-d52aa8c43b3b`::moving from state preparing -> state finished >Thread-1562::DEBUG::2013-03-01 14:01:48,598::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1562::DEBUG::2013-03-01 14:01:48,599::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1562::DEBUG::2013-03-01 14:01:48,599::task::957::TaskManager.Task::(_decref) Task=`4e65b62a-b974-4c10-8717-d52aa8c43b3b`::ref 0 aborting False >Thread-1563::DEBUG::2013-03-01 14:01:48,625::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1563::DEBUG::2013-03-01 14:01:48,625::task::568::TaskManager.Task::(_updateState) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::moving from state init -> state preparing >Thread-1563::INFO::2013-03-01 14:01:48,626::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1563::DEBUG::2013-03-01 14:01:48,626::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`e6939311-a2dc-408c-8875-9db0399562f6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1563::DEBUG::2013-03-01 14:01:48,626::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1563::DEBUG::2013-03-01 14:01:48,627::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1563::DEBUG::2013-03-01 14:01:48,627::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`e6939311-a2dc-408c-8875-9db0399562f6`::Granted request >Thread-1563::DEBUG::2013-03-01 14:01:48,628::task::794::TaskManager.Task::(resourceAcquired) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1563::DEBUG::2013-03-01 14:01:48,628::task::957::TaskManager.Task::(_decref) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::ref 1 aborting False >Thread-1563::DEBUG::2013-03-01 14:01:48,628::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`001d629a-5a4a-4f89-a636-340b4ef5d393`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1563::DEBUG::2013-03-01 14:01:48,629::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' for lock type 'exclusive' >Thread-1563::DEBUG::2013-03-01 14:01:48,629::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free. Now locking as 'exclusive' (1 active user) >Thread-1563::DEBUG::2013-03-01 14:01:48,629::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`001d629a-5a4a-4f89-a636-340b4ef5d393`::Granted request >Thread-1563::DEBUG::2013-03-01 14:01:48,630::task::794::TaskManager.Task::(resourceAcquired) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::_resourcesAcquired: Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc (exclusive) >Thread-1563::DEBUG::2013-03-01 14:01:48,630::task::957::TaskManager.Task::(_decref) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::ref 1 aborting False >Thread-1563::INFO::2013-03-01 14:01:48,630::sp::918::Storage.StoragePool::(attachSD) sdUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1563::DEBUG::2013-03-01 14:01:48,634::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1563::DEBUG::2013-03-01 14:01:48,634::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1563::DEBUG::2013-03-01 14:01:48,634::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1563::DEBUG::2013-03-01 14:01:48,634::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1563::DEBUG::2013-03-01 14:01:48,635::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1563::DEBUG::2013-03-01 14:01:48,650::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1563::DEBUG::2013-03-01 14:01:48,651::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:48,655::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:48,658::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:49,662::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:50,667::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:51,671::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:51,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1563::DEBUG::2013-03-01 14:01:51,677::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1563::DEBUG::2013-03-01 14:01:53,681::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1563::DEBUG::2013-03-01 14:01:54,769::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1563::DEBUG::2013-03-01 14:01:54,770::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,770::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,771::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,771::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,771::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,772::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,772::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1563::DEBUG::2013-03-01 14:01:54,772::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:54,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1563::DEBUG::2013-03-01 14:01:54,995::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1563::WARNING::2013-03-01 14:01:54,996::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1563::DEBUG::2013-03-01 14:01:54,997::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1563::DEBUG::2013-03-01 14:01:55,015::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1563::DEBUG::2013-03-01 14:01:55,015::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1563::DEBUG::2013-03-01 14:01:55,019::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4a9fb07ec343ed4427fda9d0a28490e08d742c40'] >Thread-1563::DEBUG::2013-03-01 14:01:55,021::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1563::WARNING::2013-03-01 14:01:55,021::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-1563::WARNING::2013-03-01 14:01:55,022::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-1563::DEBUG::2013-03-01 14:01:55,022::clusterlock::81::SafeLease::(acquireHostId) Host id for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc successfully acquired (id: 1) >Thread-1563::DEBUG::2013-03-01 14:01:55,022::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1563::DEBUG::2013-03-01 14:01:55,023::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start edd0d33d-dba0-4943-9c48-6112a2ddcdfc 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-1563::DEBUG::2013-03-01 14:01:57,174::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1563::DEBUG::2013-03-01 14:01:57,174::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-1563::DEBUG::2013-03-01 14:01:57,178::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4a9fb07ec343ed4427fda9d0a28490e08d742c40'] >Thread-1563::DEBUG::2013-03-01 14:01:57,179::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1563::DEBUG::2013-03-01 14:01:57,179::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1563::DEBUG::2013-03-01 14:01:57,180::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=373c9fd15593c7e18d3385400a17c168428511fb'] >Thread-1563::DEBUG::2013-03-01 14:01:57,216::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1563::DEBUG::2013-03-01 14:01:57,216::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1563::DEBUG::2013-03-01 14:01:57,217::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1563::DEBUG::2013-03-01 14:01:57,217::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=72208911e413e591c7c61e5daecd4a0806b95fa6'] >Thread-1563::DEBUG::2013-03-01 14:01:57,269::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1563::INFO::2013-03-01 14:01:57,269::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1563::DEBUG::2013-03-01 14:01:57,270::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1563::DEBUG::2013-03-01 14:01:57,270::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1563::DEBUG::2013-03-01 14:01:57,270::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1563::DEBUG::2013-03-01 14:01:57,271::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1563::DEBUG::2013-03-01 14:01:57,271::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-1563::DEBUG::2013-03-01 14:01:57,312::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1563::INFO::2013-03-01 14:01:57,312::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1563::DEBUG::2013-03-01 14:01:57,313::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd /usr/libexec/vdsm) >Thread-1582::DEBUG::2013-03-01 14:01:57,539::task::568::TaskManager.Task::(_updateState) Task=`4d6e4de8-83df-4360-881d-8e89406f4af0`::moving from state init -> state preparing >Thread-1582::INFO::2013-03-01 14:01:57,539::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1582::INFO::2013-03-01 14:01:57,540::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00374317169189', 'lastCheck': '7.1', 'code': 0, 'valid': True}} >Thread-1582::DEBUG::2013-03-01 14:01:57,540::task::1151::TaskManager.Task::(prepare) Task=`4d6e4de8-83df-4360-881d-8e89406f4af0`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00374317169189', 'lastCheck': '7.1', 'code': 0, 'valid': True}} >Thread-1582::DEBUG::2013-03-01 14:01:57,540::task::568::TaskManager.Task::(_updateState) Task=`4d6e4de8-83df-4360-881d-8e89406f4af0`::moving from state preparing -> state finished >Thread-1582::DEBUG::2013-03-01 14:01:57,541::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1582::DEBUG::2013-03-01 14:01:57,541::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1582::DEBUG::2013-03-01 14:01:57,541::task::957::TaskManager.Task::(_decref) Task=`4d6e4de8-83df-4360-881d-8e89406f4af0`::ref 0 aborting False >Thread-1563::DEBUG::2013-03-01 14:01:58,360::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1563::DEBUG::2013-03-01 14:01:58,360::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-1563::DEBUG::2013-03-01 14:01:58,361::clusterlock::85::SafeLease::(releaseHostId) Host id for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc released successfully (id: 1) >Thread-1563::DEBUG::2013-03-01 14:01:58,361::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1563::DEBUG::2013-03-01 14:01:58,361::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1563::DEBUG::2013-03-01 14:01:58,362::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1563::INFO::2013-03-01 14:01:58,362::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-1563::DEBUG::2013-03-01 14:01:58,362::task::1151::TaskManager.Task::(prepare) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::finished: None >Thread-1563::DEBUG::2013-03-01 14:01:58,362::task::568::TaskManager.Task::(_updateState) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::moving from state preparing -> state finished >Thread-1563::DEBUG::2013-03-01 14:01:58,363::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc': < ResourceRef 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', isValid: 'True' obj: 'None'>, 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1563::DEBUG::2013-03-01 14:01:58,363::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1563::DEBUG::2013-03-01 14:01:58,363::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' >Thread-1563::DEBUG::2013-03-01 14:01:58,364::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (0 active users) >Thread-1563::DEBUG::2013-03-01 14:01:58,364::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free, finding out if anyone is waiting for it. >Thread-1563::DEBUG::2013-03-01 14:01:58,364::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', Clearing records. >Thread-1563::DEBUG::2013-03-01 14:01:58,365::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1563::DEBUG::2013-03-01 14:01:58,365::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1563::DEBUG::2013-03-01 14:01:58,365::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1563::DEBUG::2013-03-01 14:01:58,366::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1563::DEBUG::2013-03-01 14:01:58,366::task::957::TaskManager.Task::(_decref) Task=`b249b86e-430d-44e4-a6eb-427d9df3fb51`::ref 0 aborting False >Thread-1584::DEBUG::2013-03-01 14:01:58,396::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1584::DEBUG::2013-03-01 14:01:58,396::task::568::TaskManager.Task::(_updateState) Task=`b0a1e6d3-466b-4984-8ea3-ec3ba97fecab`::moving from state init -> state preparing >Thread-1584::INFO::2013-03-01 14:01:58,397::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1584::INFO::2013-03-01 14:01:58,397::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1584::DEBUG::2013-03-01 14:01:58,397::task::1151::TaskManager.Task::(prepare) Task=`b0a1e6d3-466b-4984-8ea3-ec3ba97fecab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1584::DEBUG::2013-03-01 14:01:58,398::task::568::TaskManager.Task::(_updateState) Task=`b0a1e6d3-466b-4984-8ea3-ec3ba97fecab`::moving from state preparing -> state finished >Thread-1584::DEBUG::2013-03-01 14:01:58,398::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1584::DEBUG::2013-03-01 14:01:58,398::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1584::DEBUG::2013-03-01 14:01:58,399::task::957::TaskManager.Task::(_decref) Task=`b0a1e6d3-466b-4984-8ea3-ec3ba97fecab`::ref 0 aborting False >Thread-1585::DEBUG::2013-03-01 14:01:58,432::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1585::DEBUG::2013-03-01 14:01:58,433::task::568::TaskManager.Task::(_updateState) Task=`7ccc327a-8d96-4e5f-ba4a-de270b7fb91b`::moving from state init -> state preparing >Thread-1585::INFO::2013-03-01 14:01:58,433::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1585::DEBUG::2013-03-01 14:01:58,434::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`09b484f9-661d-40a6-8762-625ff2b1bd9f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1585::DEBUG::2013-03-01 14:01:58,434::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1585::DEBUG::2013-03-01 14:01:58,434::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1585::DEBUG::2013-03-01 14:01:58,435::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`09b484f9-661d-40a6-8762-625ff2b1bd9f`::Granted request >Thread-1585::DEBUG::2013-03-01 14:01:58,435::task::794::TaskManager.Task::(resourceAcquired) Task=`7ccc327a-8d96-4e5f-ba4a-de270b7fb91b`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1585::DEBUG::2013-03-01 14:01:58,436::task::957::TaskManager.Task::(_decref) Task=`7ccc327a-8d96-4e5f-ba4a-de270b7fb91b`::ref 1 aborting False >Thread-1585::INFO::2013-03-01 14:01:58,440::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942838644736', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-1585::DEBUG::2013-03-01 14:01:58,440::task::1151::TaskManager.Task::(prepare) Task=`7ccc327a-8d96-4e5f-ba4a-de270b7fb91b`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942838644736', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-1585::DEBUG::2013-03-01 14:01:58,441::task::568::TaskManager.Task::(_updateState) Task=`7ccc327a-8d96-4e5f-ba4a-de270b7fb91b`::moving from state preparing -> state finished >Thread-1585::DEBUG::2013-03-01 14:01:58,441::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1585::DEBUG::2013-03-01 14:01:58,441::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1585::DEBUG::2013-03-01 14:01:58,442::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1585::DEBUG::2013-03-01 14:01:58,442::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1585::DEBUG::2013-03-01 14:01:58,442::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1585::DEBUG::2013-03-01 14:01:58,442::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1585::DEBUG::2013-03-01 14:01:58,443::task::957::TaskManager.Task::(_decref) Task=`7ccc327a-8d96-4e5f-ba4a-de270b7fb91b`::ref 0 aborting False >Thread-1586::DEBUG::2013-03-01 14:01:59,917::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1586::DEBUG::2013-03-01 14:01:59,917::task::568::TaskManager.Task::(_updateState) Task=`408d2f4a-4308-40aa-8c49-343aed1864ff`::moving from state init -> state preparing >Thread-1586::INFO::2013-03-01 14:01:59,918::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1586::INFO::2013-03-01 14:01:59,918::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1586::DEBUG::2013-03-01 14:01:59,918::task::1151::TaskManager.Task::(prepare) Task=`408d2f4a-4308-40aa-8c49-343aed1864ff`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1586::DEBUG::2013-03-01 14:01:59,919::task::568::TaskManager.Task::(_updateState) Task=`408d2f4a-4308-40aa-8c49-343aed1864ff`::moving from state preparing -> state finished >Thread-1586::DEBUG::2013-03-01 14:01:59,919::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1586::DEBUG::2013-03-01 14:01:59,919::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1586::DEBUG::2013-03-01 14:01:59,919::task::957::TaskManager.Task::(_decref) Task=`408d2f4a-4308-40aa-8c49-343aed1864ff`::ref 0 aborting False >Thread-1587::DEBUG::2013-03-01 14:01:59,950::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1587::DEBUG::2013-03-01 14:01:59,950::task::568::TaskManager.Task::(_updateState) Task=`0f6b39f6-2bad-4efd-84c3-d8100dde3dcf`::moving from state init -> state preparing >Thread-1587::INFO::2013-03-01 14:01:59,951::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1587::INFO::2013-03-01 14:01:59,954::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1587::DEBUG::2013-03-01 14:01:59,954::task::1151::TaskManager.Task::(prepare) Task=`0f6b39f6-2bad-4efd-84c3-d8100dde3dcf`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1587::DEBUG::2013-03-01 14:01:59,954::task::568::TaskManager.Task::(_updateState) Task=`0f6b39f6-2bad-4efd-84c3-d8100dde3dcf`::moving from state preparing -> state finished >Thread-1587::DEBUG::2013-03-01 14:01:59,955::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1587::DEBUG::2013-03-01 14:01:59,955::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1587::DEBUG::2013-03-01 14:01:59,955::task::957::TaskManager.Task::(_decref) Task=`0f6b39f6-2bad-4efd-84c3-d8100dde3dcf`::ref 0 aborting False >Thread-1588::DEBUG::2013-03-01 14:01:59,982::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1588::DEBUG::2013-03-01 14:01:59,982::task::568::TaskManager.Task::(_updateState) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::moving from state init -> state preparing >Thread-1588::INFO::2013-03-01 14:01:59,982::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1588::DEBUG::2013-03-01 14:01:59,983::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`1a22cd85-4164-4e4b-8e19-783a000f3548`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1588::DEBUG::2013-03-01 14:01:59,983::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1588::DEBUG::2013-03-01 14:01:59,984::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1588::DEBUG::2013-03-01 14:01:59,984::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`1a22cd85-4164-4e4b-8e19-783a000f3548`::Granted request >Thread-1588::DEBUG::2013-03-01 14:01:59,984::task::794::TaskManager.Task::(resourceAcquired) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1588::DEBUG::2013-03-01 14:01:59,985::task::957::TaskManager.Task::(_decref) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::ref 1 aborting False >Thread-1588::DEBUG::2013-03-01 14:01:59,985::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`e41848a4-4e47-4b98-8a85-85761151d0f4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1588::DEBUG::2013-03-01 14:01:59,985::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-1588::DEBUG::2013-03-01 14:01:59,986::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-1588::DEBUG::2013-03-01 14:01:59,986::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`e41848a4-4e47-4b98-8a85-85761151d0f4`::Granted request >Thread-1588::DEBUG::2013-03-01 14:01:59,987::task::794::TaskManager.Task::(resourceAcquired) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-1588::DEBUG::2013-03-01 14:01:59,987::task::957::TaskManager.Task::(_decref) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::ref 1 aborting False >Thread-1588::INFO::2013-03-01 14:01:59,987::sp::1045::Storage.StoragePool::(activateSD) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1588::DEBUG::2013-03-01 14:01:59,988::formatConverter::98::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 from version 0 to version 3 >Thread-1588::DEBUG::2013-03-01 14:01:59,988::formatConverter::118::Storage.v3DomainConverter::(v3DomainConverter) Setting permissions for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:00,055::formatConverter::121::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:00,055::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:00,163::formatConverter::125::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::INFO::2013-03-01 14:02:00,163::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (id: 1) >Thread-1593::DEBUG::2013-03-01 14:02:12,764::task::568::TaskManager.Task::(_updateState) Task=`657cca68-104f-4cc4-9f4b-fdfaec48280f`::moving from state init -> state preparing >Thread-1593::INFO::2013-03-01 14:02:12,765::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1593::INFO::2013-03-01 14:02:12,765::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00364780426025', 'lastCheck': '2.3', 'code': 0, 'valid': True}} >Thread-1593::DEBUG::2013-03-01 14:02:12,765::task::1151::TaskManager.Task::(prepare) Task=`657cca68-104f-4cc4-9f4b-fdfaec48280f`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00364780426025', 'lastCheck': '2.3', 'code': 0, 'valid': True}} >Thread-1593::DEBUG::2013-03-01 14:02:12,766::task::568::TaskManager.Task::(_updateState) Task=`657cca68-104f-4cc4-9f4b-fdfaec48280f`::moving from state preparing -> state finished >Thread-1593::DEBUG::2013-03-01 14:02:12,766::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1593::DEBUG::2013-03-01 14:02:12,766::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1593::DEBUG::2013-03-01 14:02:12,766::task::957::TaskManager.Task::(_decref) Task=`657cca68-104f-4cc4-9f4b-fdfaec48280f`::ref 0 aborting False >Thread-1588::DEBUG::2013-03-01 14:02:21,166::clusterlock::191::SANLock::(acquireHostId) Host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 successfully acquired (id: 1) >Thread-1588::DEBUG::2013-03-01 14:02:21,168::formatConverter::160::Storage.v3DomainConverter::(v3ReallocateMetadataSlot) The metadata reallocation check is not needed for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:21,168::formatConverter::298::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 0 to version 3 for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:21,168::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1588::DEBUG::2013-03-01 14:02:21,168::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1588::DEBUG::2013-03-01 14:02:21,169::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1588::DEBUG::2013-03-01 14:02:21,246::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1588::DEBUG::2013-03-01 14:02:21,246::formatConverter::336::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:21,246::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1588::DEBUG::2013-03-01 14:02:21,246::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1588::DEBUG::2013-03-01 14:02:21,247::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1588::DEBUG::2013-03-01 14:02:21,247::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1588::DEBUG::2013-03-01 14:02:21,247::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1588::DEBUG::2013-03-01 14:02:21,279::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1588::DEBUG::2013-03-01 14:02:21,280::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:21,315::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:22,319::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:23,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:24,328::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:25,332::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:25,335::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1588::DEBUG::2013-03-01 14:02:25,338::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1588::DEBUG::2013-03-01 14:02:27,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1599::DEBUG::2013-03-01 14:02:28,085::task::568::TaskManager.Task::(_updateState) Task=`76cb9b10-b965-4724-8189-7fce01729447`::moving from state init -> state preparing >Thread-1599::INFO::2013-03-01 14:02:28,098::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1599::INFO::2013-03-01 14:02:28,102::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00308299064636', 'lastCheck': '7.6', 'code': 0, 'valid': True}} >Thread-1599::DEBUG::2013-03-01 14:02:28,105::task::1151::TaskManager.Task::(prepare) Task=`76cb9b10-b965-4724-8189-7fce01729447`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00308299064636', 'lastCheck': '7.6', 'code': 0, 'valid': True}} >Thread-1599::DEBUG::2013-03-01 14:02:28,108::task::568::TaskManager.Task::(_updateState) Task=`76cb9b10-b965-4724-8189-7fce01729447`::moving from state preparing -> state finished >Thread-1599::DEBUG::2013-03-01 14:02:28,110::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1599::DEBUG::2013-03-01 14:02:28,113::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1599::DEBUG::2013-03-01 14:02:28,116::task::957::TaskManager.Task::(_decref) Task=`76cb9b10-b965-4724-8189-7fce01729447`::ref 0 aborting False >Thread-1588::DEBUG::2013-03-01 14:02:29,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1588::DEBUG::2013-03-01 14:02:29,879::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,880::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,880::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,880::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,881::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,881::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,881::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1588::DEBUG::2013-03-01 14:02:29,882::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:29,883::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1588::DEBUG::2013-03-01 14:02:30,145::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1588::WARNING::2013-03-01 14:02:30,146::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1588::DEBUG::2013-03-01 14:02:30,147::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1588::DEBUG::2013-03-01 14:02:30,181::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:30,181::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1588::DEBUG::2013-03-01 14:02:30,185::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1588::DEBUG::2013-03-01 14:02:30,187::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1588::WARNING::2013-03-01 14:02:30,187::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1588::WARNING::2013-03-01 14:02:30,187::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-1588::DEBUG::2013-03-01 14:02:30,188::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1588::DEBUG::2013-03-01 14:02:30,188::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1588::DEBUG::2013-03-01 14:02:30,189::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3474e68746feddf1cf7d1efc45ff07e60f5759a1'] >Thread-1588::DEBUG::2013-03-01 14:02:30,262::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1588::INFO::2013-03-01 14:02:30,263::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:30,263::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1588::DEBUG::2013-03-01 14:02:30,264::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1588::DEBUG::2013-03-01 14:02:30,264::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1588::DEBUG::2013-03-01 14:02:30,264::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1588::DEBUG::2013-03-01 14:02:30,264::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1588::DEBUG::2013-03-01 14:02:30,265::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1588::DEBUG::2013-03-01 14:02:30,266::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` started monitoring domain `49d8a532-e3af-4ed8-b859-bacb52bd2eb0` >Thread-1612::DEBUG::2013-03-01 14:02:30,266::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1588::DEBUG::2013-03-01 14:02:30,267::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1588::INFO::2013-03-01 14:02:30,268::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-1588::DEBUG::2013-03-01 14:02:30,269::task::1151::TaskManager.Task::(prepare) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::finished: None >Thread-1588::DEBUG::2013-03-01 14:02:30,271::task::568::TaskManager.Task::(_updateState) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::moving from state preparing -> state finished >Thread-1588::DEBUG::2013-03-01 14:02:30,272::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-1588::DEBUG::2013-03-01 14:02:30,273::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1588::DEBUG::2013-03-01 14:02:30,276::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1588::DEBUG::2013-03-01 14:02:30,278::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1588::DEBUG::2013-03-01 14:02:30,279::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1588::DEBUG::2013-03-01 14:02:30,281::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1588::DEBUG::2013-03-01 14:02:30,283::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-1588::DEBUG::2013-03-01 14:02:30,284::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-1588::DEBUG::2013-03-01 14:02:30,285::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-1588::DEBUG::2013-03-01 14:02:30,286::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-1588::DEBUG::2013-03-01 14:02:30,286::task::957::TaskManager.Task::(_decref) Task=`2a453ffb-e0d2-4a6f-b7b4-90a69c869de2`::ref 0 aborting False >Thread-1613::DEBUG::2013-03-01 14:02:30,326::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1613::DEBUG::2013-03-01 14:02:30,327::task::568::TaskManager.Task::(_updateState) Task=`a20e3c62-d8d4-4a40-8142-0423efc331c9`::moving from state init -> state preparing >Thread-1613::INFO::2013-03-01 14:02:30,328::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1613::INFO::2013-03-01 14:02:30,329::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1613::DEBUG::2013-03-01 14:02:30,330::task::1151::TaskManager.Task::(prepare) Task=`a20e3c62-d8d4-4a40-8142-0423efc331c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1613::DEBUG::2013-03-01 14:02:30,330::task::568::TaskManager.Task::(_updateState) Task=`a20e3c62-d8d4-4a40-8142-0423efc331c9`::moving from state preparing -> state finished >Thread-1613::DEBUG::2013-03-01 14:02:30,330::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1613::DEBUG::2013-03-01 14:02:30,330::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1613::DEBUG::2013-03-01 14:02:30,331::task::957::TaskManager.Task::(_decref) Task=`a20e3c62-d8d4-4a40-8142-0423efc331c9`::ref 0 aborting False >Thread-1614::DEBUG::2013-03-01 14:02:30,350::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1614::DEBUG::2013-03-01 14:02:30,350::task::568::TaskManager.Task::(_updateState) Task=`aa856a04-5d78-45c5-ad81-4244ed85f5dd`::moving from state init -> state preparing >Thread-1614::INFO::2013-03-01 14:02:30,351::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1614::DEBUG::2013-03-01 14:02:30,351::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`ef3b69c2-2c03-45e3-a4bf-6f78ab3b4d73`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1614::DEBUG::2013-03-01 14:02:30,352::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1614::DEBUG::2013-03-01 14:02:30,352::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1614::DEBUG::2013-03-01 14:02:30,353::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`ef3b69c2-2c03-45e3-a4bf-6f78ab3b4d73`::Granted request >Thread-1614::DEBUG::2013-03-01 14:02:30,353::task::794::TaskManager.Task::(resourceAcquired) Task=`aa856a04-5d78-45c5-ad81-4244ed85f5dd`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1614::DEBUG::2013-03-01 14:02:30,354::task::957::TaskManager.Task::(_decref) Task=`aa856a04-5d78-45c5-ad81-4244ed85f5dd`::ref 1 aborting False >Thread-1614::INFO::2013-03-01 14:02:30,354::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1614::DEBUG::2013-03-01 14:02:30,362::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3474e68746feddf1cf7d1efc45ff07e60f5759a1'] >Thread-1614::DEBUG::2013-03-01 14:02:30,363::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:30,363::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:30,364::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:30,364::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:30,364::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:30,365::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:30,365::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1614::DEBUG::2013-03-01 14:02:30,365::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1614::DEBUG::2013-03-01 14:02:30,366::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1614::DEBUG::2013-03-01 14:02:30,366::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1614::DEBUG::2013-03-01 14:02:30,367::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1615::DEBUG::2013-03-01 14:02:30,376::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1615::DEBUG::2013-03-01 14:02:30,377::task::568::TaskManager.Task::(_updateState) Task=`2d319374-b570-4aff-829c-3c80083503d5`::moving from state init -> state preparing >Thread-1615::INFO::2013-03-01 14:02:30,377::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1615::DEBUG::2013-03-01 14:02:30,378::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`d873eb47-2dbc-4095-8a51-8d75d9207116`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1615::DEBUG::2013-03-01 14:02:30,378::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1615::DEBUG::2013-03-01 14:02:30,379::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-1615::DEBUG::2013-03-01 14:02:30,379::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`d873eb47-2dbc-4095-8a51-8d75d9207116`::Granted request >Thread-1615::DEBUG::2013-03-01 14:02:30,380::task::794::TaskManager.Task::(resourceAcquired) Task=`2d319374-b570-4aff-829c-3c80083503d5`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1615::DEBUG::2013-03-01 14:02:30,380::task::957::TaskManager.Task::(_decref) Task=`2d319374-b570-4aff-829c-3c80083503d5`::ref 1 aborting False >Thread-1614::DEBUG::2013-03-01 14:02:30,383::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1614::DEBUG::2013-03-01 14:02:30,383::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:30,386::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:31,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:32,395::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:33,400::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:34,404::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:34,408::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1614::DEBUG::2013-03-01 14:02:34,411::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1614::DEBUG::2013-03-01 14:02:36,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1614::DEBUG::2013-03-01 14:02:37,504::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1614::DEBUG::2013-03-01 14:02:37,505::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,505::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,506::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,506::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,506::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,507::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,507::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1614::DEBUG::2013-03-01 14:02:37,507::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,509::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1614::DEBUG::2013-03-01 14:02:37,726::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1614::WARNING::2013-03-01 14:02:37,727::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1614::DEBUG::2013-03-01 14:02:37,728::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,778::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1614::DEBUG::2013-03-01 14:02:37,779::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1614::DEBUG::2013-03-01 14:02:37,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3474e68746feddf1cf7d1efc45ff07e60f5759a1'] >Thread-1614::DEBUG::2013-03-01 14:02:37,785::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1614::WARNING::2013-03-01 14:02:37,785::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-1614::WARNING::2013-03-01 14:02:37,785::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-1614::DEBUG::2013-03-01 14:02:37,788::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1614::DEBUG::2013-03-01 14:02:37,790::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1614::DEBUG::2013-03-01 14:02:37,793::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1614::DEBUG::2013-03-01 14:02:37,797::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1614::WARNING::2013-03-01 14:02:37,799::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1614::DEBUG::2013-03-01 14:02:37,808::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1615::DEBUG::2013-03-01 14:02:37,821::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-1614::DEBUG::2013-03-01 14:02:37,822::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1615::DEBUG::2013-03-01 14:02:37,833::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1614::DEBUG::2013-03-01 14:02:38,050::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1614::WARNING::2013-03-01 14:02:38,051::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1615::DEBUG::2013-03-01 14:02:38,073::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1615::WARNING::2013-03-01 14:02:38,085::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1615::DEBUG::2013-03-01 14:02:38,094::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1614::INFO::2013-03-01 14:02:38,144::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1614::INFO::2013-03-01 14:02:38,151::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1614::INFO::2013-03-01 14:02:38,158::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1614::INFO::2013-03-01 14:02:38,162::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1614::DEBUG::2013-03-01 14:02:38,164::task::1151::TaskManager.Task::(prepare) Task=`aa856a04-5d78-45c5-ad81-4244ed85f5dd`::finished: None >Thread-1614::DEBUG::2013-03-01 14:02:38,166::task::568::TaskManager.Task::(_updateState) Task=`aa856a04-5d78-45c5-ad81-4244ed85f5dd`::moving from state preparing -> state finished >Thread-1614::DEBUG::2013-03-01 14:02:38,168::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1614::DEBUG::2013-03-01 14:02:38,169::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1614::DEBUG::2013-03-01 14:02:38,171::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1614::DEBUG::2013-03-01 14:02:38,174::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-1615::DEBUG::2013-03-01 14:02:38,175::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1615::DEBUG::2013-03-01 14:02:38,176::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1614::DEBUG::2013-03-01 14:02:38,177::task::957::TaskManager.Task::(_decref) Task=`aa856a04-5d78-45c5-ad81-4244ed85f5dd`::ref 0 aborting False >Thread-1615::DEBUG::2013-03-01 14:02:38,182::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1615::DEBUG::2013-03-01 14:02:38,183::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1615::WARNING::2013-03-01 14:02:38,184::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1615::WARNING::2013-03-01 14:02:38,184::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-1615::INFO::2013-03-01 14:02:38,185::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942808236032', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Active', 'diskfree': '942807187456', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-1615::DEBUG::2013-03-01 14:02:38,185::task::1151::TaskManager.Task::(prepare) Task=`2d319374-b570-4aff-829c-3c80083503d5`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942808236032', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Active', 'diskfree': '942807187456', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-1615::DEBUG::2013-03-01 14:02:38,185::task::568::TaskManager.Task::(_updateState) Task=`2d319374-b570-4aff-829c-3c80083503d5`::moving from state preparing -> state finished >Thread-1615::DEBUG::2013-03-01 14:02:38,185::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1615::DEBUG::2013-03-01 14:02:38,186::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1615::DEBUG::2013-03-01 14:02:38,186::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1615::DEBUG::2013-03-01 14:02:38,186::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1615::DEBUG::2013-03-01 14:02:38,187::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1615::DEBUG::2013-03-01 14:02:38,187::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1615::DEBUG::2013-03-01 14:02:38,187::task::957::TaskManager.Task::(_decref) Task=`2d319374-b570-4aff-829c-3c80083503d5`::ref 0 aborting False >Thread-1674::DEBUG::2013-03-01 14:02:39,357::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1674::DEBUG::2013-03-01 14:02:39,357::task::568::TaskManager.Task::(_updateState) Task=`eb8dadd3-613e-4e07-b7e0-84bb729cdf8c`::moving from state init -> state preparing >Thread-1674::INFO::2013-03-01 14:02:39,358::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-1674::INFO::2013-03-01 14:02:39,358::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1674::DEBUG::2013-03-01 14:02:39,358::task::1151::TaskManager.Task::(prepare) Task=`eb8dadd3-613e-4e07-b7e0-84bb729cdf8c`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1674::DEBUG::2013-03-01 14:02:39,358::task::568::TaskManager.Task::(_updateState) Task=`eb8dadd3-613e-4e07-b7e0-84bb729cdf8c`::moving from state preparing -> state finished >Thread-1674::DEBUG::2013-03-01 14:02:39,359::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1674::DEBUG::2013-03-01 14:02:39,359::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1674::DEBUG::2013-03-01 14:02:39,359::task::957::TaskManager.Task::(_decref) Task=`eb8dadd3-613e-4e07-b7e0-84bb729cdf8c`::ref 0 aborting False >Thread-1675::DEBUG::2013-03-01 14:02:39,396::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1675::DEBUG::2013-03-01 14:02:39,397::task::568::TaskManager.Task::(_updateState) Task=`082acb86-da13-4107-8a4c-08069c9ed7b3`::moving from state init -> state preparing >Thread-1675::INFO::2013-03-01 14:02:39,397::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-1675::INFO::2013-03-01 14:02:39,401::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1675::DEBUG::2013-03-01 14:02:39,401::task::1151::TaskManager.Task::(prepare) Task=`082acb86-da13-4107-8a4c-08069c9ed7b3`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-1675::DEBUG::2013-03-01 14:02:39,401::task::568::TaskManager.Task::(_updateState) Task=`082acb86-da13-4107-8a4c-08069c9ed7b3`::moving from state preparing -> state finished >Thread-1675::DEBUG::2013-03-01 14:02:39,401::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1675::DEBUG::2013-03-01 14:02:39,402::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1675::DEBUG::2013-03-01 14:02:39,402::task::957::TaskManager.Task::(_decref) Task=`082acb86-da13-4107-8a4c-08069c9ed7b3`::ref 0 aborting False >Thread-1676::DEBUG::2013-03-01 14:02:39,429::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1676::DEBUG::2013-03-01 14:02:39,430::task::568::TaskManager.Task::(_updateState) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::moving from state init -> state preparing >Thread-1676::INFO::2013-03-01 14:02:39,430::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1676::DEBUG::2013-03-01 14:02:39,431::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`c8e6be4a-10b3-4a31-8478-8109696d0d4c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1676::DEBUG::2013-03-01 14:02:39,431::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1676::DEBUG::2013-03-01 14:02:39,431::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1676::DEBUG::2013-03-01 14:02:39,431::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`c8e6be4a-10b3-4a31-8478-8109696d0d4c`::Granted request >Thread-1676::DEBUG::2013-03-01 14:02:39,432::task::794::TaskManager.Task::(resourceAcquired) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1676::DEBUG::2013-03-01 14:02:39,432::task::957::TaskManager.Task::(_decref) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::ref 1 aborting False >Thread-1676::DEBUG::2013-03-01 14:02:39,433::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`806e1e70-09bc-4984-abcb-f0c9484646e4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1676::DEBUG::2013-03-01 14:02:39,433::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' for lock type 'exclusive' >Thread-1676::DEBUG::2013-03-01 14:02:39,433::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free. Now locking as 'exclusive' (1 active user) >Thread-1676::DEBUG::2013-03-01 14:02:39,434::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`806e1e70-09bc-4984-abcb-f0c9484646e4`::Granted request >Thread-1676::DEBUG::2013-03-01 14:02:39,434::task::794::TaskManager.Task::(resourceAcquired) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::_resourcesAcquired: Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc (exclusive) >Thread-1676::DEBUG::2013-03-01 14:02:39,434::task::957::TaskManager.Task::(_decref) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::ref 1 aborting False >Thread-1676::INFO::2013-03-01 14:02:39,435::sp::1045::Storage.StoragePool::(activateSD) sdUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1676::DEBUG::2013-03-01 14:02:39,435::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1676::DEBUG::2013-03-01 14:02:39,435::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1676::DEBUG::2013-03-01 14:02:39,436::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1676::DEBUG::2013-03-01 14:02:39,436::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1676::DEBUG::2013-03-01 14:02:39,436::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1676::DEBUG::2013-03-01 14:02:39,451::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1676::DEBUG::2013-03-01 14:02:39,452::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:39,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:40,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:40,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:40,465::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:40,468::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:41,472::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1676::DEBUG::2013-03-01 14:02:41,475::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1678::DEBUG::2013-03-01 14:02:43,437::task::568::TaskManager.Task::(_updateState) Task=`29d7e037-8f1a-48a2-b2a9-7469ae1c3695`::moving from state init -> state preparing >Thread-1678::INFO::2013-03-01 14:02:43,437::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1678::INFO::2013-03-01 14:02:43,437::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0144760608673', 'lastCheck': '5.6', 'code': 0, 'valid': True}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'delay': '0.002934217453', 'lastCheck': '3.1', 'code': 0, 'valid': True}} >Thread-1678::DEBUG::2013-03-01 14:02:43,437::task::1151::TaskManager.Task::(prepare) Task=`29d7e037-8f1a-48a2-b2a9-7469ae1c3695`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0144760608673', 'lastCheck': '5.6', 'code': 0, 'valid': True}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'delay': '0.002934217453', 'lastCheck': '3.1', 'code': 0, 'valid': True}} >Thread-1678::DEBUG::2013-03-01 14:02:43,437::task::568::TaskManager.Task::(_updateState) Task=`29d7e037-8f1a-48a2-b2a9-7469ae1c3695`::moving from state preparing -> state finished >Thread-1678::DEBUG::2013-03-01 14:02:43,438::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1678::DEBUG::2013-03-01 14:02:43,438::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1678::DEBUG::2013-03-01 14:02:43,438::task::957::TaskManager.Task::(_decref) Task=`29d7e037-8f1a-48a2-b2a9-7469ae1c3695`::ref 0 aborting False >Thread-1676::DEBUG::2013-03-01 14:02:43,478::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1676::DEBUG::2013-03-01 14:02:44,539::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1676::DEBUG::2013-03-01 14:02:44,540::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,540::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,541::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,541::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,541::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,542::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,542::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1676::DEBUG::2013-03-01 14:02:44,542::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,544::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1676::DEBUG::2013-03-01 14:02:44,762::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1676::WARNING::2013-03-01 14:02:44,763::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1676::DEBUG::2013-03-01 14:02:44,764::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1676::DEBUG::2013-03-01 14:02:44,812::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1676::DEBUG::2013-03-01 14:02:44,812::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1676::DEBUG::2013-03-01 14:02:44,816::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-1676::DEBUG::2013-03-01 14:02:44,818::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1676::WARNING::2013-03-01 14:02:44,819::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-1676::WARNING::2013-03-01 14:02:44,819::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-1676::DEBUG::2013-03-01 14:02:44,819::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1676::DEBUG::2013-03-01 14:02:44,820::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1676::DEBUG::2013-03-01 14:02:44,820::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=87e4f99925b20ddb366667b02aec8e3cd54beb52'] >Thread-1676::DEBUG::2013-03-01 14:02:44,899::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1676::INFO::2013-03-01 14:02:44,899::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1676::DEBUG::2013-03-01 14:02:44,900::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1676::DEBUG::2013-03-01 14:02:44,900::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1676::DEBUG::2013-03-01 14:02:44,901::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1676::DEBUG::2013-03-01 14:02:44,901::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1676::DEBUG::2013-03-01 14:02:44,901::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1676::DEBUG::2013-03-01 14:02:44,901::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1676::DEBUG::2013-03-01 14:02:44,902::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` started monitoring domain `edd0d33d-dba0-4943-9c48-6112a2ddcdfc` >Thread-1697::DEBUG::2013-03-01 14:02:44,902::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1676::DEBUG::2013-03-01 14:02:44,903::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1676::INFO::2013-03-01 14:02:44,905::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-1676::DEBUG::2013-03-01 14:02:44,906::task::1151::TaskManager.Task::(prepare) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::finished: None >Thread-1676::DEBUG::2013-03-01 14:02:44,907::task::568::TaskManager.Task::(_updateState) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::moving from state preparing -> state finished >Thread-1676::DEBUG::2013-03-01 14:02:44,909::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc': < ResourceRef 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', isValid: 'True' obj: 'None'>, 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1676::DEBUG::2013-03-01 14:02:44,911::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1676::DEBUG::2013-03-01 14:02:44,914::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' >Thread-1676::DEBUG::2013-03-01 14:02:44,917::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (0 active users) >Thread-1676::DEBUG::2013-03-01 14:02:44,918::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free, finding out if anyone is waiting for it. >Thread-1676::DEBUG::2013-03-01 14:02:44,918::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', Clearing records. >Thread-1676::DEBUG::2013-03-01 14:02:44,920::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1676::DEBUG::2013-03-01 14:02:44,921::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1676::DEBUG::2013-03-01 14:02:44,922::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1676::DEBUG::2013-03-01 14:02:44,922::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1676::DEBUG::2013-03-01 14:02:44,922::task::957::TaskManager.Task::(_decref) Task=`97a2444b-6b7f-48ef-a207-138710610c80`::ref 0 aborting False >Thread-1698::DEBUG::2013-03-01 14:02:44,964::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1698::DEBUG::2013-03-01 14:02:44,965::task::568::TaskManager.Task::(_updateState) Task=`023fc227-ebf2-495a-9c36-5824802eb867`::moving from state init -> state preparing >Thread-1698::INFO::2013-03-01 14:02:44,965::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1698::DEBUG::2013-03-01 14:02:44,966::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`aa6f1c11-aa88-4fd6-8b91-4be02f771b33`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1698::DEBUG::2013-03-01 14:02:44,966::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1698::DEBUG::2013-03-01 14:02:44,966::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1698::DEBUG::2013-03-01 14:02:44,967::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`aa6f1c11-aa88-4fd6-8b91-4be02f771b33`::Granted request >Thread-1698::DEBUG::2013-03-01 14:02:44,967::task::794::TaskManager.Task::(resourceAcquired) Task=`023fc227-ebf2-495a-9c36-5824802eb867`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1698::DEBUG::2013-03-01 14:02:44,968::task::957::TaskManager.Task::(_decref) Task=`023fc227-ebf2-495a-9c36-5824802eb867`::ref 1 aborting False >Thread-1698::INFO::2013-03-01 14:02:44,968::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1698::DEBUG::2013-03-01 14:02:44,972::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=87e4f99925b20ddb366667b02aec8e3cd54beb52'] >Thread-1698::DEBUG::2013-03-01 14:02:44,973::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:44,974::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:44,974::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:44,974::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:44,975::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:44,975::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:44,975::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1698::DEBUG::2013-03-01 14:02:44,976::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1698::DEBUG::2013-03-01 14:02:44,976::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1698::DEBUG::2013-03-01 14:02:44,976::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1698::DEBUG::2013-03-01 14:02:44,977::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1698::DEBUG::2013-03-01 14:02:44,992::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1698::DEBUG::2013-03-01 14:02:44,993::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:44,995::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:45,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:46,003::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:47,007::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:48,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:48,014::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1698::DEBUG::2013-03-01 14:02:48,017::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1700::DEBUG::2013-03-01 14:02:48,244::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1700::DEBUG::2013-03-01 14:02:48,244::task::568::TaskManager.Task::(_updateState) Task=`9d3fbe4a-b9a3-4abb-9389-0f19c6ab8016`::moving from state init -> state preparing >Thread-1700::INFO::2013-03-01 14:02:48,245::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1698::DEBUG::2013-03-01 14:02:50,021::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1612::DEBUG::2013-03-01 14:02:50,298::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1698::DEBUG::2013-03-01 14:02:51,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1698::DEBUG::2013-03-01 14:02:51,094::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,094::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,094::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,095::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,095::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,095::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,096::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1612::DEBUG::2013-03-01 14:02:51,096::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1612::DEBUG::2013-03-01 14:02:51,098::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1698::DEBUG::2013-03-01 14:02:51,098::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:51,099::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1612::DEBUG::2013-03-01 14:02:51,101::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1698::DEBUG::2013-03-01 14:02:51,109::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1612::DEBUG::2013-03-01 14:02:51,117::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1612::DEBUG::2013-03-01 14:02:51,118::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:51,120::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1698::DEBUG::2013-03-01 14:02:51,281::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1698::WARNING::2013-03-01 14:02:51,282::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1698::DEBUG::2013-03-01 14:02:51,282::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,331::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1698::DEBUG::2013-03-01 14:02:51,332::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1698::DEBUG::2013-03-01 14:02:51,336::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=87e4f99925b20ddb366667b02aec8e3cd54beb52'] >Thread-1698::DEBUG::2013-03-01 14:02:51,338::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1698::WARNING::2013-03-01 14:02:51,338::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-1698::WARNING::2013-03-01 14:02:51,338::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-1700::INFO::2013-03-01 14:02:51,341::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1698::DEBUG::2013-03-01 14:02:51,342::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1698::DEBUG::2013-03-01 14:02:51,344::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1700::DEBUG::2013-03-01 14:02:51,344::task::1151::TaskManager.Task::(prepare) Task=`9d3fbe4a-b9a3-4abb-9389-0f19c6ab8016`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1698::DEBUG::2013-03-01 14:02:51,347::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1700::DEBUG::2013-03-01 14:02:51,348::task::568::TaskManager.Task::(_updateState) Task=`9d3fbe4a-b9a3-4abb-9389-0f19c6ab8016`::moving from state preparing -> state finished >Thread-1700::DEBUG::2013-03-01 14:02:51,351::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1700::DEBUG::2013-03-01 14:02:51,353::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1698::DEBUG::2013-03-01 14:02:51,353::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1700::DEBUG::2013-03-01 14:02:51,356::task::957::TaskManager.Task::(_decref) Task=`9d3fbe4a-b9a3-4abb-9389-0f19c6ab8016`::ref 0 aborting False >Thread-1698::WARNING::2013-03-01 14:02:51,359::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1698::DEBUG::2013-03-01 14:02:51,370::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1698::DEBUG::2013-03-01 14:02:51,373::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1720::DEBUG::2013-03-01 14:02:51,399::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1720::DEBUG::2013-03-01 14:02:51,400::task::568::TaskManager.Task::(_updateState) Task=`5956cdb1-d097-4805-846b-1832148ac6c6`::moving from state init -> state preparing >Thread-1720::INFO::2013-03-01 14:02:51,400::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1720::DEBUG::2013-03-01 14:02:51,401::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`98ae7773-d535-4abc-bfc2-298c78ff2429`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1720::DEBUG::2013-03-01 14:02:51,401::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1720::DEBUG::2013-03-01 14:02:51,402::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-1720::DEBUG::2013-03-01 14:02:51,402::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`98ae7773-d535-4abc-bfc2-298c78ff2429`::Granted request >Thread-1720::DEBUG::2013-03-01 14:02:51,402::task::794::TaskManager.Task::(resourceAcquired) Task=`5956cdb1-d097-4805-846b-1832148ac6c6`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1720::DEBUG::2013-03-01 14:02:51,403::task::957::TaskManager.Task::(_decref) Task=`5956cdb1-d097-4805-846b-1832148ac6c6`::ref 1 aborting False >Thread-1698::DEBUG::2013-03-01 14:02:51,550::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1698::WARNING::2013-03-01 14:02:51,551::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found', ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1698::DEBUG::2013-03-01 14:02:51,552::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1698::INFO::2013-03-01 14:02:51,613::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1698::INFO::2013-03-01 14:02:51,614::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1698::INFO::2013-03-01 14:02:51,614::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1698::INFO::2013-03-01 14:02:51,615::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1698::INFO::2013-03-01 14:02:51,615::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1698::DEBUG::2013-03-01 14:02:51,616::task::1151::TaskManager.Task::(prepare) Task=`023fc227-ebf2-495a-9c36-5824802eb867`::finished: None >Thread-1698::DEBUG::2013-03-01 14:02:51,616::task::568::TaskManager.Task::(_updateState) Task=`023fc227-ebf2-495a-9c36-5824802eb867`::moving from state preparing -> state finished >Thread-1698::DEBUG::2013-03-01 14:02:51,616::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1698::DEBUG::2013-03-01 14:02:51,616::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1698::DEBUG::2013-03-01 14:02:51,617::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1698::DEBUG::2013-03-01 14:02:51,617::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-1698::DEBUG::2013-03-01 14:02:51,618::task::957::TaskManager.Task::(_decref) Task=`023fc227-ebf2-495a-9c36-5824802eb867`::ref 0 aborting False >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:52,125::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:53,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:54,140::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:54,143::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:54,146::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1612::DEBUG::2013-03-01 14:02:54,149::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1697::DEBUG::2013-03-01 14:02:54,926::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1612::DEBUG::2013-03-01 14:02:56,153::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1612::DEBUG::2013-03-01 14:02:57,231::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1612::DEBUG::2013-03-01 14:02:57,232::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,232::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,233::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,233::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,234::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,234::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,235::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1697::DEBUG::2013-03-01 14:02:57,235::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:02:57,237::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1612::DEBUG::2013-03-01 14:02:57,238::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:02:57,239::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:02:57,242::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1612::DEBUG::2013-03-01 14:02:57,252::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:02:57,260::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1697::DEBUG::2013-03-01 14:02:57,260::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:57,263::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1612::DEBUG::2013-03-01 14:02:57,419::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1612::WARNING::2013-03-01 14:02:57,419::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1612::DEBUG::2013-03-01 14:02:57,420::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1612::DEBUG::2013-03-01 14:02:57,455::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1612::DEBUG::2013-03-01 14:02:57,455::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1612::DEBUG::2013-03-01 14:02:57,460::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1612::DEBUG::2013-03-01 14:02:57,462::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1612::WARNING::2013-03-01 14:02:57,463::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1612::WARNING::2013-03-01 14:02:57,463::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:58,267::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:58,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:59,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:59,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:59,281::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:02:59,284::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1761::DEBUG::2013-03-01 14:03:00,516::task::568::TaskManager.Task::(_updateState) Task=`1c4bf229-2211-45e7-b9e9-c18baec72397`::moving from state init -> state preparing >Thread-1761::INFO::2013-03-01 14:03:00,516::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1761::INFO::2013-03-01 14:03:00,516::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0107898712158', 'lastCheck': '9.1', 'code': 0, 'valid': True}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'delay': '0.00345897674561', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00474500656128', 'lastCheck': '15.6', 'code': 0, 'valid': True}} >Thread-1761::DEBUG::2013-03-01 14:03:00,517::task::1151::TaskManager.Task::(prepare) Task=`1c4bf229-2211-45e7-b9e9-c18baec72397`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0107898712158', 'lastCheck': '9.1', 'code': 0, 'valid': True}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'delay': '0.00345897674561', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00474500656128', 'lastCheck': '15.6', 'code': 0, 'valid': True}} >Thread-1761::DEBUG::2013-03-01 14:03:00,517::task::568::TaskManager.Task::(_updateState) Task=`1c4bf229-2211-45e7-b9e9-c18baec72397`::moving from state preparing -> state finished >Thread-1761::DEBUG::2013-03-01 14:03:00,517::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1761::DEBUG::2013-03-01 14:03:00,517::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1761::DEBUG::2013-03-01 14:03:00,518::task::957::TaskManager.Task::(_decref) Task=`1c4bf229-2211-45e7-b9e9-c18baec72397`::ref 0 aborting False >Thread-1697::DEBUG::2013-03-01 14:03:01,287::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:02,415::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1697::DEBUG::2013-03-01 14:03:02,416::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,416::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,417::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,417::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,417::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,418::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,418::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1697::DEBUG::2013-03-01 14:03:02,418::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,420::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:02,642::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1697::WARNING::2013-03-01 14:03:02,643::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1697::DEBUG::2013-03-01 14:03:02,643::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:02,691::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1697::DEBUG::2013-03-01 14:03:02,691::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1697::DEBUG::2013-03-01 14:03:02,695::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-1697::DEBUG::2013-03-01 14:03:02,697::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1697::WARNING::2013-03-01 14:03:02,698::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-1697::WARNING::2013-03-01 14:03:02,698::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-1720::INFO::2013-03-01 14:03:02,699::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-1720::DEBUG::2013-03-01 14:03:02,701::task::1151::TaskManager.Task::(prepare) Task=`5956cdb1-d097-4805-846b-1832148ac6c6`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-1720::DEBUG::2013-03-01 14:03:02,703::task::568::TaskManager.Task::(_updateState) Task=`5956cdb1-d097-4805-846b-1832148ac6c6`::moving from state preparing -> state finished >Thread-1720::DEBUG::2013-03-01 14:03:02,705::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1720::DEBUG::2013-03-01 14:03:02,707::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1720::DEBUG::2013-03-01 14:03:02,710::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1720::DEBUG::2013-03-01 14:03:02,711::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1720::DEBUG::2013-03-01 14:03:02,712::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1720::DEBUG::2013-03-01 14:03:02,712::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1720::DEBUG::2013-03-01 14:03:02,714::task::957::TaskManager.Task::(_decref) Task=`5956cdb1-d097-4805-846b-1832148ac6c6`::ref 0 aborting False >Thread-1780::DEBUG::2013-03-01 14:03:02,761::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1780::DEBUG::2013-03-01 14:03:02,761::task::568::TaskManager.Task::(_updateState) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::moving from state init -> state preparing >Thread-1780::INFO::2013-03-01 14:03:02,761::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1780::DEBUG::2013-03-01 14:03:02,762::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`0082a4c0-94eb-4e92-9ba0-2ef45c11ebf6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1780::DEBUG::2013-03-01 14:03:02,762::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1780::DEBUG::2013-03-01 14:03:02,763::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1780::DEBUG::2013-03-01 14:03:02,763::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`0082a4c0-94eb-4e92-9ba0-2ef45c11ebf6`::Granted request >Thread-1780::DEBUG::2013-03-01 14:03:02,764::task::794::TaskManager.Task::(resourceAcquired) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1780::DEBUG::2013-03-01 14:03:02,764::task::957::TaskManager.Task::(_decref) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::ref 1 aborting False >Thread-1780::DEBUG::2013-03-01 14:03:02,764::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`6b9ba3e1-d294-433d-aec5-3ae745163b00`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1780::DEBUG::2013-03-01 14:03:02,765::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-1780::DEBUG::2013-03-01 14:03:02,765::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-1780::DEBUG::2013-03-01 14:03:02,765::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`6b9ba3e1-d294-433d-aec5-3ae745163b00`::Granted request >Thread-1780::DEBUG::2013-03-01 14:03:02,766::task::794::TaskManager.Task::(resourceAcquired) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-1780::DEBUG::2013-03-01 14:03:02,766::task::957::TaskManager.Task::(_decref) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::ref 1 aborting False >Thread-1780::INFO::2013-03-01 14:03:02,766::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-1780::DEBUG::2013-03-01 14:03:02,770::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1780::DEBUG::2013-03-01 14:03:02,770::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1780::DEBUG::2013-03-01 14:03:02,770::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=583cda42f3ca33eb6b204e230fb2f0aeda2b7235'] >Thread-1780::DEBUG::2013-03-01 14:03:02,853::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1780::DEBUG::2013-03-01 14:03:02,853::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1780::DEBUG::2013-03-01 14:03:02,853::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1612::DEBUG::2013-03-01 14:03:02,854::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1612::INFO::2013-03-01 14:03:02,854::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (id: 1) >Thread-1612::DEBUG::2013-03-01 14:03:05,855::clusterlock::206::SANLock::(releaseHostId) Host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 released successfully (id: 1) >Thread-1780::DEBUG::2013-03-01 14:03:05,855::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` stopped monitoring domain `49d8a532-e3af-4ed8-b859-bacb52bd2eb0` >Thread-1780::DEBUG::2013-03-01 14:03:05,856::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1780::INFO::2013-03-01 14:03:05,856::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-1780::DEBUG::2013-03-01 14:03:05,856::task::1151::TaskManager.Task::(prepare) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::finished: None >Thread-1780::DEBUG::2013-03-01 14:03:05,856::task::568::TaskManager.Task::(_updateState) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::moving from state preparing -> state finished >Thread-1780::DEBUG::2013-03-01 14:03:05,857::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-1780::DEBUG::2013-03-01 14:03:05,857::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1780::DEBUG::2013-03-01 14:03:05,857::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1780::DEBUG::2013-03-01 14:03:05,858::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1780::DEBUG::2013-03-01 14:03:05,858::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1780::DEBUG::2013-03-01 14:03:05,858::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1780::DEBUG::2013-03-01 14:03:05,858::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-1780::DEBUG::2013-03-01 14:03:05,859::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-1780::DEBUG::2013-03-01 14:03:05,859::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-1780::DEBUG::2013-03-01 14:03:05,859::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-1780::DEBUG::2013-03-01 14:03:05,859::task::957::TaskManager.Task::(_decref) Task=`62967d34-58e7-4a36-b364-75beeb7fa933`::ref 0 aborting False >Thread-1782::DEBUG::2013-03-01 14:03:05,898::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1782::DEBUG::2013-03-01 14:03:05,899::task::568::TaskManager.Task::(_updateState) Task=`5357b57b-9d61-4a35-a61c-f90cbd1614c2`::moving from state init -> state preparing >Thread-1782::INFO::2013-03-01 14:03:05,899::logUtils::37::dispatcher::(wrapper) Run and protect: getIsoList(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', extension='iso', options=None) >Thread-1782::DEBUG::2013-03-01 14:03:05,899::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`7f164df0-3b42-4cf7-a76d-b06c9661d3d3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1782::DEBUG::2013-03-01 14:03:05,900::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1782::DEBUG::2013-03-01 14:03:05,900::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1782::DEBUG::2013-03-01 14:03:05,900::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`7f164df0-3b42-4cf7-a76d-b06c9661d3d3`::Granted request >Thread-1782::DEBUG::2013-03-01 14:03:05,900::task::794::TaskManager.Task::(resourceAcquired) Task=`5357b57b-9d61-4a35-a61c-f90cbd1614c2`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1782::DEBUG::2013-03-01 14:03:05,901::task::957::TaskManager.Task::(_decref) Task=`5357b57b-9d61-4a35-a61c-f90cbd1614c2`::ref 1 aborting False >Thread-1783::DEBUG::2013-03-01 14:03:05,903::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1783::DEBUG::2013-03-01 14:03:05,903::task::568::TaskManager.Task::(_updateState) Task=`7b1b6fbc-15a4-447b-b8a6-4d43e790bb43`::moving from state init -> state preparing >Thread-1783::INFO::2013-03-01 14:03:05,904::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1783::DEBUG::2013-03-01 14:03:05,904::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`38e6f624-41a8-4eb8-9177-d0ebcf8a10c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1782::INFO::2013-03-01 14:03:05,905::logUtils::39::dispatcher::(wrapper) Run and protect: getIsoList, Return response: {'isolist': []} >Thread-1783::DEBUG::2013-03-01 14:03:05,905::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1782::DEBUG::2013-03-01 14:03:05,906::task::1151::TaskManager.Task::(prepare) Task=`5357b57b-9d61-4a35-a61c-f90cbd1614c2`::finished: {'isolist': []} >Thread-1783::DEBUG::2013-03-01 14:03:05,906::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-1782::DEBUG::2013-03-01 14:03:05,906::task::568::TaskManager.Task::(_updateState) Task=`5357b57b-9d61-4a35-a61c-f90cbd1614c2`::moving from state preparing -> state finished >Thread-1783::DEBUG::2013-03-01 14:03:05,907::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`38e6f624-41a8-4eb8-9177-d0ebcf8a10c2`::Granted request >Thread-1782::DEBUG::2013-03-01 14:03:05,907::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1782::DEBUG::2013-03-01 14:03:05,908::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1783::DEBUG::2013-03-01 14:03:05,908::task::794::TaskManager.Task::(resourceAcquired) Task=`7b1b6fbc-15a4-447b-b8a6-4d43e790bb43`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1782::DEBUG::2013-03-01 14:03:05,909::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1783::DEBUG::2013-03-01 14:03:05,909::task::957::TaskManager.Task::(_decref) Task=`7b1b6fbc-15a4-447b-b8a6-4d43e790bb43`::ref 1 aborting False >Thread-1782::DEBUG::2013-03-01 14:03:05,910::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-1783::INFO::2013-03-01 14:03:05,910::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1782::DEBUG::2013-03-01 14:03:05,911::task::957::TaskManager.Task::(_decref) Task=`5357b57b-9d61-4a35-a61c-f90cbd1614c2`::ref 0 aborting False >Thread-1783::DEBUG::2013-03-01 14:03:05,916::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=583cda42f3ca33eb6b204e230fb2f0aeda2b7235'] >Thread-1783::DEBUG::2013-03-01 14:03:05,917::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:05,917::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:05,917::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:05,918::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:05,918::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:05,918::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:05,919::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1783::DEBUG::2013-03-01 14:03:05,919::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1783::DEBUG::2013-03-01 14:03:05,919::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1783::DEBUG::2013-03-01 14:03:05,919::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1783::DEBUG::2013-03-01 14:03:05,920::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1783::DEBUG::2013-03-01 14:03:05,936::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1783::DEBUG::2013-03-01 14:03:05,936::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:05,939::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1784::DEBUG::2013-03-01 14:03:05,947::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1784::DEBUG::2013-03-01 14:03:05,948::task::568::TaskManager.Task::(_updateState) Task=`65c1457b-0e58-43ca-99d9-a3b582dbaf52`::moving from state init -> state preparing >Thread-1784::INFO::2013-03-01 14:03:05,948::logUtils::37::dispatcher::(wrapper) Run and protect: getFloppyList(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1784::INFO::2013-03-01 14:03:05,949::logUtils::37::dispatcher::(wrapper) Run and protect: getIsoList(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', extension='vfd', options=None) >Thread-1784::DEBUG::2013-03-01 14:03:05,949::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`9c1dd8a9-bb5d-4219-aac6-2ebc3534fb81`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1784::DEBUG::2013-03-01 14:03:05,949::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1784::DEBUG::2013-03-01 14:03:05,950::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-1784::DEBUG::2013-03-01 14:03:05,950::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`9c1dd8a9-bb5d-4219-aac6-2ebc3534fb81`::Granted request >Thread-1784::DEBUG::2013-03-01 14:03:05,951::task::794::TaskManager.Task::(resourceAcquired) Task=`65c1457b-0e58-43ca-99d9-a3b582dbaf52`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1784::DEBUG::2013-03-01 14:03:05,951::task::957::TaskManager.Task::(_decref) Task=`65c1457b-0e58-43ca-99d9-a3b582dbaf52`::ref 1 aborting False >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:06,943::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:06,946::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:06,949::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:06,952::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:06,955::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1783::DEBUG::2013-03-01 14:03:07,959::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1783::DEBUG::2013-03-01 14:03:09,962::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1783::DEBUG::2013-03-01 14:03:11,022::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1783::DEBUG::2013-03-01 14:03:11,023::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,024::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,024::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,024::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,025::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,025::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,025::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1783::DEBUG::2013-03-01 14:03:11,026::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1783::DEBUG::2013-03-01 14:03:11,246::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1783::WARNING::2013-03-01 14:03:11,247::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1783::DEBUG::2013-03-01 14:03:11,248::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,294::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1783::DEBUG::2013-03-01 14:03:11,294::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1783::DEBUG::2013-03-01 14:03:11,298::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=583cda42f3ca33eb6b204e230fb2f0aeda2b7235'] >Thread-1783::DEBUG::2013-03-01 14:03:11,300::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1783::WARNING::2013-03-01 14:03:11,301::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-1783::WARNING::2013-03-01 14:03:11,301::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-1783::DEBUG::2013-03-01 14:03:11,302::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1783::DEBUG::2013-03-01 14:03:11,304::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1784::DEBUG::2013-03-01 14:03:11,304::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,305::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1783::DEBUG::2013-03-01 14:03:11,307::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1783::WARNING::2013-03-01 14:03:11,308::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1784::DEBUG::2013-03-01 14:03:11,308::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1783::DEBUG::2013-03-01 14:03:11,318::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-1783::DEBUG::2013-03-01 14:03:11,319::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1784::DEBUG::2013-03-01 14:03:11,532::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1784::WARNING::2013-03-01 14:03:11,533::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1783::DEBUG::2013-03-01 14:03:11,546::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1783::WARNING::2013-03-01 14:03:11,556::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1783::DEBUG::2013-03-01 14:03:11,564::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1784::DEBUG::2013-03-01 14:03:11,646::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1784::DEBUG::2013-03-01 14:03:11,650::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1783::INFO::2013-03-01 14:03:11,666::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1783::INFO::2013-03-01 14:03:11,667::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1784::DEBUG::2013-03-01 14:03:11,668::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-1783::INFO::2013-03-01 14:03:11,669::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1783::INFO::2013-03-01 14:03:11,671::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1783::DEBUG::2013-03-01 14:03:11,672::task::1151::TaskManager.Task::(prepare) Task=`7b1b6fbc-15a4-447b-b8a6-4d43e790bb43`::finished: None >Thread-1783::DEBUG::2013-03-01 14:03:11,673::task::568::TaskManager.Task::(_updateState) Task=`7b1b6fbc-15a4-447b-b8a6-4d43e790bb43`::moving from state preparing -> state finished >Thread-1783::DEBUG::2013-03-01 14:03:11,675::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1783::DEBUG::2013-03-01 14:03:11,675::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1783::DEBUG::2013-03-01 14:03:11,676::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1784::DEBUG::2013-03-01 14:03:11,676::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1783::DEBUG::2013-03-01 14:03:11,678::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-1784::WARNING::2013-03-01 14:03:11,678::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-1783::DEBUG::2013-03-01 14:03:11,680::task::957::TaskManager.Task::(_decref) Task=`7b1b6fbc-15a4-447b-b8a6-4d43e790bb43`::ref 0 aborting False >Thread-1784::WARNING::2013-03-01 14:03:11,681::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-1784::INFO::2013-03-01 14:03:11,687::logUtils::39::dispatcher::(wrapper) Run and protect: getIsoList, Return response: {'isolist': []} >Thread-1784::INFO::2013-03-01 14:03:11,687::logUtils::39::dispatcher::(wrapper) Run and protect: getFloppyList, Return response: {'isolist': []} >Thread-1784::DEBUG::2013-03-01 14:03:11,687::task::1151::TaskManager.Task::(prepare) Task=`65c1457b-0e58-43ca-99d9-a3b582dbaf52`::finished: {'isolist': []} >Thread-1784::DEBUG::2013-03-01 14:03:11,688::task::568::TaskManager.Task::(_updateState) Task=`65c1457b-0e58-43ca-99d9-a3b582dbaf52`::moving from state preparing -> state finished >Thread-1784::DEBUG::2013-03-01 14:03:11,688::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1784::DEBUG::2013-03-01 14:03:11,688::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1784::DEBUG::2013-03-01 14:03:11,689::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1784::DEBUG::2013-03-01 14:03:11,689::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1784::DEBUG::2013-03-01 14:03:11,689::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1784::DEBUG::2013-03-01 14:03:11,689::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1784::DEBUG::2013-03-01 14:03:11,690::task::957::TaskManager.Task::(_decref) Task=`65c1457b-0e58-43ca-99d9-a3b582dbaf52`::ref 0 aborting False >Thread-1848::DEBUG::2013-03-01 14:03:11,718::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1848::DEBUG::2013-03-01 14:03:11,719::task::568::TaskManager.Task::(_updateState) Task=`5072f30b-43fd-45c4-a843-606de048ce47`::moving from state init -> state preparing >Thread-1848::INFO::2013-03-01 14:03:11,719::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1848::DEBUG::2013-03-01 14:03:11,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-1848::DEBUG::2013-03-01 14:03:11,769::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1848::DEBUG::2013-03-01 14:03:11,770::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1848::DEBUG::2013-03-01 14:03:11,770::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1848::DEBUG::2013-03-01 14:03:11,770::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1848::DEBUG::2013-03-01 14:03:11,771::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1848::DEBUG::2013-03-01 14:03:11,786::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1848::DEBUG::2013-03-01 14:03:11,787::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:11,790::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1850::DEBUG::2013-03-01 14:03:12,763::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1850::DEBUG::2013-03-01 14:03:12,764::task::568::TaskManager.Task::(_updateState) Task=`d0835c74-cfdf-4712-919c-e8a58d4008c3`::moving from state init -> state preparing >Thread-1850::INFO::2013-03-01 14:03:12,764::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1850::INFO::2013-03-01 14:03:12,765::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1850::DEBUG::2013-03-01 14:03:12,765::task::1151::TaskManager.Task::(prepare) Task=`d0835c74-cfdf-4712-919c-e8a58d4008c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1850::DEBUG::2013-03-01 14:03:12,765::task::568::TaskManager.Task::(_updateState) Task=`d0835c74-cfdf-4712-919c-e8a58d4008c3`::moving from state preparing -> state finished >Thread-1850::DEBUG::2013-03-01 14:03:12,766::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1850::DEBUG::2013-03-01 14:03:12,766::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1850::DEBUG::2013-03-01 14:03:12,766::task::957::TaskManager.Task::(_decref) Task=`d0835c74-cfdf-4712-919c-e8a58d4008c3`::ref 0 aborting False >Thread-1851::DEBUG::2013-03-01 14:03:12,790::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1851::DEBUG::2013-03-01 14:03:12,791::task::568::TaskManager.Task::(_updateState) Task=`a3e949c7-539c-41ab-872b-a376ad2c47fd`::moving from state init -> state preparing >Thread-1851::INFO::2013-03-01 14:03:12,791::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1851::DEBUG::2013-03-01 14:03:12,792::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`f8312b79-1ec8-4cd2-b47f-8c5bb01bf1ef`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1851::DEBUG::2013-03-01 14:03:12,792::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1851::DEBUG::2013-03-01 14:03:12,792::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1851::DEBUG::2013-03-01 14:03:12,793::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`f8312b79-1ec8-4cd2-b47f-8c5bb01bf1ef`::Granted request >Thread-1851::DEBUG::2013-03-01 14:03:12,793::task::794::TaskManager.Task::(resourceAcquired) Task=`a3e949c7-539c-41ab-872b-a376ad2c47fd`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1851::DEBUG::2013-03-01 14:03:12,794::task::957::TaskManager.Task::(_decref) Task=`a3e949c7-539c-41ab-872b-a376ad2c47fd`::ref 1 aborting False >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:12,794::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-1851::INFO::2013-03-01 14:03:12,798::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-1851::DEBUG::2013-03-01 14:03:12,799::task::1151::TaskManager.Task::(prepare) Task=`a3e949c7-539c-41ab-872b-a376ad2c47fd`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942806138880', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-1851::DEBUG::2013-03-01 14:03:12,799::task::568::TaskManager.Task::(_updateState) Task=`a3e949c7-539c-41ab-872b-a376ad2c47fd`::moving from state preparing -> state finished >Thread-1851::DEBUG::2013-03-01 14:03:12,799::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1851::DEBUG::2013-03-01 14:03:12,800::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1851::DEBUG::2013-03-01 14:03:12,800::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1851::DEBUG::2013-03-01 14:03:12,800::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1851::DEBUG::2013-03-01 14:03:12,800::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1851::DEBUG::2013-03-01 14:03:12,800::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1851::DEBUG::2013-03-01 14:03:12,801::task::957::TaskManager.Task::(_decref) Task=`a3e949c7-539c-41ab-872b-a376ad2c47fd`::ref 0 aborting False >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:13,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:14,803::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-1852::DEBUG::2013-03-01 14:03:15,740::task::568::TaskManager.Task::(_updateState) Task=`166bc5a0-1f3f-41b6-b920-57f7e4a3c8df`::moving from state init -> state preparing >Thread-1852::INFO::2013-03-01 14:03:15,740::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1852::INFO::2013-03-01 14:03:15,740::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00518202781677', 'lastCheck': '4.3', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00311017036438', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-1852::DEBUG::2013-03-01 14:03:15,741::task::1151::TaskManager.Task::(prepare) Task=`166bc5a0-1f3f-41b6-b920-57f7e4a3c8df`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00518202781677', 'lastCheck': '4.3', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00311017036438', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-1852::DEBUG::2013-03-01 14:03:15,741::task::568::TaskManager.Task::(_updateState) Task=`166bc5a0-1f3f-41b6-b920-57f7e4a3c8df`::moving from state preparing -> state finished >Thread-1852::DEBUG::2013-03-01 14:03:15,741::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1852::DEBUG::2013-03-01 14:03:15,741::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1852::DEBUG::2013-03-01 14:03:15,742::task::957::TaskManager.Task::(_decref) Task=`166bc5a0-1f3f-41b6-b920-57f7e4a3c8df`::ref 0 aborting False >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:15,807::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:16,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1848::DEBUG::2013-03-01 14:03:16,815::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1848::DEBUG::2013-03-01 14:03:18,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1848::DEBUG::2013-03-01 14:03:19,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1848::DEBUG::2013-03-01 14:03:19,895::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1848::DEBUG::2013-03-01 14:03:19,895::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1848::DEBUG::2013-03-01 14:03:19,895::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1848::DEBUG::2013-03-01 14:03:19,896::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1848::DEBUG::2013-03-01 14:03:19,896::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1848::DEBUG::2013-03-01 14:03:19,896::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1848::DEBUG::2013-03-01 14:03:19,897::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1848::INFO::2013-03-01 14:03:19,897::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1848::DEBUG::2013-03-01 14:03:19,897::task::1151::TaskManager.Task::(prepare) Task=`5072f30b-43fd-45c4-a843-606de048ce47`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1848::DEBUG::2013-03-01 14:03:19,898::task::568::TaskManager.Task::(_updateState) Task=`5072f30b-43fd-45c4-a843-606de048ce47`::moving from state preparing -> state finished >Thread-1848::DEBUG::2013-03-01 14:03:19,898::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1848::DEBUG::2013-03-01 14:03:19,898::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1848::DEBUG::2013-03-01 14:03:19,899::task::957::TaskManager.Task::(_decref) Task=`5072f30b-43fd-45c4-a843-606de048ce47`::ref 0 aborting False >Thread-1855::DEBUG::2013-03-01 14:03:21,567::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1855::DEBUG::2013-03-01 14:03:21,568::task::568::TaskManager.Task::(_updateState) Task=`23757836-c362-42c7-a0a6-3f620fd256c9`::moving from state init -> state preparing >Thread-1855::INFO::2013-03-01 14:03:21,568::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1855::INFO::2013-03-01 14:03:21,569::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1855::DEBUG::2013-03-01 14:03:21,569::task::1151::TaskManager.Task::(prepare) Task=`23757836-c362-42c7-a0a6-3f620fd256c9`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1855::DEBUG::2013-03-01 14:03:21,569::task::568::TaskManager.Task::(_updateState) Task=`23757836-c362-42c7-a0a6-3f620fd256c9`::moving from state preparing -> state finished >Thread-1855::DEBUG::2013-03-01 14:03:21,570::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1855::DEBUG::2013-03-01 14:03:21,570::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1855::DEBUG::2013-03-01 14:03:21,570::task::957::TaskManager.Task::(_decref) Task=`23757836-c362-42c7-a0a6-3f620fd256c9`::ref 0 aborting False >Thread-1856::DEBUG::2013-03-01 14:03:21,605::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1856::DEBUG::2013-03-01 14:03:21,606::task::568::TaskManager.Task::(_updateState) Task=`9f780ac7-c742-4079-bedd-3021d906fcb8`::moving from state init -> state preparing >Thread-1856::INFO::2013-03-01 14:03:21,606::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-1856::DEBUG::2013-03-01 14:03:21,610::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-1856::INFO::2013-03-01 14:03:21,667::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1856::DEBUG::2013-03-01 14:03:21,667::task::1151::TaskManager.Task::(prepare) Task=`9f780ac7-c742-4079-bedd-3021d906fcb8`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-1856::DEBUG::2013-03-01 14:03:21,668::task::568::TaskManager.Task::(_updateState) Task=`9f780ac7-c742-4079-bedd-3021d906fcb8`::moving from state preparing -> state finished >Thread-1856::DEBUG::2013-03-01 14:03:21,668::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1856::DEBUG::2013-03-01 14:03:21,668::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1856::DEBUG::2013-03-01 14:03:21,669::task::957::TaskManager.Task::(_decref) Task=`9f780ac7-c742-4079-bedd-3021d906fcb8`::ref 0 aborting False >Thread-1857::DEBUG::2013-03-01 14:03:21,697::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1857::DEBUG::2013-03-01 14:03:21,698::task::568::TaskManager.Task::(_updateState) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::moving from state init -> state preparing >Thread-1857::INFO::2013-03-01 14:03:21,698::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1857::DEBUG::2013-03-01 14:03:21,699::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`2e3e923d-41f4-4fad-8a32-2e7bbe56fa5a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1857::DEBUG::2013-03-01 14:03:21,699::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1857::DEBUG::2013-03-01 14:03:21,700::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1857::DEBUG::2013-03-01 14:03:21,700::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`2e3e923d-41f4-4fad-8a32-2e7bbe56fa5a`::Granted request >Thread-1857::DEBUG::2013-03-01 14:03:21,701::task::794::TaskManager.Task::(resourceAcquired) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1857::DEBUG::2013-03-01 14:03:21,701::task::957::TaskManager.Task::(_decref) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::ref 1 aborting False >Thread-1857::DEBUG::2013-03-01 14:03:21,702::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`62894dd2-40d8-45f2-87e2-feadfdcb67c0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1857::DEBUG::2013-03-01 14:03:21,702::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-1857::DEBUG::2013-03-01 14:03:21,702::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-1857::DEBUG::2013-03-01 14:03:21,702::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`62894dd2-40d8-45f2-87e2-feadfdcb67c0`::Granted request >Thread-1857::DEBUG::2013-03-01 14:03:21,703::task::794::TaskManager.Task::(resourceAcquired) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-1857::DEBUG::2013-03-01 14:03:21,703::task::957::TaskManager.Task::(_decref) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::ref 1 aborting False >Thread-1857::INFO::2013-03-01 14:03:21,704::sp::1045::Storage.StoragePool::(activateSD) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1857::DEBUG::2013-03-01 14:03:21,704::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1857::DEBUG::2013-03-01 14:03:21,704::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1857::DEBUG::2013-03-01 14:03:21,705::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1857::DEBUG::2013-03-01 14:03:21,705::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1857::DEBUG::2013-03-01 14:03:21,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1857::DEBUG::2013-03-01 14:03:21,721::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1857::DEBUG::2013-03-01 14:03:21,721::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:21,724::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:22,728::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:23,733::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:24,738::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:25,742::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:26,746::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1857::DEBUG::2013-03-01 14:03:27,751::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1857::DEBUG::2013-03-01 14:03:29,754::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1857::DEBUG::2013-03-01 14:03:30,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1857::DEBUG::2013-03-01 14:03:30,820::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,820::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,821::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,821::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,821::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,821::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,822::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1857::DEBUG::2013-03-01 14:03:30,822::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:30,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1861::DEBUG::2013-03-01 14:03:30,960::task::568::TaskManager.Task::(_updateState) Task=`c0de521c-ee6e-4bdf-b1f1-068f3805d2ee`::moving from state init -> state preparing >Thread-1861::INFO::2013-03-01 14:03:30,960::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1861::INFO::2013-03-01 14:03:30,961::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00411295890808', 'lastCheck': '9.5', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00299096107483', 'lastCheck': '8.2', 'code': 0, 'valid': True}} >Thread-1861::DEBUG::2013-03-01 14:03:30,962::task::1151::TaskManager.Task::(prepare) Task=`c0de521c-ee6e-4bdf-b1f1-068f3805d2ee`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00411295890808', 'lastCheck': '9.5', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00299096107483', 'lastCheck': '8.2', 'code': 0, 'valid': True}} >Thread-1861::DEBUG::2013-03-01 14:03:30,962::task::568::TaskManager.Task::(_updateState) Task=`c0de521c-ee6e-4bdf-b1f1-068f3805d2ee`::moving from state preparing -> state finished >Thread-1861::DEBUG::2013-03-01 14:03:30,963::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1861::DEBUG::2013-03-01 14:03:30,963::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1861::DEBUG::2013-03-01 14:03:30,964::task::957::TaskManager.Task::(_decref) Task=`c0de521c-ee6e-4bdf-b1f1-068f3805d2ee`::ref 0 aborting False >Thread-1857::DEBUG::2013-03-01 14:03:31,056::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1857::WARNING::2013-03-01 14:03:31,057::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1857::DEBUG::2013-03-01 14:03:31,057::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:31,094::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1857::DEBUG::2013-03-01 14:03:31,095::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1857::DEBUG::2013-03-01 14:03:31,099::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1857::DEBUG::2013-03-01 14:03:31,102::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1857::WARNING::2013-03-01 14:03:31,102::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1857::WARNING::2013-03-01 14:03:31,103::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-1857::DEBUG::2013-03-01 14:03:31,103::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:31,104::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1857::DEBUG::2013-03-01 14:03:31,327::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1857::WARNING::2013-03-01 14:03:31,328::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1857::DEBUG::2013-03-01 14:03:31,328::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1857::DEBUG::2013-03-01 14:03:31,359::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1857::DEBUG::2013-03-01 14:03:31,359::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1857::DEBUG::2013-03-01 14:03:31,363::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1857::DEBUG::2013-03-01 14:03:31,365::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1857::WARNING::2013-03-01 14:03:31,365::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1857::WARNING::2013-03-01 14:03:31,365::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-1857::DEBUG::2013-03-01 14:03:31,366::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1857::DEBUG::2013-03-01 14:03:31,366::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1857::DEBUG::2013-03-01 14:03:31,367::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=87e4f99925b20ddb366667b02aec8e3cd54beb52'] >Thread-1857::DEBUG::2013-03-01 14:03:31,418::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1857::INFO::2013-03-01 14:03:31,418::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1857::DEBUG::2013-03-01 14:03:31,419::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1857::DEBUG::2013-03-01 14:03:31,419::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1857::DEBUG::2013-03-01 14:03:31,420::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1857::DEBUG::2013-03-01 14:03:31,420::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1857::DEBUG::2013-03-01 14:03:31,420::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1857::DEBUG::2013-03-01 14:03:31,420::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1857::DEBUG::2013-03-01 14:03:31,421::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` started monitoring domain `49d8a532-e3af-4ed8-b859-bacb52bd2eb0` >Thread-1886::DEBUG::2013-03-01 14:03:31,421::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1857::DEBUG::2013-03-01 14:03:31,422::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1857::INFO::2013-03-01 14:03:31,423::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-1857::DEBUG::2013-03-01 14:03:31,424::task::1151::TaskManager.Task::(prepare) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::finished: None >Thread-1857::DEBUG::2013-03-01 14:03:31,426::task::568::TaskManager.Task::(_updateState) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::moving from state preparing -> state finished >Thread-1857::DEBUG::2013-03-01 14:03:31,430::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-1857::DEBUG::2013-03-01 14:03:31,434::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1857::DEBUG::2013-03-01 14:03:31,439::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1857::DEBUG::2013-03-01 14:03:31,442::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1857::DEBUG::2013-03-01 14:03:31,445::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1857::DEBUG::2013-03-01 14:03:31,448::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1857::DEBUG::2013-03-01 14:03:31,455::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-1857::DEBUG::2013-03-01 14:03:31,457::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-1857::DEBUG::2013-03-01 14:03:31,459::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-1857::DEBUG::2013-03-01 14:03:31,462::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-1857::DEBUG::2013-03-01 14:03:31,465::task::957::TaskManager.Task::(_decref) Task=`f319ad7c-d5ab-4c2f-86f7-dd7e3a8a0288`::ref 0 aborting False >Thread-1886::INFO::2013-03-01 14:03:31,475::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (id: 1) >Thread-1886::DEBUG::2013-03-01 14:03:31,475::clusterlock::191::SANLock::(acquireHostId) Host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 successfully acquired (id: 1) >Thread-1887::DEBUG::2013-03-01 14:03:31,503::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1887::DEBUG::2013-03-01 14:03:31,504::task::568::TaskManager.Task::(_updateState) Task=`11fa7edf-6096-427a-8cda-c1f4c5dbb00e`::moving from state init -> state preparing >Thread-1887::INFO::2013-03-01 14:03:31,504::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1887::INFO::2013-03-01 14:03:31,505::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1887::DEBUG::2013-03-01 14:03:31,505::task::1151::TaskManager.Task::(prepare) Task=`11fa7edf-6096-427a-8cda-c1f4c5dbb00e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1887::DEBUG::2013-03-01 14:03:31,505::task::568::TaskManager.Task::(_updateState) Task=`11fa7edf-6096-427a-8cda-c1f4c5dbb00e`::moving from state preparing -> state finished >Thread-1887::DEBUG::2013-03-01 14:03:31,506::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1887::DEBUG::2013-03-01 14:03:31,506::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1887::DEBUG::2013-03-01 14:03:31,507::task::957::TaskManager.Task::(_decref) Task=`11fa7edf-6096-427a-8cda-c1f4c5dbb00e`::ref 0 aborting False >Thread-1888::DEBUG::2013-03-01 14:03:31,520::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1888::DEBUG::2013-03-01 14:03:31,520::task::568::TaskManager.Task::(_updateState) Task=`22435b0e-47aa-4973-8b07-3b6731e57b89`::moving from state init -> state preparing >Thread-1888::INFO::2013-03-01 14:03:31,521::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1888::DEBUG::2013-03-01 14:03:31,522::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`413b6b1e-ff5c-4d19-bfe0-fc7f373a05ae`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1888::DEBUG::2013-03-01 14:03:31,522::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1888::DEBUG::2013-03-01 14:03:31,522::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1888::DEBUG::2013-03-01 14:03:31,523::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`413b6b1e-ff5c-4d19-bfe0-fc7f373a05ae`::Granted request >Thread-1888::DEBUG::2013-03-01 14:03:31,523::task::794::TaskManager.Task::(resourceAcquired) Task=`22435b0e-47aa-4973-8b07-3b6731e57b89`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1888::DEBUG::2013-03-01 14:03:31,524::task::957::TaskManager.Task::(_decref) Task=`22435b0e-47aa-4973-8b07-3b6731e57b89`::ref 1 aborting False >Thread-1888::INFO::2013-03-01 14:03:31,524::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1888::DEBUG::2013-03-01 14:03:31,528::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=87e4f99925b20ddb366667b02aec8e3cd54beb52'] >Thread-1888::DEBUG::2013-03-01 14:03:31,529::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:31,529::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:31,529::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:31,530::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:31,530::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:31,530::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:31,533::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1889::DEBUG::2013-03-01 14:03:31,533::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1888::DEBUG::2013-03-01 14:03:31,534::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1888::DEBUG::2013-03-01 14:03:31,536::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1889::DEBUG::2013-03-01 14:03:31,536::task::568::TaskManager.Task::(_updateState) Task=`08314c87-11e8-4c6e-865f-5d371d1d3f30`::moving from state init -> state preparing >Thread-1888::DEBUG::2013-03-01 14:03:31,537::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1889::INFO::2013-03-01 14:03:31,538::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-1888::DEBUG::2013-03-01 14:03:31,540::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1889::DEBUG::2013-03-01 14:03:31,547::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`2083cd8f-1f8d-4a16-9f1a-243f76866366`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1889::DEBUG::2013-03-01 14:03:31,549::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1889::DEBUG::2013-03-01 14:03:31,550::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-1889::DEBUG::2013-03-01 14:03:31,550::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`2083cd8f-1f8d-4a16-9f1a-243f76866366`::Granted request >Thread-1889::DEBUG::2013-03-01 14:03:31,551::task::794::TaskManager.Task::(resourceAcquired) Task=`08314c87-11e8-4c6e-865f-5d371d1d3f30`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1889::DEBUG::2013-03-01 14:03:31,551::task::957::TaskManager.Task::(_decref) Task=`08314c87-11e8-4c6e-865f-5d371d1d3f30`::ref 1 aborting False >Thread-1888::DEBUG::2013-03-01 14:03:31,556::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1888::DEBUG::2013-03-01 14:03:31,556::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:31,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:32,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:32,566::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:32,569::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:32,736::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:33,573::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:34,577::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1888::DEBUG::2013-03-01 14:03:34,580::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1888::DEBUG::2013-03-01 14:03:36,584::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1888::DEBUG::2013-03-01 14:03:37,657::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1888::DEBUG::2013-03-01 14:03:37,658::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,658::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,658::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,660::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,661::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,663::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,664::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1697::DEBUG::2013-03-01 14:03:37,664::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:03:37,667::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1888::DEBUG::2013-03-01 14:03:37,668::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:37,669::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:03:37,671::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1888::DEBUG::2013-03-01 14:03:37,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:37,688::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1697::DEBUG::2013-03-01 14:03:37,688::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:37,690::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1888::DEBUG::2013-03-01 14:03:37,855::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1888::WARNING::2013-03-01 14:03:37,856::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1888::DEBUG::2013-03-01 14:03:37,856::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1888::DEBUG::2013-03-01 14:03:37,902::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1888::DEBUG::2013-03-01 14:03:37,903::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1888::DEBUG::2013-03-01 14:03:37,906::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=87e4f99925b20ddb366667b02aec8e3cd54beb52'] >Thread-1888::DEBUG::2013-03-01 14:03:37,908::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1888::WARNING::2013-03-01 14:03:37,909::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-1888::WARNING::2013-03-01 14:03:37,909::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-1888::DEBUG::2013-03-01 14:03:37,911::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1888::DEBUG::2013-03-01 14:03:37,912::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1888::DEBUG::2013-03-01 14:03:37,914::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1888::DEBUG::2013-03-01 14:03:37,917::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1888::WARNING::2013-03-01 14:03:37,919::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1888::DEBUG::2013-03-01 14:03:37,923::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:37,927::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1888::DEBUG::2013-03-01 14:03:37,928::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1888::DEBUG::2013-03-01 14:03:38,147::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1888::WARNING::2013-03-01 14:03:38,148::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found', ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1888::DEBUG::2013-03-01 14:03:38,148::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1888::INFO::2013-03-01 14:03:38,205::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1888::INFO::2013-03-01 14:03:38,205::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1888::INFO::2013-03-01 14:03:38,206::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1888::INFO::2013-03-01 14:03:38,206::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1888::INFO::2013-03-01 14:03:38,207::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1888::DEBUG::2013-03-01 14:03:38,207::task::1151::TaskManager.Task::(prepare) Task=`22435b0e-47aa-4973-8b07-3b6731e57b89`::finished: None >Thread-1888::DEBUG::2013-03-01 14:03:38,207::task::568::TaskManager.Task::(_updateState) Task=`22435b0e-47aa-4973-8b07-3b6731e57b89`::moving from state preparing -> state finished >Thread-1888::DEBUG::2013-03-01 14:03:38,208::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1888::DEBUG::2013-03-01 14:03:38,208::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1888::DEBUG::2013-03-01 14:03:38,208::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1888::DEBUG::2013-03-01 14:03:38,209::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-1888::DEBUG::2013-03-01 14:03:38,209::task::957::TaskManager.Task::(_decref) Task=`22435b0e-47aa-4973-8b07-3b6731e57b89`::ref 0 aborting False >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:38,694::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:39,699::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:39,702::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:39,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:39,708::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:40,712::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1697::DEBUG::2013-03-01 14:03:42,716::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:43,793::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1697::DEBUG::2013-03-01 14:03:43,794::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:43,794::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:43,795::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:43,795::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:43,795::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:43,796::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:43,796::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1889::DEBUG::2013-03-01 14:03:43,797::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:03:43,798::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:43,798::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1889::DEBUG::2013-03-01 14:03:43,800::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1889::DEBUG::2013-03-01 14:03:43,802::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:43,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1889::DEBUG::2013-03-01 14:03:43,819::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1889::DEBUG::2013-03-01 14:03:43,820::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:43,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:44,014::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1697::WARNING::2013-03-01 14:03:44,015::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1697::DEBUG::2013-03-01 14:03:44,015::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:44,058::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1697::DEBUG::2013-03-01 14:03:44,059::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1697::DEBUG::2013-03-01 14:03:44,063::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-1697::DEBUG::2013-03-01 14:03:44,064::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1697::WARNING::2013-03-01 14:03:44,065::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-1697::WARNING::2013-03-01 14:03:44,065::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:44,827::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:44,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:44,834::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:44,837::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:45,841::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-1955::DEBUG::2013-03-01 14:03:46,187::task::568::TaskManager.Task::(_updateState) Task=`2a89690d-fda7-49e6-bed6-f79bdc52b738`::moving from state init -> state preparing >Thread-1955::INFO::2013-03-01 14:03:46,188::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1955::INFO::2013-03-01 14:03:46,188::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00296783447266', 'lastCheck': '4.7', 'code': 0, 'valid': True}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'delay': '0.0109980106354', 'lastCheck': '14.7', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00256681442261', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-1955::DEBUG::2013-03-01 14:03:46,188::task::1151::TaskManager.Task::(prepare) Task=`2a89690d-fda7-49e6-bed6-f79bdc52b738`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00296783447266', 'lastCheck': '4.7', 'code': 0, 'valid': True}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'delay': '0.0109980106354', 'lastCheck': '14.7', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00256681442261', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-1955::DEBUG::2013-03-01 14:03:46,188::task::568::TaskManager.Task::(_updateState) Task=`2a89690d-fda7-49e6-bed6-f79bdc52b738`::moving from state preparing -> state finished >Thread-1955::DEBUG::2013-03-01 14:03:46,189::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1955::DEBUG::2013-03-01 14:03:46,189::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1955::DEBUG::2013-03-01 14:03:46,189::task::957::TaskManager.Task::(_decref) Task=`2a89690d-fda7-49e6-bed6-f79bdc52b738`::ref 0 aborting False >MainProcess|Thread-1889::DEBUG::2013-03-01 14:03:46,845::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1889::DEBUG::2013-03-01 14:03:48,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1889::DEBUG::2013-03-01 14:03:49,925::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1889::DEBUG::2013-03-01 14:03:49,926::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,926::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,926::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,927::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,927::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,927::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,928::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1889::DEBUG::2013-03-01 14:03:49,928::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:49,929::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-1889::DEBUG::2013-03-01 14:03:50,122::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-1889::WARNING::2013-03-01 14:03:50,123::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-1889::DEBUG::2013-03-01 14:03:50,124::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1889::DEBUG::2013-03-01 14:03:50,158::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1889::DEBUG::2013-03-01 14:03:50,159::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1889::DEBUG::2013-03-01 14:03:50,215::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-1889::DEBUG::2013-03-01 14:03:50,217::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1889::WARNING::2013-03-01 14:03:50,217::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-1889::WARNING::2013-03-01 14:03:50,217::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-1889::INFO::2013-03-01 14:03:50,219::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-1889::DEBUG::2013-03-01 14:03:50,222::task::1151::TaskManager.Task::(prepare) Task=`08314c87-11e8-4c6e-865f-5d371d1d3f30`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-1889::DEBUG::2013-03-01 14:03:50,224::task::568::TaskManager.Task::(_updateState) Task=`08314c87-11e8-4c6e-865f-5d371d1d3f30`::moving from state preparing -> state finished >Thread-1889::DEBUG::2013-03-01 14:03:50,226::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1889::DEBUG::2013-03-01 14:03:50,228::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1889::DEBUG::2013-03-01 14:03:50,231::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1889::DEBUG::2013-03-01 14:03:50,233::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1889::DEBUG::2013-03-01 14:03:50,234::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1889::DEBUG::2013-03-01 14:03:50,234::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1889::DEBUG::2013-03-01 14:03:50,235::task::957::TaskManager.Task::(_decref) Task=`08314c87-11e8-4c6e-865f-5d371d1d3f30`::ref 0 aborting False >Thread-1969::DEBUG::2013-03-01 14:03:50,282::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1969::DEBUG::2013-03-01 14:03:50,283::task::568::TaskManager.Task::(_updateState) Task=`dd292434-61ae-462a-8f21-41270c071344`::moving from state init -> state preparing >Thread-1969::INFO::2013-03-01 14:03:50,283::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1969::DEBUG::2013-03-01 14:03:50,284::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`6e751c05-5fe8-4f54-8cce-5f75689f6a98`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1969::DEBUG::2013-03-01 14:03:50,284::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-1969::DEBUG::2013-03-01 14:03:50,285::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-1969::DEBUG::2013-03-01 14:03:50,285::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`6e751c05-5fe8-4f54-8cce-5f75689f6a98`::Granted request >Thread-1969::DEBUG::2013-03-01 14:03:50,285::task::794::TaskManager.Task::(resourceAcquired) Task=`dd292434-61ae-462a-8f21-41270c071344`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-1969::DEBUG::2013-03-01 14:03:50,286::task::957::TaskManager.Task::(_decref) Task=`dd292434-61ae-462a-8f21-41270c071344`::ref 1 aborting False >Thread-1969::DEBUG::2013-03-01 14:03:50,286::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`fa74ea22-02cd-428e-98ca-1a19f7f993ca`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1969::DEBUG::2013-03-01 14:03:50,286::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-1969::DEBUG::2013-03-01 14:03:50,287::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-1969::DEBUG::2013-03-01 14:03:50,287::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`fa74ea22-02cd-428e-98ca-1a19f7f993ca`::Granted request >Thread-1969::DEBUG::2013-03-01 14:03:50,288::task::794::TaskManager.Task::(resourceAcquired) Task=`dd292434-61ae-462a-8f21-41270c071344`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-1969::DEBUG::2013-03-01 14:03:50,288::task::957::TaskManager.Task::(_decref) Task=`dd292434-61ae-462a-8f21-41270c071344`::ref 1 aborting False >Thread-1969::INFO::2013-03-01 14:03:50,288::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-1969::DEBUG::2013-03-01 14:03:50,291::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1969::DEBUG::2013-03-01 14:03:50,292::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1969::DEBUG::2013-03-01 14:03:50,292::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=583cda42f3ca33eb6b204e230fb2f0aeda2b7235'] >Thread-1969::DEBUG::2013-03-01 14:03:50,326::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1969::DEBUG::2013-03-01 14:03:50,327::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1969::DEBUG::2013-03-01 14:03:50,327::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1886::DEBUG::2013-03-01 14:03:50,327::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-1886::INFO::2013-03-01 14:03:50,328::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (id: 1) >Thread-1886::DEBUG::2013-03-01 14:03:52,328::clusterlock::206::SANLock::(releaseHostId) Host id for domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 released successfully (id: 1) >Thread-1969::DEBUG::2013-03-01 14:03:52,329::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` stopped monitoring domain `49d8a532-e3af-4ed8-b859-bacb52bd2eb0` >Thread-1969::DEBUG::2013-03-01 14:03:52,329::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1969::INFO::2013-03-01 14:03:52,329::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-1969::DEBUG::2013-03-01 14:03:52,330::task::1151::TaskManager.Task::(prepare) Task=`dd292434-61ae-462a-8f21-41270c071344`::finished: None >Thread-1969::DEBUG::2013-03-01 14:03:52,330::task::568::TaskManager.Task::(_updateState) Task=`dd292434-61ae-462a-8f21-41270c071344`::moving from state preparing -> state finished >Thread-1969::DEBUG::2013-03-01 14:03:52,330::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-1969::DEBUG::2013-03-01 14:03:52,330::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1969::DEBUG::2013-03-01 14:03:52,331::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1969::DEBUG::2013-03-01 14:03:52,331::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1969::DEBUG::2013-03-01 14:03:52,331::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1969::DEBUG::2013-03-01 14:03:52,331::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1969::DEBUG::2013-03-01 14:03:52,332::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-1969::DEBUG::2013-03-01 14:03:52,332::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-1969::DEBUG::2013-03-01 14:03:52,332::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-1969::DEBUG::2013-03-01 14:03:52,332::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-1969::DEBUG::2013-03-01 14:03:52,333::task::957::TaskManager.Task::(_decref) Task=`dd292434-61ae-462a-8f21-41270c071344`::ref 0 aborting False >Thread-1971::DEBUG::2013-03-01 14:03:52,372::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-1971::DEBUG::2013-03-01 14:03:52,373::task::568::TaskManager.Task::(_updateState) Task=`2ec4987a-b6c2-4eaf-be94-a43dc49487f9`::moving from state init -> state preparing >Thread-1971::INFO::2013-03-01 14:03:52,373::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-1971::DEBUG::2013-03-01 14:03:52,374::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`b4a168ce-d51b-4976-b3cb-d6d0be57eec8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-1971::DEBUG::2013-03-01 14:03:52,374::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-1971::DEBUG::2013-03-01 14:03:52,374::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-1971::DEBUG::2013-03-01 14:03:52,374::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`b4a168ce-d51b-4976-b3cb-d6d0be57eec8`::Granted request >Thread-1971::DEBUG::2013-03-01 14:03:52,375::task::794::TaskManager.Task::(resourceAcquired) Task=`2ec4987a-b6c2-4eaf-be94-a43dc49487f9`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-1971::DEBUG::2013-03-01 14:03:52,375::task::957::TaskManager.Task::(_decref) Task=`2ec4987a-b6c2-4eaf-be94-a43dc49487f9`::ref 1 aborting False >Thread-1971::INFO::2013-03-01 14:03:52,375::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1971::DEBUG::2013-03-01 14:03:52,379::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=583cda42f3ca33eb6b204e230fb2f0aeda2b7235'] >Thread-1971::DEBUG::2013-03-01 14:03:52,380::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:52,380::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:52,381::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:52,381::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:52,381::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:52,382::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:52,382::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1971::DEBUG::2013-03-01 14:03:52,382::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1971::DEBUG::2013-03-01 14:03:52,382::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1971::DEBUG::2013-03-01 14:03:52,383::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1971::DEBUG::2013-03-01 14:03:52,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1971::DEBUG::2013-03-01 14:03:52,398::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1971::DEBUG::2013-03-01 14:03:52,399::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:52,401::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:53,406::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:54,073::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:54,410::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:55,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:55,417::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:55,420::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1971::DEBUG::2013-03-01 14:03:56,424::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1971::DEBUG::2013-03-01 14:03:58,428::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1971::DEBUG::2013-03-01 14:03:59,511::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1971::DEBUG::2013-03-01 14:03:59,511::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,512::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,512::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,513::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,513::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,513::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,514::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1697::DEBUG::2013-03-01 14:03:59,514::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:03:59,515::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1971::DEBUG::2013-03-01 14:03:59,516::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:03:59,517::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:03:59,519::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1971::DEBUG::2013-03-01 14:03:59,528::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:03:59,536::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-1697::DEBUG::2013-03-01 14:03:59,537::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-1697::DEBUG::2013-03-01 14:03:59,538::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1971::DEBUG::2013-03-01 14:03:59,694::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-1971::WARNING::2013-03-01 14:03:59,695::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-1971::DEBUG::2013-03-01 14:03:59,695::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,746::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1971::DEBUG::2013-03-01 14:03:59,746::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1971::DEBUG::2013-03-01 14:03:59,750::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=583cda42f3ca33eb6b204e230fb2f0aeda2b7235'] >Thread-1971::DEBUG::2013-03-01 14:03:59,752::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1971::WARNING::2013-03-01 14:03:59,752::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-1971::WARNING::2013-03-01 14:03:59,753::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-1971::DEBUG::2013-03-01 14:03:59,753::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-1971::DEBUG::2013-03-01 14:03:59,754::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1971::DEBUG::2013-03-01 14:03:59,754::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1971::DEBUG::2013-03-01 14:03:59,754::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-1971::WARNING::2013-03-01 14:03:59,755::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-1971::DEBUG::2013-03-01 14:03:59,755::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1971::DEBUG::2013-03-01 14:03:59,756::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-1971::DEBUG::2013-03-01 14:03:59,978::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1971::WARNING::2013-03-01 14:03:59,979::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1971::DEBUG::2013-03-01 14:03:59,980::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1971::INFO::2013-03-01 14:04:00,043::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1971::INFO::2013-03-01 14:04:00,043::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1971::INFO::2013-03-01 14:04:00,044::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-1971::INFO::2013-03-01 14:04:00,044::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1971::DEBUG::2013-03-01 14:04:00,045::task::1151::TaskManager.Task::(prepare) Task=`2ec4987a-b6c2-4eaf-be94-a43dc49487f9`::finished: None >Thread-1971::DEBUG::2013-03-01 14:04:00,045::task::568::TaskManager.Task::(_updateState) Task=`2ec4987a-b6c2-4eaf-be94-a43dc49487f9`::moving from state preparing -> state finished >Thread-1971::DEBUG::2013-03-01 14:04:00,045::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-1971::DEBUG::2013-03-01 14:04:00,046::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1971::DEBUG::2013-03-01 14:04:00,046::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-1971::DEBUG::2013-03-01 14:04:00,046::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-1971::DEBUG::2013-03-01 14:04:00,047::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-1971::DEBUG::2013-03-01 14:04:00,047::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-1971::DEBUG::2013-03-01 14:04:00,047::task::957::TaskManager.Task::(_decref) Task=`2ec4987a-b6c2-4eaf-be94-a43dc49487f9`::ref 0 aborting False >Thread-2018::DEBUG::2013-03-01 14:04:00,081::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2018::DEBUG::2013-03-01 14:04:00,081::task::568::TaskManager.Task::(_updateState) Task=`3da4cd20-cf0f-410c-9f00-49cec5e14dbd`::moving from state init -> state preparing >Thread-2018::INFO::2013-03-01 14:04:00,081::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2018::DEBUG::2013-03-01 14:04:00,082::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-2018::DEBUG::2013-03-01 14:04:00,113::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2019::DEBUG::2013-03-01 14:04:00,287::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2019::DEBUG::2013-03-01 14:04:00,288::task::568::TaskManager.Task::(_updateState) Task=`b34d4e57-0413-41c9-9aac-e1d20fd12d2a`::moving from state init -> state preparing >Thread-2019::INFO::2013-03-01 14:04:00,288::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2019::INFO::2013-03-01 14:04:00,289::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2019::DEBUG::2013-03-01 14:04:00,289::task::1151::TaskManager.Task::(prepare) Task=`b34d4e57-0413-41c9-9aac-e1d20fd12d2a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2019::DEBUG::2013-03-01 14:04:00,289::task::568::TaskManager.Task::(_updateState) Task=`b34d4e57-0413-41c9-9aac-e1d20fd12d2a`::moving from state preparing -> state finished >Thread-2019::DEBUG::2013-03-01 14:04:00,289::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2019::DEBUG::2013-03-01 14:04:00,290::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2019::DEBUG::2013-03-01 14:04:00,290::task::957::TaskManager.Task::(_decref) Task=`b34d4e57-0413-41c9-9aac-e1d20fd12d2a`::ref 0 aborting False >Thread-2020::DEBUG::2013-03-01 14:04:00,314::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2020::DEBUG::2013-03-01 14:04:00,315::task::568::TaskManager.Task::(_updateState) Task=`6cfe1541-3501-4781-bd7e-b8ed934112ad`::moving from state init -> state preparing >Thread-2020::INFO::2013-03-01 14:04:00,315::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2020::DEBUG::2013-03-01 14:04:00,316::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`3cd946e9-5166-4386-bb48-173b1fb86e89`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2020::DEBUG::2013-03-01 14:04:00,316::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2020::DEBUG::2013-03-01 14:04:00,316::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-2020::DEBUG::2013-03-01 14:04:00,317::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`3cd946e9-5166-4386-bb48-173b1fb86e89`::Granted request >Thread-2020::DEBUG::2013-03-01 14:04:00,317::task::794::TaskManager.Task::(resourceAcquired) Task=`6cfe1541-3501-4781-bd7e-b8ed934112ad`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2020::DEBUG::2013-03-01 14:04:00,318::task::957::TaskManager.Task::(_decref) Task=`6cfe1541-3501-4781-bd7e-b8ed934112ad`::ref 1 aborting False >MainProcess|Thread-1697::DEBUG::2013-03-01 14:04:00,542::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-2021::DEBUG::2013-03-01 14:04:01,404::task::568::TaskManager.Task::(_updateState) Task=`4a1755a2-d5f1-4b0e-9dc2-f03cdfc9bc5e`::moving from state init -> state preparing >Thread-2021::INFO::2013-03-01 14:04:01,405::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2021::INFO::2013-03-01 14:04:01,405::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00344300270081', 'lastCheck': '9.9', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00256681442261', 'lastCheck': '17.3', 'code': 0, 'valid': True}} >Thread-2021::DEBUG::2013-03-01 14:04:01,405::task::1151::TaskManager.Task::(prepare) Task=`4a1755a2-d5f1-4b0e-9dc2-f03cdfc9bc5e`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00344300270081', 'lastCheck': '9.9', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.00256681442261', 'lastCheck': '17.3', 'code': 0, 'valid': True}} >Thread-2021::DEBUG::2013-03-01 14:04:01,406::task::568::TaskManager.Task::(_updateState) Task=`4a1755a2-d5f1-4b0e-9dc2-f03cdfc9bc5e`::moving from state preparing -> state finished >Thread-2021::DEBUG::2013-03-01 14:04:01,406::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2021::DEBUG::2013-03-01 14:04:01,406::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2021::DEBUG::2013-03-01 14:04:01,406::task::957::TaskManager.Task::(_decref) Task=`4a1755a2-d5f1-4b0e-9dc2-f03cdfc9bc5e`::ref 0 aborting False >MainProcess|Thread-1697::DEBUG::2013-03-01 14:04:01,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:04:01,551::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:04:01,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:04:01,557::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-1697::DEBUG::2013-03-01 14:04:01,560::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-1697::DEBUG::2013-03-01 14:04:03,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:04:04,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-1697::DEBUG::2013-03-01 14:04:04,710::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:04,717::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:04,718::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:04,718::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:04,718::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:04,719::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:04,719::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2018::DEBUG::2013-03-01 14:04:04,719::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2018::DEBUG::2013-03-01 14:04:04,721::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1697::DEBUG::2013-03-01 14:04:04,722::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:04,723::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2018::DEBUG::2013-03-01 14:04:04,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:04:04,735::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-2018::DEBUG::2013-03-01 14:04:04,751::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2018::DEBUG::2013-03-01 14:04:04,752::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:04,755::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-1697::DEBUG::2013-03-01 14:04:04,983::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-1697::WARNING::2013-03-01 14:04:04,984::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-1697::DEBUG::2013-03-01 14:04:04,986::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1697::DEBUG::2013-03-01 14:04:05,028::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-1697::DEBUG::2013-03-01 14:04:05,028::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1697::DEBUG::2013-03-01 14:04:05,032::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-1697::DEBUG::2013-03-01 14:04:05,033::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1697::WARNING::2013-03-01 14:04:05,033::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-1697::WARNING::2013-03-01 14:04:05,034::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-2020::INFO::2013-03-01 14:04:05,034::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-2020::DEBUG::2013-03-01 14:04:05,036::task::1151::TaskManager.Task::(prepare) Task=`6cfe1541-3501-4781-bd7e-b8ed934112ad`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,49d8a532-e3af-4ed8-b859-bacb52bd2eb0:Attached,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, '49d8a532-e3af-4ed8-b859-bacb52bd2eb0': {'status': 'Attached'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-2020::DEBUG::2013-03-01 14:04:05,037::task::568::TaskManager.Task::(_updateState) Task=`6cfe1541-3501-4781-bd7e-b8ed934112ad`::moving from state preparing -> state finished >Thread-2020::DEBUG::2013-03-01 14:04:05,039::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2020::DEBUG::2013-03-01 14:04:05,041::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2020::DEBUG::2013-03-01 14:04:05,043::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2020::DEBUG::2013-03-01 14:04:05,046::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2020::DEBUG::2013-03-01 14:04:05,047::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2020::DEBUG::2013-03-01 14:04:05,048::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2020::DEBUG::2013-03-01 14:04:05,051::task::957::TaskManager.Task::(_decref) Task=`6cfe1541-3501-4781-bd7e-b8ed934112ad`::ref 0 aborting False >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:05,759::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:05,763::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:05,766::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:05,769::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:05,772::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2018::DEBUG::2013-03-01 14:04:06,776::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2018::DEBUG::2013-03-01 14:04:08,780::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2018::DEBUG::2013-03-01 14:04:09,847::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2018::DEBUG::2013-03-01 14:04:09,847::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:09,848::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:09,848::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:09,848::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:09,849::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:09,849::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2018::DEBUG::2013-03-01 14:04:09,849::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2018::INFO::2013-03-01 14:04:09,850::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2018::DEBUG::2013-03-01 14:04:09,850::task::1151::TaskManager.Task::(prepare) Task=`3da4cd20-cf0f-410c-9f00-49cec5e14dbd`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2018::DEBUG::2013-03-01 14:04:09,851::task::568::TaskManager.Task::(_updateState) Task=`3da4cd20-cf0f-410c-9f00-49cec5e14dbd`::moving from state preparing -> state finished >Thread-2018::DEBUG::2013-03-01 14:04:09,851::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2018::DEBUG::2013-03-01 14:04:09,851::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2018::DEBUG::2013-03-01 14:04:09,851::task::957::TaskManager.Task::(_decref) Task=`3da4cd20-cf0f-410c-9f00-49cec5e14dbd`::ref 0 aborting False >Thread-2042::DEBUG::2013-03-01 14:04:11,124::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2042::DEBUG::2013-03-01 14:04:11,124::task::568::TaskManager.Task::(_updateState) Task=`3a734d6a-a751-4adb-bcc2-7a72316d98df`::moving from state init -> state preparing >Thread-2042::INFO::2013-03-01 14:04:11,125::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2042::INFO::2013-03-01 14:04:11,125::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2042::DEBUG::2013-03-01 14:04:11,125::task::1151::TaskManager.Task::(prepare) Task=`3a734d6a-a751-4adb-bcc2-7a72316d98df`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2042::DEBUG::2013-03-01 14:04:11,125::task::568::TaskManager.Task::(_updateState) Task=`3a734d6a-a751-4adb-bcc2-7a72316d98df`::moving from state preparing -> state finished >Thread-2042::DEBUG::2013-03-01 14:04:11,125::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2042::DEBUG::2013-03-01 14:04:11,126::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2042::DEBUG::2013-03-01 14:04:11,126::task::957::TaskManager.Task::(_decref) Task=`3a734d6a-a751-4adb-bcc2-7a72316d98df`::ref 0 aborting False >Thread-2043::DEBUG::2013-03-01 14:04:11,156::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2043::DEBUG::2013-03-01 14:04:11,156::task::568::TaskManager.Task::(_updateState) Task=`083f713d-185f-4e54-ac86-205c45de451c`::moving from state init -> state preparing >Thread-2043::INFO::2013-03-01 14:04:11,157::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2043::DEBUG::2013-03-01 14:04:11,160::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-2043::INFO::2013-03-01 14:04:11,233::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2043::DEBUG::2013-03-01 14:04:11,233::task::1151::TaskManager.Task::(prepare) Task=`083f713d-185f-4e54-ac86-205c45de451c`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2043::DEBUG::2013-03-01 14:04:11,234::task::568::TaskManager.Task::(_updateState) Task=`083f713d-185f-4e54-ac86-205c45de451c`::moving from state preparing -> state finished >Thread-2043::DEBUG::2013-03-01 14:04:11,234::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2043::DEBUG::2013-03-01 14:04:11,234::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2043::DEBUG::2013-03-01 14:04:11,234::task::957::TaskManager.Task::(_decref) Task=`083f713d-185f-4e54-ac86-205c45de451c`::ref 0 aborting False >Thread-2044::DEBUG::2013-03-01 14:04:11,269::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2044::DEBUG::2013-03-01 14:04:11,269::task::568::TaskManager.Task::(_updateState) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::moving from state init -> state preparing >Thread-2044::INFO::2013-03-01 14:04:11,270::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-2044::DEBUG::2013-03-01 14:04:11,270::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`78744732-b681-45eb-a5e7-7846bf6811e4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2044::DEBUG::2013-03-01 14:04:11,271::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2044::DEBUG::2013-03-01 14:04:11,271::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2044::DEBUG::2013-03-01 14:04:11,271::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`78744732-b681-45eb-a5e7-7846bf6811e4`::Granted request >Thread-2044::DEBUG::2013-03-01 14:04:11,272::task::794::TaskManager.Task::(resourceAcquired) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2044::DEBUG::2013-03-01 14:04:11,272::task::957::TaskManager.Task::(_decref) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::ref 1 aborting False >Thread-2044::DEBUG::2013-03-01 14:04:11,273::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`7f2da677-5933-40f4-96b7-bf731ecfac0c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2044::DEBUG::2013-03-01 14:04:11,273::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-2044::DEBUG::2013-03-01 14:04:11,273::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-2044::DEBUG::2013-03-01 14:04:11,274::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`7f2da677-5933-40f4-96b7-bf731ecfac0c`::Granted request >Thread-2044::DEBUG::2013-03-01 14:04:11,274::task::794::TaskManager.Task::(resourceAcquired) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-2044::DEBUG::2013-03-01 14:04:11,274::task::957::TaskManager.Task::(_decref) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::ref 1 aborting False >Thread-2044::INFO::2013-03-01 14:04:11,275::sp::984::Storage.StoragePool::(detachSD) sdUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0 spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-2044::DEBUG::2013-03-01 14:04:11,275::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2044::DEBUG::2013-03-01 14:04:11,275::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2044::DEBUG::2013-03-01 14:04:11,275::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2044::DEBUG::2013-03-01 14:04:11,276::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2044::DEBUG::2013-03-01 14:04:11,276::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2044::DEBUG::2013-03-01 14:04:11,291::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2044::DEBUG::2013-03-01 14:04:11,292::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:11,295::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:12,299::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:12,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:12,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:12,309::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:12,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2044::DEBUG::2013-03-01 14:04:12,315::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2044::DEBUG::2013-03-01 14:04:14,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2044::DEBUG::2013-03-01 14:04:15,397::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2044::DEBUG::2013-03-01 14:04:15,398::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,398::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,398::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,399::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,399::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,399::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,400::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2044::DEBUG::2013-03-01 14:04:15,400::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,402::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-2044::DEBUG::2013-03-01 14:04:15,624::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-2044::WARNING::2013-03-01 14:04:15,626::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-2044::DEBUG::2013-03-01 14:04:15,626::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2044::DEBUG::2013-03-01 14:04:15,662::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-2044::DEBUG::2013-03-01 14:04:15,662::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2044::DEBUG::2013-03-01 14:04:15,667::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-2044::DEBUG::2013-03-01 14:04:15,669::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2044::WARNING::2013-03-01 14:04:15,669::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-2044::WARNING::2013-03-01 14:04:15,670::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-2044::DEBUG::2013-03-01 14:04:15,674::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6e20236edf18d1357e7285e3bcb467406734532e'] >Thread-2044::DEBUG::2013-03-01 14:04:15,674::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2044::DEBUG::2013-03-01 14:04:15,675::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-2044::DEBUG::2013-03-01 14:04:15,675::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-2044::DEBUG::2013-03-01 14:04:15,675::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2044::DEBUG::2013-03-01 14:04:15,675::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f750573841a8efbd6c760672df3821255d89ee35'] >Thread-2044::DEBUG::2013-03-01 14:04:15,760::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2044::WARNING::2013-03-01 14:04:15,760::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `49d8a532-e3af-4ed8-b859-bacb52bd2eb0` >Thread-2044::DEBUG::2013-03-01 14:04:15,761::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2044::DEBUG::2013-03-01 14:04:15,761::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2044::DEBUG::2013-03-01 14:04:15,762::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2e433a8a08a6d76ed398bb2932f8b74cabf057b4'] >Thread-2044::DEBUG::2013-03-01 14:04:15,832::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2044::DEBUG::2013-03-01 14:04:15,832::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2044::DEBUG::2013-03-01 14:04:15,832::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2044::DEBUG::2013-03-01 14:04:15,833::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2044::DEBUG::2013-03-01 14:04:15,833::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `49d8a532-e3af-4ed8-b859-bacb52bd2eb0` is done >Thread-2044::INFO::2013-03-01 14:04:15,833::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-2044::DEBUG::2013-03-01 14:04:15,834::task::1151::TaskManager.Task::(prepare) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::finished: None >Thread-2044::DEBUG::2013-03-01 14:04:15,834::task::568::TaskManager.Task::(_updateState) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::moving from state preparing -> state finished >Thread-2044::DEBUG::2013-03-01 14:04:15,834::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-2044::DEBUG::2013-03-01 14:04:15,835::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2044::DEBUG::2013-03-01 14:04:15,835::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2044::DEBUG::2013-03-01 14:04:15,835::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2044::DEBUG::2013-03-01 14:04:15,836::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2044::DEBUG::2013-03-01 14:04:15,836::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2044::DEBUG::2013-03-01 14:04:15,836::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-2044::DEBUG::2013-03-01 14:04:15,837::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-2044::DEBUG::2013-03-01 14:04:15,837::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-2044::DEBUG::2013-03-01 14:04:15,837::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-2044::DEBUG::2013-03-01 14:04:15,838::task::957::TaskManager.Task::(_decref) Task=`163985ab-7b33-4e26-be77-98dbdc5fd491`::ref 0 aborting False >Thread-2058::DEBUG::2013-03-01 14:04:15,866::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2058::DEBUG::2013-03-01 14:04:15,867::task::568::TaskManager.Task::(_updateState) Task=`fa3e084c-b61f-4302-b29d-05b008e0ed4e`::moving from state init -> state preparing >Thread-2058::INFO::2013-03-01 14:04:15,867::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2058::INFO::2013-03-01 14:04:15,868::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2058::DEBUG::2013-03-01 14:04:15,868::task::1151::TaskManager.Task::(prepare) Task=`fa3e084c-b61f-4302-b29d-05b008e0ed4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2058::DEBUG::2013-03-01 14:04:15,869::task::568::TaskManager.Task::(_updateState) Task=`fa3e084c-b61f-4302-b29d-05b008e0ed4e`::moving from state preparing -> state finished >Thread-2058::DEBUG::2013-03-01 14:04:15,869::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2058::DEBUG::2013-03-01 14:04:15,870::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2058::DEBUG::2013-03-01 14:04:15,870::task::957::TaskManager.Task::(_decref) Task=`fa3e084c-b61f-4302-b29d-05b008e0ed4e`::ref 0 aborting False >Thread-2059::DEBUG::2013-03-01 14:04:15,883::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2059::DEBUG::2013-03-01 14:04:15,884::task::568::TaskManager.Task::(_updateState) Task=`96423fb5-9801-43d4-86c3-ff6e93f625cb`::moving from state init -> state preparing >Thread-2059::INFO::2013-03-01 14:04:15,884::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-2059::DEBUG::2013-03-01 14:04:15,885::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`b88c8125-6fbd-473a-8de3-1e50bc93cf47`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2059::DEBUG::2013-03-01 14:04:15,885::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2059::DEBUG::2013-03-01 14:04:15,886::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-2059::DEBUG::2013-03-01 14:04:15,886::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`b88c8125-6fbd-473a-8de3-1e50bc93cf47`::Granted request >Thread-2059::DEBUG::2013-03-01 14:04:15,887::task::794::TaskManager.Task::(resourceAcquired) Task=`96423fb5-9801-43d4-86c3-ff6e93f625cb`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2059::DEBUG::2013-03-01 14:04:15,887::task::957::TaskManager.Task::(_decref) Task=`96423fb5-9801-43d4-86c3-ff6e93f625cb`::ref 1 aborting False >Thread-2059::INFO::2013-03-01 14:04:15,888::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2060::DEBUG::2013-03-01 14:04:15,895::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2060::DEBUG::2013-03-01 14:04:15,896::task::568::TaskManager.Task::(_updateState) Task=`378497e5-0b91-4725-a23a-68c5b6418236`::moving from state init -> state preparing >Thread-2060::INFO::2013-03-01 14:04:15,896::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2060::DEBUG::2013-03-01 14:04:15,897::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`744a8921-de46-4c2d-b185-67e8b6db2910`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2060::DEBUG::2013-03-01 14:04:15,897::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2060::DEBUG::2013-03-01 14:04:15,897::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-2060::DEBUG::2013-03-01 14:04:15,898::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`744a8921-de46-4c2d-b185-67e8b6db2910`::Granted request >Thread-2060::DEBUG::2013-03-01 14:04:15,898::task::794::TaskManager.Task::(resourceAcquired) Task=`378497e5-0b91-4725-a23a-68c5b6418236`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2060::DEBUG::2013-03-01 14:04:15,899::task::957::TaskManager.Task::(_decref) Task=`378497e5-0b91-4725-a23a-68c5b6418236`::ref 1 aborting False >Thread-2059::DEBUG::2013-03-01 14:04:15,908::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2e433a8a08a6d76ed398bb2932f8b74cabf057b4'] >Thread-2059::DEBUG::2013-03-01 14:04:15,913::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2059::DEBUG::2013-03-01 14:04:15,918::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2059::DEBUG::2013-03-01 14:04:15,922::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2059::DEBUG::2013-03-01 14:04:15,925::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2059::DEBUG::2013-03-01 14:04:15,927::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2059::DEBUG::2013-03-01 14:04:15,927::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:15,928::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2060::DEBUG::2013-03-01 14:04:15,928::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2060::DEBUG::2013-03-01 14:04:15,928::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2060::DEBUG::2013-03-01 14:04:15,928::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2060::DEBUG::2013-03-01 14:04:15,929::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2060::DEBUG::2013-03-01 14:04:15,943::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2060::DEBUG::2013-03-01 14:04:15,944::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:15,946::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-2061::DEBUG::2013-03-01 14:04:16,619::task::568::TaskManager.Task::(_updateState) Task=`2e6536ef-029a-413d-85ce-c3e93ceefb8c`::moving from state init -> state preparing >Thread-2061::INFO::2013-03-01 14:04:16,619::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2061::INFO::2013-03-01 14:04:16,620::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00370407104492', 'lastCheck': '5.1', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.270144939423', 'lastCheck': '1.3', 'code': 0, 'valid': True}} >Thread-2061::DEBUG::2013-03-01 14:04:16,620::task::1151::TaskManager.Task::(prepare) Task=`2e6536ef-029a-413d-85ce-c3e93ceefb8c`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.00370407104492', 'lastCheck': '5.1', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.270144939423', 'lastCheck': '1.3', 'code': 0, 'valid': True}} >Thread-2061::DEBUG::2013-03-01 14:04:16,620::task::568::TaskManager.Task::(_updateState) Task=`2e6536ef-029a-413d-85ce-c3e93ceefb8c`::moving from state preparing -> state finished >Thread-2061::DEBUG::2013-03-01 14:04:16,621::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2061::DEBUG::2013-03-01 14:04:16,621::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2061::DEBUG::2013-03-01 14:04:16,621::task::957::TaskManager.Task::(_decref) Task=`2e6536ef-029a-413d-85ce-c3e93ceefb8c`::ref 0 aborting False >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:16,950::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:16,961::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:17,965::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:18,969::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:19,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2060::DEBUG::2013-03-01 14:04:20,978::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2060::DEBUG::2013-03-01 14:04:22,982::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2060::DEBUG::2013-03-01 14:04:24,064::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2060::DEBUG::2013-03-01 14:04:24,065::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,065::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,065::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,066::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,066::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,066::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,067::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2060::DEBUG::2013-03-01 14:04:24,067::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,068::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-2060::DEBUG::2013-03-01 14:04:24,290::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-2060::WARNING::2013-03-01 14:04:24,291::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-2060::DEBUG::2013-03-01 14:04:24,291::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,346::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2060::DEBUG::2013-03-01 14:04:24,346::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2060::DEBUG::2013-03-01 14:04:24,364::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2e433a8a08a6d76ed398bb2932f8b74cabf057b4'] >Thread-2060::DEBUG::2013-03-01 14:04:24,368::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2060::WARNING::2013-03-01 14:04:24,368::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-2060::WARNING::2013-03-01 14:04:24,369::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-2059::DEBUG::2013-03-01 14:04:24,373::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-2059::DEBUG::2013-03-01 14:04:24,375::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2059::DEBUG::2013-03-01 14:04:24,378::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2059::DEBUG::2013-03-01 14:04:24,381::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2059::WARNING::2013-03-01 14:04:24,384::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-2060::DEBUG::2013-03-01 14:04:24,386::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2059::DEBUG::2013-03-01 14:04:24,390::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,396::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-2059::DEBUG::2013-03-01 14:04:24,397::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-2060::DEBUG::2013-03-01 14:04:24,566::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-2060::WARNING::2013-03-01 14:04:24,567::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-2059::DEBUG::2013-03-01 14:04:24,593::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-2059::WARNING::2013-03-01 14:04:24,604::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-2059::DEBUG::2013-03-01 14:04:24,611::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2060::DEBUG::2013-03-01 14:04:24,654::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2060::DEBUG::2013-03-01 14:04:24,658::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2060::DEBUG::2013-03-01 14:04:24,690::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-2059::INFO::2013-03-01 14:04:24,696::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2059::INFO::2013-03-01 14:04:24,698::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2059::INFO::2013-03-01 14:04:24,699::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-2060::DEBUG::2013-03-01 14:04:24,700::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2059::INFO::2013-03-01 14:04:24,700::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-2060::WARNING::2013-03-01 14:04:24,701::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-2059::DEBUG::2013-03-01 14:04:24,702::task::1151::TaskManager.Task::(prepare) Task=`96423fb5-9801-43d4-86c3-ff6e93f625cb`::finished: None >Thread-2059::DEBUG::2013-03-01 14:04:24,703::task::568::TaskManager.Task::(_updateState) Task=`96423fb5-9801-43d4-86c3-ff6e93f625cb`::moving from state preparing -> state finished >Thread-2060::WARNING::2013-03-01 14:04:24,702::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-2059::DEBUG::2013-03-01 14:04:24,704::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2059::DEBUG::2013-03-01 14:04:24,705::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2060::INFO::2013-03-01 14:04:24,705::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942800896000', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-2059::DEBUG::2013-03-01 14:04:24,707::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2060::DEBUG::2013-03-01 14:04:24,707::task::1151::TaskManager.Task::(prepare) Task=`378497e5-0b91-4725-a23a-68c5b6418236`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942805090304', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Active', 'diskfree': '942800896000', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-2060::DEBUG::2013-03-01 14:04:24,709::task::568::TaskManager.Task::(_updateState) Task=`378497e5-0b91-4725-a23a-68c5b6418236`::moving from state preparing -> state finished >Thread-2059::DEBUG::2013-03-01 14:04:24,710::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-2060::DEBUG::2013-03-01 14:04:24,710::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2060::DEBUG::2013-03-01 14:04:24,712::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2059::DEBUG::2013-03-01 14:04:24,713::task::957::TaskManager.Task::(_decref) Task=`96423fb5-9801-43d4-86c3-ff6e93f625cb`::ref 0 aborting False >Thread-2060::DEBUG::2013-03-01 14:04:24,715::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2060::DEBUG::2013-03-01 14:04:24,718::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2060::DEBUG::2013-03-01 14:04:24,720::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2060::DEBUG::2013-03-01 14:04:24,720::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2060::DEBUG::2013-03-01 14:04:24,720::task::957::TaskManager.Task::(_decref) Task=`378497e5-0b91-4725-a23a-68c5b6418236`::ref 0 aborting False >Thread-2128::DEBUG::2013-03-01 14:04:24,753::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2128::DEBUG::2013-03-01 14:04:24,754::task::568::TaskManager.Task::(_updateState) Task=`893fda70-ba95-4c0b-9d05-0a539b5bce6b`::moving from state init -> state preparing >Thread-2128::INFO::2013-03-01 14:04:24,754::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2128::DEBUG::2013-03-01 14:04:24,755::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-2128::DEBUG::2013-03-01 14:04:24,782::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2128::DEBUG::2013-03-01 14:04:24,783::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2128::DEBUG::2013-03-01 14:04:24,783::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2128::DEBUG::2013-03-01 14:04:24,783::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2128::DEBUG::2013-03-01 14:04:24,784::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2128::DEBUG::2013-03-01 14:04:24,799::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2128::DEBUG::2013-03-01 14:04:24,800::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:24,802::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:25,806::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:25,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:25,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:25,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:25,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2128::DEBUG::2013-03-01 14:04:26,822::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2128::DEBUG::2013-03-01 14:04:28,825::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2128::DEBUG::2013-03-01 14:04:29,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2128::DEBUG::2013-03-01 14:04:29,891::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2128::DEBUG::2013-03-01 14:04:29,892::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2128::DEBUG::2013-03-01 14:04:29,892::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2128::DEBUG::2013-03-01 14:04:29,892::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2128::DEBUG::2013-03-01 14:04:29,893::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2128::DEBUG::2013-03-01 14:04:29,893::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2128::DEBUG::2013-03-01 14:04:29,894::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2128::INFO::2013-03-01 14:04:29,894::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2128::DEBUG::2013-03-01 14:04:29,894::task::1151::TaskManager.Task::(prepare) Task=`893fda70-ba95-4c0b-9d05-0a539b5bce6b`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2128::DEBUG::2013-03-01 14:04:29,894::task::568::TaskManager.Task::(_updateState) Task=`893fda70-ba95-4c0b-9d05-0a539b5bce6b`::moving from state preparing -> state finished >Thread-2128::DEBUG::2013-03-01 14:04:29,895::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2128::DEBUG::2013-03-01 14:04:29,895::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2128::DEBUG::2013-03-01 14:04:29,895::task::957::TaskManager.Task::(_decref) Task=`893fda70-ba95-4c0b-9d05-0a539b5bce6b`::ref 0 aborting False >Thread-2131::DEBUG::2013-03-01 14:04:31,834::task::568::TaskManager.Task::(_updateState) Task=`a78a52d2-e84a-4ad7-8b7c-8e06ad2970e4`::moving from state init -> state preparing >Thread-2131::INFO::2013-03-01 14:04:31,835::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2131::INFO::2013-03-01 14:04:31,835::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0116820335388', 'lastCheck': '7.4', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.638104915619', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-2131::DEBUG::2013-03-01 14:04:31,835::task::1151::TaskManager.Task::(prepare) Task=`a78a52d2-e84a-4ad7-8b7c-8e06ad2970e4`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.0116820335388', 'lastCheck': '7.4', 'code': 0, 'valid': True}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'delay': '0.638104915619', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-2131::DEBUG::2013-03-01 14:04:31,836::task::568::TaskManager.Task::(_updateState) Task=`a78a52d2-e84a-4ad7-8b7c-8e06ad2970e4`::moving from state preparing -> state finished >Thread-2131::DEBUG::2013-03-01 14:04:31,836::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2131::DEBUG::2013-03-01 14:04:31,836::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2131::DEBUG::2013-03-01 14:04:31,836::task::957::TaskManager.Task::(_decref) Task=`a78a52d2-e84a-4ad7-8b7c-8e06ad2970e4`::ref 0 aborting False >Thread-2133::DEBUG::2013-03-01 14:04:31,943::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2133::DEBUG::2013-03-01 14:04:31,943::task::568::TaskManager.Task::(_updateState) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::moving from state init -> state preparing >Thread-2133::INFO::2013-03-01 14:04:31,943::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-2133::DEBUG::2013-03-01 14:04:31,944::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`1fec7511-7b1c-4245-8722-7d5207c943bf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2133::DEBUG::2013-03-01 14:04:31,944::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2133::DEBUG::2013-03-01 14:04:31,945::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2133::DEBUG::2013-03-01 14:04:31,945::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`1fec7511-7b1c-4245-8722-7d5207c943bf`::Granted request >Thread-2133::DEBUG::2013-03-01 14:04:31,946::task::794::TaskManager.Task::(resourceAcquired) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2133::DEBUG::2013-03-01 14:04:31,946::task::957::TaskManager.Task::(_decref) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::ref 1 aborting False >Thread-2133::DEBUG::2013-03-01 14:04:31,946::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`9475f9b1-fdc3-460d-87d1-0a400a875672`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2133::DEBUG::2013-03-01 14:04:31,946::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' for lock type 'exclusive' >Thread-2133::DEBUG::2013-03-01 14:04:31,947::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free. Now locking as 'exclusive' (1 active user) >Thread-2133::DEBUG::2013-03-01 14:04:31,947::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`9475f9b1-fdc3-460d-87d1-0a400a875672`::Granted request >Thread-2133::DEBUG::2013-03-01 14:04:31,947::task::794::TaskManager.Task::(resourceAcquired) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::_resourcesAcquired: Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc (exclusive) >Thread-2133::DEBUG::2013-03-01 14:04:31,948::task::957::TaskManager.Task::(_decref) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::ref 1 aborting False >Thread-2133::INFO::2013-03-01 14:04:31,948::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-2133::DEBUG::2013-03-01 14:04:31,951::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2133::DEBUG::2013-03-01 14:04:31,952::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2133::DEBUG::2013-03-01 14:04:31,952::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=eb981fde799330d603b720282c255bcdd46e2b16'] >Thread-2133::DEBUG::2013-03-01 14:04:32,350::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2133::DEBUG::2013-03-01 14:04:32,350::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2133::DEBUG::2013-03-01 14:04:32,350::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-1697::DEBUG::2013-03-01 14:04:32,351::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2133::DEBUG::2013-03-01 14:04:32,351::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` stopped monitoring domain `edd0d33d-dba0-4943-9c48-6112a2ddcdfc` >Thread-2133::DEBUG::2013-03-01 14:04:32,351::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2133::INFO::2013-03-01 14:04:32,351::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-2133::DEBUG::2013-03-01 14:04:32,352::task::1151::TaskManager.Task::(prepare) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::finished: None >Thread-2133::DEBUG::2013-03-01 14:04:32,352::task::568::TaskManager.Task::(_updateState) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::moving from state preparing -> state finished >Thread-2133::DEBUG::2013-03-01 14:04:32,352::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc': < ResourceRef 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', isValid: 'True' obj: 'None'>, 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2133::DEBUG::2013-03-01 14:04:32,352::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2133::DEBUG::2013-03-01 14:04:32,353::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' >Thread-2133::DEBUG::2013-03-01 14:04:32,353::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (0 active users) >Thread-2133::DEBUG::2013-03-01 14:04:32,353::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free, finding out if anyone is waiting for it. >Thread-2133::DEBUG::2013-03-01 14:04:32,353::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', Clearing records. >Thread-2133::DEBUG::2013-03-01 14:04:32,354::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2133::DEBUG::2013-03-01 14:04:32,354::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2133::DEBUG::2013-03-01 14:04:32,354::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2133::DEBUG::2013-03-01 14:04:32,354::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2133::DEBUG::2013-03-01 14:04:32,355::task::957::TaskManager.Task::(_decref) Task=`50ad525a-bd0e-49de-a9a6-307e4189fd57`::ref 0 aborting False >Thread-2134::DEBUG::2013-03-01 14:04:32,394::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2134::DEBUG::2013-03-01 14:04:32,394::task::568::TaskManager.Task::(_updateState) Task=`90acadf6-8fe2-41cd-a7f1-d3b264959290`::moving from state init -> state preparing >Thread-2134::INFO::2013-03-01 14:04:32,395::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-2134::DEBUG::2013-03-01 14:04:32,395::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`7e1540a1-fdc8-454c-83f5-71914728f2e9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2134::DEBUG::2013-03-01 14:04:32,395::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2134::DEBUG::2013-03-01 14:04:32,396::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-2134::DEBUG::2013-03-01 14:04:32,396::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`7e1540a1-fdc8-454c-83f5-71914728f2e9`::Granted request >Thread-2134::DEBUG::2013-03-01 14:04:32,396::task::794::TaskManager.Task::(resourceAcquired) Task=`90acadf6-8fe2-41cd-a7f1-d3b264959290`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2134::DEBUG::2013-03-01 14:04:32,397::task::957::TaskManager.Task::(_decref) Task=`90acadf6-8fe2-41cd-a7f1-d3b264959290`::ref 1 aborting False >Thread-2134::INFO::2013-03-01 14:04:32,397::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2134::DEBUG::2013-03-01 14:04:32,423::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=eb981fde799330d603b720282c255bcdd46e2b16'] >Thread-2134::DEBUG::2013-03-01 14:04:32,424::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:32,424::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:32,424::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:32,425::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:32,425::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:32,425::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:32,425::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2134::DEBUG::2013-03-01 14:04:32,426::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2134::DEBUG::2013-03-01 14:04:32,426::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2134::DEBUG::2013-03-01 14:04:32,426::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2134::DEBUG::2013-03-01 14:04:32,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2134::DEBUG::2013-03-01 14:04:32,442::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2134::DEBUG::2013-03-01 14:04:32,443::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:32,445::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:33,450::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:34,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-2135::DEBUG::2013-03-01 14:04:34,766::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2135::DEBUG::2013-03-01 14:04:34,766::task::568::TaskManager.Task::(_updateState) Task=`9bcdcc79-e0b8-424b-b99d-60e7abd3b5ca`::moving from state init -> state preparing >Thread-2135::INFO::2013-03-01 14:04:34,767::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:35,458::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:36,463::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:37,504::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2134::DEBUG::2013-03-01 14:04:38,509::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2134::DEBUG::2013-03-01 14:04:40,512::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2134::DEBUG::2013-03-01 14:04:41,580::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2134::DEBUG::2013-03-01 14:04:41,581::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,581::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,581::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,582::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,582::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,582::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,582::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2134::DEBUG::2013-03-01 14:04:41,583::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,584::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-2134::DEBUG::2013-03-01 14:04:41,760::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-2134::WARNING::2013-03-01 14:04:41,761::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-2134::DEBUG::2013-03-01 14:04:41,762::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2134::DEBUG::2013-03-01 14:04:41,816::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2134::DEBUG::2013-03-01 14:04:41,816::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2134::DEBUG::2013-03-01 14:04:41,820::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=eb981fde799330d603b720282c255bcdd46e2b16'] >Thread-2134::DEBUG::2013-03-01 14:04:41,822::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2134::WARNING::2013-03-01 14:04:41,822::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-2134::WARNING::2013-03-01 14:04:41,823::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-2135::INFO::2013-03-01 14:04:41,825::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2134::DEBUG::2013-03-01 14:04:41,827::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-2134::DEBUG::2013-03-01 14:04:41,829::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2135::DEBUG::2013-03-01 14:04:41,829::task::1151::TaskManager.Task::(prepare) Task=`9bcdcc79-e0b8-424b-b99d-60e7abd3b5ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2134::DEBUG::2013-03-01 14:04:41,831::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2134::DEBUG::2013-03-01 14:04:41,835::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2135::DEBUG::2013-03-01 14:04:41,834::task::568::TaskManager.Task::(_updateState) Task=`9bcdcc79-e0b8-424b-b99d-60e7abd3b5ca`::moving from state preparing -> state finished >Thread-2134::WARNING::2013-03-01 14:04:41,837::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-2135::DEBUG::2013-03-01 14:04:41,839::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2135::DEBUG::2013-03-01 14:04:41,842::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2134::DEBUG::2013-03-01 14:04:41,843::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2135::DEBUG::2013-03-01 14:04:41,845::task::957::TaskManager.Task::(_decref) Task=`9bcdcc79-e0b8-424b-b99d-60e7abd3b5ca`::ref 0 aborting False >Thread-2134::DEBUG::2013-03-01 14:04:41,853::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-2155::DEBUG::2013-03-01 14:04:41,889::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2155::DEBUG::2013-03-01 14:04:41,889::task::568::TaskManager.Task::(_updateState) Task=`adcf967e-b07e-463a-b090-12a6fb491fe5`::moving from state init -> state preparing >Thread-2155::INFO::2013-03-01 14:04:41,890::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2155::DEBUG::2013-03-01 14:04:41,890::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`8119ba0e-cf14-474e-9d49-412a6f21874e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2155::DEBUG::2013-03-01 14:04:41,891::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2155::DEBUG::2013-03-01 14:04:41,891::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-2155::DEBUG::2013-03-01 14:04:41,891::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`8119ba0e-cf14-474e-9d49-412a6f21874e`::Granted request >Thread-2155::DEBUG::2013-03-01 14:04:41,892::task::794::TaskManager.Task::(resourceAcquired) Task=`adcf967e-b07e-463a-b090-12a6fb491fe5`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2155::DEBUG::2013-03-01 14:04:41,892::task::957::TaskManager.Task::(_decref) Task=`adcf967e-b07e-463a-b090-12a6fb491fe5`::ref 1 aborting False >Thread-2155::INFO::2013-03-01 14:04:41,896::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942618443776', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-2155::DEBUG::2013-03-01 14:04:41,896::task::1151::TaskManager.Task::(prepare) Task=`adcf967e-b07e-463a-b090-12a6fb491fe5`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942618443776', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-2155::DEBUG::2013-03-01 14:04:41,897::task::568::TaskManager.Task::(_updateState) Task=`adcf967e-b07e-463a-b090-12a6fb491fe5`::moving from state preparing -> state finished >Thread-2155::DEBUG::2013-03-01 14:04:41,897::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2155::DEBUG::2013-03-01 14:04:41,897::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2155::DEBUG::2013-03-01 14:04:41,898::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2155::DEBUG::2013-03-01 14:04:41,898::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-2155::DEBUG::2013-03-01 14:04:41,898::task::957::TaskManager.Task::(_decref) Task=`adcf967e-b07e-463a-b090-12a6fb491fe5`::ref 0 aborting False >Thread-2134::DEBUG::2013-03-01 14:04:42,023::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-2134::DEBUG::2013-03-01 14:04:42,023::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2134::INFO::2013-03-01 14:04:42,081::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2134::INFO::2013-03-01 14:04:42,081::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-2134::INFO::2013-03-01 14:04:42,082::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-2134::DEBUG::2013-03-01 14:04:42,082::task::1151::TaskManager.Task::(prepare) Task=`90acadf6-8fe2-41cd-a7f1-d3b264959290`::finished: None >Thread-2134::DEBUG::2013-03-01 14:04:42,082::task::568::TaskManager.Task::(_updateState) Task=`90acadf6-8fe2-41cd-a7f1-d3b264959290`::moving from state preparing -> state finished >Thread-2134::DEBUG::2013-03-01 14:04:42,083::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2134::DEBUG::2013-03-01 14:04:42,083::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2134::DEBUG::2013-03-01 14:04:42,083::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2134::DEBUG::2013-03-01 14:04:42,084::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2134::DEBUG::2013-03-01 14:04:42,084::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2134::DEBUG::2013-03-01 14:04:42,084::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2134::DEBUG::2013-03-01 14:04:42,085::task::957::TaskManager.Task::(_decref) Task=`90acadf6-8fe2-41cd-a7f1-d3b264959290`::ref 0 aborting False >Thread-2181::DEBUG::2013-03-01 14:04:42,120::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2181::DEBUG::2013-03-01 14:04:42,121::task::568::TaskManager.Task::(_updateState) Task=`a2aacd5b-651f-48a9-8bb8-4352146190eb`::moving from state init -> state preparing >Thread-2181::INFO::2013-03-01 14:04:42,121::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2181::DEBUG::2013-03-01 14:04:42,122::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-2181::DEBUG::2013-03-01 14:04:42,145::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2181::DEBUG::2013-03-01 14:04:42,145::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2181::DEBUG::2013-03-01 14:04:42,146::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2181::DEBUG::2013-03-01 14:04:42,146::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2181::DEBUG::2013-03-01 14:04:42,146::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2181::DEBUG::2013-03-01 14:04:42,161::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2181::DEBUG::2013-03-01 14:04:42,162::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:42,164::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:43,169::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:44,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:45,177::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:46,182::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:47,186::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2181::DEBUG::2013-03-01 14:04:48,190::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2181::DEBUG::2013-03-01 14:04:50,194::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2181::DEBUG::2013-03-01 14:04:51,263::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2181::DEBUG::2013-03-01 14:04:51,263::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2181::DEBUG::2013-03-01 14:04:51,264::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2181::DEBUG::2013-03-01 14:04:51,264::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2181::DEBUG::2013-03-01 14:04:51,264::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2181::DEBUG::2013-03-01 14:04:51,265::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2181::DEBUG::2013-03-01 14:04:51,265::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2181::DEBUG::2013-03-01 14:04:51,265::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2181::INFO::2013-03-01 14:04:51,266::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2181::DEBUG::2013-03-01 14:04:51,266::task::1151::TaskManager.Task::(prepare) Task=`a2aacd5b-651f-48a9-8bb8-4352146190eb`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2181::DEBUG::2013-03-01 14:04:51,266::task::568::TaskManager.Task::(_updateState) Task=`a2aacd5b-651f-48a9-8bb8-4352146190eb`::moving from state preparing -> state finished >Thread-2181::DEBUG::2013-03-01 14:04:51,267::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2181::DEBUG::2013-03-01 14:04:51,267::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2181::DEBUG::2013-03-01 14:04:51,267::task::957::TaskManager.Task::(_decref) Task=`a2aacd5b-651f-48a9-8bb8-4352146190eb`::ref 0 aborting False >Thread-2185::DEBUG::2013-03-01 14:04:52,038::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2185::DEBUG::2013-03-01 14:04:52,039::task::568::TaskManager.Task::(_updateState) Task=`b085f7a5-a9dd-4791-bf22-1c72a066723c`::moving from state init -> state preparing >Thread-2185::INFO::2013-03-01 14:04:52,039::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2185::INFO::2013-03-01 14:04:52,039::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2185::DEBUG::2013-03-01 14:04:52,040::task::1151::TaskManager.Task::(prepare) Task=`b085f7a5-a9dd-4791-bf22-1c72a066723c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2185::DEBUG::2013-03-01 14:04:52,040::task::568::TaskManager.Task::(_updateState) Task=`b085f7a5-a9dd-4791-bf22-1c72a066723c`::moving from state preparing -> state finished >Thread-2185::DEBUG::2013-03-01 14:04:52,040::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2185::DEBUG::2013-03-01 14:04:52,040::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2185::DEBUG::2013-03-01 14:04:52,041::task::957::TaskManager.Task::(_decref) Task=`b085f7a5-a9dd-4791-bf22-1c72a066723c`::ref 0 aborting False >Thread-2186::DEBUG::2013-03-01 14:04:52,066::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2186::DEBUG::2013-03-01 14:04:52,066::task::568::TaskManager.Task::(_updateState) Task=`9f425131-d7a1-496b-a50c-65fbc445a492`::moving from state init -> state preparing >Thread-2186::INFO::2013-03-01 14:04:52,066::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2186::DEBUG::2013-03-01 14:04:52,067::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`12d98d10-a010-480c-8d25-c8481b749008`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2186::DEBUG::2013-03-01 14:04:52,067::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2186::DEBUG::2013-03-01 14:04:52,068::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-2186::DEBUG::2013-03-01 14:04:52,068::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`12d98d10-a010-480c-8d25-c8481b749008`::Granted request >Thread-2186::DEBUG::2013-03-01 14:04:52,069::task::794::TaskManager.Task::(resourceAcquired) Task=`9f425131-d7a1-496b-a50c-65fbc445a492`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2186::DEBUG::2013-03-01 14:04:52,069::task::957::TaskManager.Task::(_decref) Task=`9f425131-d7a1-496b-a50c-65fbc445a492`::ref 1 aborting False >Thread-2186::INFO::2013-03-01 14:04:52,073::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942618443776', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-2186::DEBUG::2013-03-01 14:04:52,073::task::1151::TaskManager.Task::(prepare) Task=`9f425131-d7a1-496b-a50c-65fbc445a492`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active,edd0d33d-dba0-4943-9c48-6112a2ddcdfc:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942618443776', 'alerts': [], 'disktotal': '1098974756864'}, 'edd0d33d-dba0-4943-9c48-6112a2ddcdfc': {'status': 'Attached'}}} >Thread-2186::DEBUG::2013-03-01 14:04:52,073::task::568::TaskManager.Task::(_updateState) Task=`9f425131-d7a1-496b-a50c-65fbc445a492`::moving from state preparing -> state finished >Thread-2186::DEBUG::2013-03-01 14:04:52,074::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2186::DEBUG::2013-03-01 14:04:52,074::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2186::DEBUG::2013-03-01 14:04:52,074::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2186::DEBUG::2013-03-01 14:04:52,075::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2186::DEBUG::2013-03-01 14:04:52,075::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2186::DEBUG::2013-03-01 14:04:52,075::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2186::DEBUG::2013-03-01 14:04:52,076::task::957::TaskManager.Task::(_decref) Task=`9f425131-d7a1-496b-a50c-65fbc445a492`::ref 0 aborting False >Thread-2187::DEBUG::2013-03-01 14:04:52,610::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2187::DEBUG::2013-03-01 14:04:52,611::task::568::TaskManager.Task::(_updateState) Task=`71d309d5-6994-47cd-8cb5-ca7e77b2d018`::moving from state init -> state preparing >Thread-2187::INFO::2013-03-01 14:04:52,611::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2187::INFO::2013-03-01 14:04:52,611::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2187::DEBUG::2013-03-01 14:04:52,612::task::1151::TaskManager.Task::(prepare) Task=`71d309d5-6994-47cd-8cb5-ca7e77b2d018`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2187::DEBUG::2013-03-01 14:04:52,612::task::568::TaskManager.Task::(_updateState) Task=`71d309d5-6994-47cd-8cb5-ca7e77b2d018`::moving from state preparing -> state finished >Thread-2187::DEBUG::2013-03-01 14:04:52,612::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2187::DEBUG::2013-03-01 14:04:52,612::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2187::DEBUG::2013-03-01 14:04:52,612::task::957::TaskManager.Task::(_decref) Task=`71d309d5-6994-47cd-8cb5-ca7e77b2d018`::ref 0 aborting False >Thread-2188::DEBUG::2013-03-01 14:04:52,642::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2188::DEBUG::2013-03-01 14:04:52,643::task::568::TaskManager.Task::(_updateState) Task=`ffae61ec-93cc-46f8-ac8e-420335b0c877`::moving from state init -> state preparing >Thread-2188::INFO::2013-03-01 14:04:52,643::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2188::DEBUG::2013-03-01 14:04:52,646::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-2188::INFO::2013-03-01 14:04:52,691::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2188::DEBUG::2013-03-01 14:04:52,691::task::1151::TaskManager.Task::(prepare) Task=`ffae61ec-93cc-46f8-ac8e-420335b0c877`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2188::DEBUG::2013-03-01 14:04:52,691::task::568::TaskManager.Task::(_updateState) Task=`ffae61ec-93cc-46f8-ac8e-420335b0c877`::moving from state preparing -> state finished >Thread-2188::DEBUG::2013-03-01 14:04:52,692::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2188::DEBUG::2013-03-01 14:04:52,692::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2188::DEBUG::2013-03-01 14:04:52,692::task::957::TaskManager.Task::(_decref) Task=`ffae61ec-93cc-46f8-ac8e-420335b0c877`::ref 0 aborting False >Thread-2189::DEBUG::2013-03-01 14:04:52,727::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2189::DEBUG::2013-03-01 14:04:52,727::task::568::TaskManager.Task::(_updateState) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::moving from state init -> state preparing >Thread-2189::INFO::2013-03-01 14:04:52,728::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-2189::DEBUG::2013-03-01 14:04:52,729::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`fc87699c-2423-42f2-8f2d-ccf535fbb17c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2189::DEBUG::2013-03-01 14:04:52,729::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2189::DEBUG::2013-03-01 14:04:52,729::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2189::DEBUG::2013-03-01 14:04:52,730::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`fc87699c-2423-42f2-8f2d-ccf535fbb17c`::Granted request >Thread-2189::DEBUG::2013-03-01 14:04:52,730::task::794::TaskManager.Task::(resourceAcquired) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2189::DEBUG::2013-03-01 14:04:52,731::task::957::TaskManager.Task::(_decref) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::ref 1 aborting False >Thread-2189::DEBUG::2013-03-01 14:04:52,731::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`d5d18971-e8bd-4462-9e2d-9314f5a5d35c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2189::DEBUG::2013-03-01 14:04:52,731::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' for lock type 'exclusive' >Thread-2189::DEBUG::2013-03-01 14:04:52,732::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free. Now locking as 'exclusive' (1 active user) >Thread-2189::DEBUG::2013-03-01 14:04:52,732::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`d5d18971-e8bd-4462-9e2d-9314f5a5d35c`::Granted request >Thread-2189::DEBUG::2013-03-01 14:04:52,733::task::794::TaskManager.Task::(resourceAcquired) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::_resourcesAcquired: Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc (exclusive) >Thread-2189::DEBUG::2013-03-01 14:04:52,733::task::957::TaskManager.Task::(_decref) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::ref 1 aborting False >Thread-2189::INFO::2013-03-01 14:04:52,733::sp::984::Storage.StoragePool::(detachSD) sdUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-2189::DEBUG::2013-03-01 14:04:52,733::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2189::DEBUG::2013-03-01 14:04:52,734::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2189::DEBUG::2013-03-01 14:04:52,734::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2189::DEBUG::2013-03-01 14:04:52,734::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2189::DEBUG::2013-03-01 14:04:52,735::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2189::DEBUG::2013-03-01 14:04:52,755::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2189::DEBUG::2013-03-01 14:04:52,756::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:52,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:53,763::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:53,766::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:53,769::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-2190::DEBUG::2013-03-01 14:04:54,012::task::568::TaskManager.Task::(_updateState) Task=`2bd9b63a-27d4-4b36-9a86-05af2217ad96`::moving from state init -> state preparing >Thread-2190::INFO::2013-03-01 14:04:54,012::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2190::INFO::2013-03-01 14:04:54,013::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.459074020386', 'lastCheck': '1.7', 'code': 0, 'valid': True}} >Thread-2190::DEBUG::2013-03-01 14:04:54,013::task::1151::TaskManager.Task::(prepare) Task=`2bd9b63a-27d4-4b36-9a86-05af2217ad96`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.459074020386', 'lastCheck': '1.7', 'code': 0, 'valid': True}} >Thread-2190::DEBUG::2013-03-01 14:04:54,013::task::568::TaskManager.Task::(_updateState) Task=`2bd9b63a-27d4-4b36-9a86-05af2217ad96`::moving from state preparing -> state finished >Thread-2190::DEBUG::2013-03-01 14:04:54,013::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2190::DEBUG::2013-03-01 14:04:54,014::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2190::DEBUG::2013-03-01 14:04:54,014::task::957::TaskManager.Task::(_decref) Task=`2bd9b63a-27d4-4b36-9a86-05af2217ad96`::ref 0 aborting False >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:54,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:54,776::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2189::DEBUG::2013-03-01 14:04:54,779::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2189::DEBUG::2013-03-01 14:04:56,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2189::DEBUG::2013-03-01 14:04:57,806::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2189::DEBUG::2013-03-01 14:04:57,807::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,807::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,807::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,808::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,808::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,808::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,809::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2189::DEBUG::2013-03-01 14:04:57,809::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:57,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-2189::DEBUG::2013-03-01 14:04:58,035::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-2189::WARNING::2013-03-01 14:04:58,036::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-2189::DEBUG::2013-03-01 14:04:58,036::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2189::DEBUG::2013-03-01 14:04:58,074::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2189::DEBUG::2013-03-01 14:04:58,074::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2189::DEBUG::2013-03-01 14:04:58,078::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-2189::DEBUG::2013-03-01 14:04:58,080::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2189::WARNING::2013-03-01 14:04:58,080::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-2189::WARNING::2013-03-01 14:04:58,080::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-2189::DEBUG::2013-03-01 14:04:58,081::clusterlock::81::SafeLease::(acquireHostId) Host id for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc successfully acquired (id: 1) >Thread-2189::DEBUG::2013-03-01 14:04:58,081::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2189::DEBUG::2013-03-01 14:04:58,082::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start edd0d33d-dba0-4943-9c48-6112a2ddcdfc 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-2189::DEBUG::2013-03-01 14:05:00,186::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2189::DEBUG::2013-03-01 14:05:00,187::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-2189::DEBUG::2013-03-01 14:05:00,191::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4e71fcb469241e9aa23675ddea6f748f6b7f42ef'] >Thread-2189::DEBUG::2013-03-01 14:05:00,192::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2189::DEBUG::2013-03-01 14:05:00,192::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-2189::DEBUG::2013-03-01 14:05:00,192::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-2189::DEBUG::2013-03-01 14:05:00,193::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2189::DEBUG::2013-03-01 14:05:00,193::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8911a7db9cbbe5333609fa055adbead85bb01744'] >Thread-2189::DEBUG::2013-03-01 14:05:00,274::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2189::INFO::2013-03-01 14:05:00,274::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2189::DEBUG::2013-03-01 14:05:00,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd /usr/libexec/vdsm) >Thread-2189::DEBUG::2013-03-01 14:05:01,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2189::DEBUG::2013-03-01 14:05:01,386::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-2189::DEBUG::2013-03-01 14:05:01,386::clusterlock::85::SafeLease::(releaseHostId) Host id for domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc released successfully (id: 1) >Thread-2189::WARNING::2013-03-01 14:05:01,386::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `edd0d33d-dba0-4943-9c48-6112a2ddcdfc` >Thread-2189::DEBUG::2013-03-01 14:05:01,387::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2189::DEBUG::2013-03-01 14:05:01,387::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2189::DEBUG::2013-03-01 14:05:01,388::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9c08a6cc1a00c49d606eac7bbde3046a27fcbe8d'] >Thread-2189::DEBUG::2013-03-01 14:05:01,449::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2189::DEBUG::2013-03-01 14:05:01,449::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2189::DEBUG::2013-03-01 14:05:01,450::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2189::DEBUG::2013-03-01 14:05:01,450::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2189::DEBUG::2013-03-01 14:05:01,450::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `edd0d33d-dba0-4943-9c48-6112a2ddcdfc` is done >Thread-2189::INFO::2013-03-01 14:05:01,451::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-2189::DEBUG::2013-03-01 14:05:01,451::task::1151::TaskManager.Task::(prepare) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::finished: None >Thread-2189::DEBUG::2013-03-01 14:05:01,451::task::568::TaskManager.Task::(_updateState) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::moving from state preparing -> state finished >Thread-2189::DEBUG::2013-03-01 14:05:01,452::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc': < ResourceRef 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', isValid: 'True' obj: 'None'>, 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2189::DEBUG::2013-03-01 14:05:01,452::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2189::DEBUG::2013-03-01 14:05:01,452::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' >Thread-2189::DEBUG::2013-03-01 14:05:01,453::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (0 active users) >Thread-2189::DEBUG::2013-03-01 14:05:01,453::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free, finding out if anyone is waiting for it. >Thread-2189::DEBUG::2013-03-01 14:05:01,453::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', Clearing records. >Thread-2189::DEBUG::2013-03-01 14:05:01,454::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2189::DEBUG::2013-03-01 14:05:01,454::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2189::DEBUG::2013-03-01 14:05:01,454::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2189::DEBUG::2013-03-01 14:05:01,455::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2189::DEBUG::2013-03-01 14:05:01,455::task::957::TaskManager.Task::(_decref) Task=`473ce38d-fd97-446d-a22a-7f7f39220655`::ref 0 aborting False >Thread-2212::DEBUG::2013-03-01 14:05:01,503::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2212::DEBUG::2013-03-01 14:05:01,504::task::568::TaskManager.Task::(_updateState) Task=`79e4d51a-4a4d-4046-921c-7180156825fb`::moving from state init -> state preparing >Thread-2212::INFO::2013-03-01 14:05:01,504::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-2212::DEBUG::2013-03-01 14:05:01,505::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`51e889ad-9acd-44a7-85eb-4ab892ab24f7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2212::DEBUG::2013-03-01 14:05:01,505::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2212::DEBUG::2013-03-01 14:05:01,506::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'shared' (1 active user) >Thread-2212::DEBUG::2013-03-01 14:05:01,506::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`51e889ad-9acd-44a7-85eb-4ab892ab24f7`::Granted request >Thread-2212::DEBUG::2013-03-01 14:05:01,506::task::794::TaskManager.Task::(resourceAcquired) Task=`79e4d51a-4a4d-4046-921c-7180156825fb`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2212::DEBUG::2013-03-01 14:05:01,507::task::957::TaskManager.Task::(_decref) Task=`79e4d51a-4a4d-4046-921c-7180156825fb`::ref 1 aborting False >Thread-2212::INFO::2013-03-01 14:05:01,507::fileSD::302::Storage.StorageDomain::(validate) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2212::DEBUG::2013-03-01 14:05:01,531::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9c08a6cc1a00c49d606eac7bbde3046a27fcbe8d'] >Thread-2212::DEBUG::2013-03-01 14:05:01,532::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:01,532::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:01,533::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:01,533::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:01,533::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:01,534::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:01,534::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2212::DEBUG::2013-03-01 14:05:01,534::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2212::DEBUG::2013-03-01 14:05:01,535::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2212::DEBUG::2013-03-01 14:05:01,535::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2212::DEBUG::2013-03-01 14:05:01,535::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2212::DEBUG::2013-03-01 14:05:01,552::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2212::DEBUG::2013-03-01 14:05:01,552::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:01,555::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-2213::DEBUG::2013-03-01 14:05:02,118::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2213::DEBUG::2013-03-01 14:05:02,132::task::568::TaskManager.Task::(_updateState) Task=`95af1226-5746-4af0-b29a-01c4c468f469`::moving from state init -> state preparing >Thread-2213::INFO::2013-03-01 14:05:02,132::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:02,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:03,564::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:03,567::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:04,571::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:05,575::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2212::DEBUG::2013-03-01 14:05:05,578::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2212::DEBUG::2013-03-01 14:05:07,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2212::DEBUG::2013-03-01 14:05:08,687::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2212::DEBUG::2013-03-01 14:05:08,688::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,688::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,689::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,689::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,689::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,690::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,690::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2212::DEBUG::2013-03-01 14:05:08,690::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,692::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-2212::DEBUG::2013-03-01 14:05:08,922::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-2212::WARNING::2013-03-01 14:05:08,923::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-2212::DEBUG::2013-03-01 14:05:08,924::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:08,973::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2212::DEBUG::2013-03-01 14:05:08,973::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2212::DEBUG::2013-03-01 14:05:09,000::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9c08a6cc1a00c49d606eac7bbde3046a27fcbe8d'] >Thread-2212::DEBUG::2013-03-01 14:05:09,007::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2212::WARNING::2013-03-01 14:05:09,007::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-2212::WARNING::2013-03-01 14:05:09,007::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-2213::INFO::2013-03-01 14:05:09,010::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2212::DEBUG::2013-03-01 14:05:09,011::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-2213::DEBUG::2013-03-01 14:05:09,013::task::1151::TaskManager.Task::(prepare) Task=`95af1226-5746-4af0-b29a-01c4c468f469`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-2212::DEBUG::2013-03-01 14:05:09,013::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2213::DEBUG::2013-03-01 14:05:09,016::task::568::TaskManager.Task::(_updateState) Task=`95af1226-5746-4af0-b29a-01c4c468f469`::moving from state preparing -> state finished >Thread-2212::DEBUG::2013-03-01 14:05:09,016::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2213::DEBUG::2013-03-01 14:05:09,019::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2212::DEBUG::2013-03-01 14:05:09,021::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2213::DEBUG::2013-03-01 14:05:09,022::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2212::WARNING::2013-03-01 14:05:09,024::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d already exists >Thread-2213::DEBUG::2013-03-01 14:05:09,025::task::957::TaskManager.Task::(_decref) Task=`95af1226-5746-4af0-b29a-01c4c468f469`::ref 0 aborting False >Thread-2212::DEBUG::2013-03-01 14:05:09,029::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2212::DEBUG::2013-03-01 14:05:09,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-2235::DEBUG::2013-03-01 14:05:09,067::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2235::DEBUG::2013-03-01 14:05:09,068::task::568::TaskManager.Task::(_updateState) Task=`cf6d2208-69ba-419b-920b-c37d46896a9b`::moving from state init -> state preparing >Thread-2235::INFO::2013-03-01 14:05:09,069::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2235::DEBUG::2013-03-01 14:05:09,069::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`df8e6591-1137-4628-8159-1a9fd4e99b4b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2235::DEBUG::2013-03-01 14:05:09,069::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'shared' >Thread-2235::DEBUG::2013-03-01 14:05:09,070::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-2235::DEBUG::2013-03-01 14:05:09,070::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`df8e6591-1137-4628-8159-1a9fd4e99b4b`::Granted request >Thread-2235::DEBUG::2013-03-01 14:05:09,071::task::794::TaskManager.Task::(resourceAcquired) Task=`cf6d2208-69ba-419b-920b-c37d46896a9b`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (shared) >Thread-2235::DEBUG::2013-03-01 14:05:09,071::task::957::TaskManager.Task::(_decref) Task=`cf6d2208-69ba-419b-920b-c37d46896a9b`::ref 1 aborting False >Thread-2235::INFO::2013-03-01 14:05:09,081::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942486323200', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-2235::DEBUG::2013-03-01 14:05:09,082::task::1151::TaskManager.Task::(prepare) Task=`cf6d2208-69ba-419b-920b-c37d46896a9b`::finished: {'info': {'spm_id': 1, 'master_uuid': '0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'name': 'nfsStorageTest', 'version': '3', 'domains': '0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'status': 'Active', 'diskfree': '942486323200', 'alerts': [], 'disktotal': '1098974756864'}}} >Thread-2235::DEBUG::2013-03-01 14:05:09,084::task::568::TaskManager.Task::(_updateState) Task=`cf6d2208-69ba-419b-920b-c37d46896a9b`::moving from state preparing -> state finished >Thread-2235::DEBUG::2013-03-01 14:05:09,084::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2235::DEBUG::2013-03-01 14:05:09,084::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2235::DEBUG::2013-03-01 14:05:09,085::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2235::DEBUG::2013-03-01 14:05:09,085::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (1 active users) >Thread-2235::DEBUG::2013-03-01 14:05:09,086::task::957::TaskManager.Task::(_decref) Task=`cf6d2208-69ba-419b-920b-c37d46896a9b`::ref 0 aborting False >Thread-2212::DEBUG::2013-03-01 14:05:09,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-2212::DEBUG::2013-03-01 14:05:09,194::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2212::INFO::2013-03-01 14:05:09,253::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2212::INFO::2013-03-01 14:05:09,254::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-2212::INFO::2013-03-01 14:05:09,255::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-2212::DEBUG::2013-03-01 14:05:09,255::task::1151::TaskManager.Task::(prepare) Task=`79e4d51a-4a4d-4046-921c-7180156825fb`::finished: None >Thread-2212::DEBUG::2013-03-01 14:05:09,255::task::568::TaskManager.Task::(_updateState) Task=`79e4d51a-4a4d-4046-921c-7180156825fb`::moving from state preparing -> state finished >Thread-2212::DEBUG::2013-03-01 14:05:09,255::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2212::DEBUG::2013-03-01 14:05:09,256::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2212::DEBUG::2013-03-01 14:05:09,256::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2212::DEBUG::2013-03-01 14:05:09,256::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2212::DEBUG::2013-03-01 14:05:09,257::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2212::DEBUG::2013-03-01 14:05:09,257::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2212::DEBUG::2013-03-01 14:05:09,257::task::957::TaskManager.Task::(_decref) Task=`79e4d51a-4a4d-4046-921c-7180156825fb`::ref 0 aborting False >Thread-2261::DEBUG::2013-03-01 14:05:09,296::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2261::DEBUG::2013-03-01 14:05:09,297::task::568::TaskManager.Task::(_updateState) Task=`64646969-1d32-4cee-b85c-e35877117c21`::moving from state init -> state preparing >Thread-2261::INFO::2013-03-01 14:05:09,297::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2261::DEBUG::2013-03-01 14:05:09,298::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-2261::DEBUG::2013-03-01 14:05:09,331::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2261::DEBUG::2013-03-01 14:05:09,331::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2261::DEBUG::2013-03-01 14:05:09,332::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2261::DEBUG::2013-03-01 14:05:09,332::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2261::DEBUG::2013-03-01 14:05:09,332::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2261::DEBUG::2013-03-01 14:05:09,347::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2261::DEBUG::2013-03-01 14:05:09,348::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:09,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:10,355::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:11,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:11,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:11,365::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:12,369::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2261::DEBUG::2013-03-01 14:05:13,373::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2263::DEBUG::2013-03-01 14:05:15,131::task::568::TaskManager.Task::(_updateState) Task=`238f99c6-f693-45bb-a156-4681776c3d73`::moving from state init -> state preparing >Thread-2263::INFO::2013-03-01 14:05:15,131::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2263::INFO::2013-03-01 14:05:15,132::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.024209022522', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-2263::DEBUG::2013-03-01 14:05:15,132::task::1151::TaskManager.Task::(prepare) Task=`238f99c6-f693-45bb-a156-4681776c3d73`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.024209022522', 'lastCheck': '6.0', 'code': 0, 'valid': True}} >Thread-2263::DEBUG::2013-03-01 14:05:15,132::task::568::TaskManager.Task::(_updateState) Task=`238f99c6-f693-45bb-a156-4681776c3d73`::moving from state preparing -> state finished >Thread-2263::DEBUG::2013-03-01 14:05:15,132::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2263::DEBUG::2013-03-01 14:05:15,132::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2263::DEBUG::2013-03-01 14:05:15,133::task::957::TaskManager.Task::(_decref) Task=`238f99c6-f693-45bb-a156-4681776c3d73`::ref 0 aborting False >Thread-2261::DEBUG::2013-03-01 14:05:15,377::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2261::DEBUG::2013-03-01 14:05:16,441::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2261::DEBUG::2013-03-01 14:05:16,442::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2261::DEBUG::2013-03-01 14:05:16,442::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2261::DEBUG::2013-03-01 14:05:16,443::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2261::DEBUG::2013-03-01 14:05:16,443::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2261::DEBUG::2013-03-01 14:05:16,444::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2261::DEBUG::2013-03-01 14:05:16,444::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2261::DEBUG::2013-03-01 14:05:16,444::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2261::INFO::2013-03-01 14:05:16,445::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2261::DEBUG::2013-03-01 14:05:16,445::task::1151::TaskManager.Task::(prepare) Task=`64646969-1d32-4cee-b85c-e35877117c21`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2261::DEBUG::2013-03-01 14:05:16,445::task::568::TaskManager.Task::(_updateState) Task=`64646969-1d32-4cee-b85c-e35877117c21`::moving from state preparing -> state finished >Thread-2261::DEBUG::2013-03-01 14:05:16,445::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2261::DEBUG::2013-03-01 14:05:16,446::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2261::DEBUG::2013-03-01 14:05:16,446::task::957::TaskManager.Task::(_decref) Task=`64646969-1d32-4cee-b85c-e35877117c21`::ref 0 aborting False >Thread-2265::DEBUG::2013-03-01 14:05:17,493::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2265::DEBUG::2013-03-01 14:05:17,494::task::568::TaskManager.Task::(_updateState) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::moving from state init -> state preparing >Thread-2265::INFO::2013-03-01 14:05:17,494::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-2265::DEBUG::2013-03-01 14:05:17,495::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`ee78c536-245c-4e20-822c-690c6aa6c852`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2265::DEBUG::2013-03-01 14:05:17,495::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2265::DEBUG::2013-03-01 14:05:17,496::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2265::DEBUG::2013-03-01 14:05:17,496::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`ee78c536-245c-4e20-822c-690c6aa6c852`::Granted request >Thread-2265::DEBUG::2013-03-01 14:05:17,497::task::794::TaskManager.Task::(resourceAcquired) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2265::DEBUG::2013-03-01 14:05:17,497::task::957::TaskManager.Task::(_decref) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::ref 1 aborting False >Thread-2265::DEBUG::2013-03-01 14:05:17,497::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`4071a2aa-41bb-4078-b878-85d4689c90af`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2265::DEBUG::2013-03-01 14:05:17,498::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >Thread-2265::DEBUG::2013-03-01 14:05:17,498::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >Thread-2265::DEBUG::2013-03-01 14:05:17,498::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`4071a2aa-41bb-4078-b878-85d4689c90af`::Granted request >Thread-2265::DEBUG::2013-03-01 14:05:17,499::task::794::TaskManager.Task::(resourceAcquired) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::_resourcesAcquired: Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc (exclusive) >Thread-2265::DEBUG::2013-03-01 14:05:17,499::task::957::TaskManager.Task::(_decref) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::ref 1 aborting False >Thread-2265::INFO::2013-03-01 14:05:17,499::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-2265::INFO::2013-03-01 14:05:17,500::sp::1103::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2265::INFO::2013-03-01 14:05:17,500::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-2265::DEBUG::2013-03-01 14:05:17,500::task::1151::TaskManager.Task::(prepare) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::finished: None >Thread-2265::DEBUG::2013-03-01 14:05:17,501::task::568::TaskManager.Task::(_updateState) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::moving from state preparing -> state finished >Thread-2265::DEBUG::2013-03-01 14:05:17,501::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc': < ResourceRef 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', isValid: 'True' obj: 'None'>} >Thread-2265::DEBUG::2013-03-01 14:05:17,501::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2265::DEBUG::2013-03-01 14:05:17,502::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2265::DEBUG::2013-03-01 14:05:17,502::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2265::DEBUG::2013-03-01 14:05:17,502::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2265::DEBUG::2013-03-01 14:05:17,502::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2265::DEBUG::2013-03-01 14:05:17,503::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >Thread-2265::DEBUG::2013-03-01 14:05:17,503::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >Thread-2265::DEBUG::2013-03-01 14:05:17,503::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >Thread-2265::DEBUG::2013-03-01 14:05:17,504::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >Thread-2265::DEBUG::2013-03-01 14:05:17,504::task::957::TaskManager.Task::(_decref) Task=`4dbe2b8c-e886-42da-8f32-48049de84074`::ref 0 aborting False >Thread-2266::DEBUG::2013-03-01 14:05:17,537::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2266::DEBUG::2013-03-01 14:05:17,538::task::568::TaskManager.Task::(_updateState) Task=`5924297b-4ce4-4122-b112-212dbbba1f15`::moving from state init -> state preparing >Thread-2266::INFO::2013-03-01 14:05:17,538::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-2266::DEBUG::2013-03-01 14:05:17,538::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-2266::DEBUG::2013-03-01 14:05:17,538::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-2266::INFO::2013-03-01 14:05:17,539::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-2266::DEBUG::2013-03-01 14:05:17,539::task::1151::TaskManager.Task::(prepare) Task=`5924297b-4ce4-4122-b112-212dbbba1f15`::finished: {'allTasksStatus': {}} >Thread-2266::DEBUG::2013-03-01 14:05:17,539::task::568::TaskManager.Task::(_updateState) Task=`5924297b-4ce4-4122-b112-212dbbba1f15`::moving from state preparing -> state finished >Thread-2266::DEBUG::2013-03-01 14:05:17,539::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2266::DEBUG::2013-03-01 14:05:17,540::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2266::DEBUG::2013-03-01 14:05:17,540::task::957::TaskManager.Task::(_decref) Task=`5924297b-4ce4-4122-b112-212dbbba1f15`::ref 0 aborting False >Thread-2267::DEBUG::2013-03-01 14:05:17,565::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2267::DEBUG::2013-03-01 14:05:17,565::task::568::TaskManager.Task::(_updateState) Task=`9d20ddb3-e44a-4525-bd4f-624e1ca67223`::moving from state init -> state preparing >Thread-2267::INFO::2013-03-01 14:05:17,566::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2267::DEBUG::2013-03-01 14:05:17,566::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`e3f9efc2-fcda-4441-8121-7167cc2c08be`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2267::DEBUG::2013-03-01 14:05:17,566::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2267::DEBUG::2013-03-01 14:05:17,567::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2267::DEBUG::2013-03-01 14:05:17,567::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`e3f9efc2-fcda-4441-8121-7167cc2c08be`::Granted request >Thread-2267::DEBUG::2013-03-01 14:05:17,568::task::794::TaskManager.Task::(resourceAcquired) Task=`9d20ddb3-e44a-4525-bd4f-624e1ca67223`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2267::DEBUG::2013-03-01 14:05:17,568::task::957::TaskManager.Task::(_decref) Task=`9d20ddb3-e44a-4525-bd4f-624e1ca67223`::ref 1 aborting False >Thread-2267::DEBUG::2013-03-01 14:05:17,568::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-2267::DEBUG::2013-03-01 14:05:17,569::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`17e2cd49-137c-4c1c-be4e-69b974100976`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2267::DEBUG::2013-03-01 14:05:17,569::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2267::DEBUG::2013-03-01 14:05:17,569::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2267::DEBUG::2013-03-01 14:05:17,570::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`17e2cd49-137c-4c1c-be4e-69b974100976`::Granted request >Thread-2267::DEBUG::2013-03-01 14:05:17,570::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2267::DEBUG::2013-03-01 14:05:17,571::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2267::DEBUG::2013-03-01 14:05:17,571::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2267::DEBUG::2013-03-01 14:05:17,571::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2267::DEBUG::2013-03-01 14:05:17,576::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,593::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,596::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,598::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,601::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,603::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,606::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,609::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,611::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,614::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,616::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,619::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,622::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,624::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,627::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,629::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,632::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,635::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,637::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,640::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,643::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,645::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,648::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,650::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,653::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,656::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,658::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,661::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,664::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,666::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,669::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,671::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,674::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,677::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,679::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,682::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-2267::DEBUG::2013-03-01 14:05:17,682::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2267::DEBUG::2013-03-01 14:05:17,683::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2267::DEBUG::2013-03-01 14:05:17,683::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=201580bb4c9044f8c2b2dfa195d399ad0f2527b8'] >Thread-2267::DEBUG::2013-03-01 14:05:17,744::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2267::INFO::2013-03-01 14:05:17,744::clusterlock::252::SANLock::(release) Releasing cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2267::DEBUG::2013-03-01 14:05:17,775::clusterlock::263::SANLock::(release) Cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully released >Thread-2267::INFO::2013-03-01 14:05:17,775::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-2267::DEBUG::2013-03-01 14:05:17,775::task::1151::TaskManager.Task::(prepare) Task=`9d20ddb3-e44a-4525-bd4f-624e1ca67223`::finished: None >Thread-2267::DEBUG::2013-03-01 14:05:17,776::task::568::TaskManager.Task::(_updateState) Task=`9d20ddb3-e44a-4525-bd4f-624e1ca67223`::moving from state preparing -> state finished >Thread-2267::DEBUG::2013-03-01 14:05:17,776::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2267::DEBUG::2013-03-01 14:05:17,776::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2267::DEBUG::2013-03-01 14:05:17,777::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2267::DEBUG::2013-03-01 14:05:17,777::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2267::DEBUG::2013-03-01 14:05:17,777::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2267::DEBUG::2013-03-01 14:05:17,777::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2267::DEBUG::2013-03-01 14:05:17,778::task::957::TaskManager.Task::(_decref) Task=`9d20ddb3-e44a-4525-bd4f-624e1ca67223`::ref 0 aborting False >Thread-2268::DEBUG::2013-03-01 14:05:17,812::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2268::DEBUG::2013-03-01 14:05:17,813::task::568::TaskManager.Task::(_updateState) Task=`49479f16-5458-49a9-8925-e18753920fb7`::moving from state init -> state preparing >Thread-2268::INFO::2013-03-01 14:05:17,813::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', hostID=1, scsiKey='35b6dfb7-cf75-44b4-9bc5-c190faab989d', remove=False, options=None) >Thread-2268::DEBUG::2013-03-01 14:05:17,814::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`4393e930-991d-4a8b-a00f-14b51fdf0563`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2268::DEBUG::2013-03-01 14:05:17,814::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2268::DEBUG::2013-03-01 14:05:17,815::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2268::DEBUG::2013-03-01 14:05:17,815::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`4393e930-991d-4a8b-a00f-14b51fdf0563`::Granted request >Thread-2268::DEBUG::2013-03-01 14:05:17,815::task::794::TaskManager.Task::(resourceAcquired) Task=`49479f16-5458-49a9-8925-e18753920fb7`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2268::DEBUG::2013-03-01 14:05:17,816::task::957::TaskManager.Task::(_decref) Task=`49479f16-5458-49a9-8925-e18753920fb7`::ref 1 aborting False >Thread-2268::INFO::2013-03-01 14:05:17,816::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-1429::DEBUG::2013-03-01 14:05:17,817::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-1429::INFO::2013-03-01 14:05:17,817::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >Thread-1429::DEBUG::2013-03-01 14:05:19,818::clusterlock::206::SANLock::(releaseHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc released successfully (id: 1) >Thread-2268::INFO::2013-03-01 14:05:19,819::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-2268::DEBUG::2013-03-01 14:05:19,819::task::1151::TaskManager.Task::(prepare) Task=`49479f16-5458-49a9-8925-e18753920fb7`::finished: True >Thread-2268::DEBUG::2013-03-01 14:05:19,819::task::568::TaskManager.Task::(_updateState) Task=`49479f16-5458-49a9-8925-e18753920fb7`::moving from state preparing -> state finished >Thread-2268::DEBUG::2013-03-01 14:05:19,819::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >Thread-2268::DEBUG::2013-03-01 14:05:19,820::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2268::DEBUG::2013-03-01 14:05:19,820::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2268::DEBUG::2013-03-01 14:05:19,820::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2268::DEBUG::2013-03-01 14:05:19,820::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2268::DEBUG::2013-03-01 14:05:19,821::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2268::DEBUG::2013-03-01 14:05:19,821::task::957::TaskManager.Task::(_decref) Task=`49479f16-5458-49a9-8925-e18753920fb7`::ref 0 aborting False >Thread-2270::DEBUG::2013-03-01 14:05:19,854::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2270::DEBUG::2013-03-01 14:05:19,854::task::568::TaskManager.Task::(_updateState) Task=`8c338693-0f15-47ea-b66d-b8007d395a16`::moving from state init -> state preparing >Thread-2270::INFO::2013-03-01 14:05:19,854::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2270::DEBUG::2013-03-01 14:05:19,855::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-2270::DEBUG::2013-03-01 14:05:19,894::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2270::DEBUG::2013-03-01 14:05:19,894::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2270::DEBUG::2013-03-01 14:05:19,895::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2270::DEBUG::2013-03-01 14:05:19,895::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2270::DEBUG::2013-03-01 14:05:19,895::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2270::DEBUG::2013-03-01 14:05:19,910::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2270::DEBUG::2013-03-01 14:05:19,911::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:19,914::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:20,918::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:21,922::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:22,927::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:23,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:24,935::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2270::DEBUG::2013-03-01 14:05:24,938::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2270::DEBUG::2013-03-01 14:05:27,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2270::DEBUG::2013-03-01 14:05:28,069::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2270::DEBUG::2013-03-01 14:05:28,070::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2270::DEBUG::2013-03-01 14:05:28,070::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2270::DEBUG::2013-03-01 14:05:28,070::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2270::DEBUG::2013-03-01 14:05:28,071::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2270::DEBUG::2013-03-01 14:05:28,071::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2270::DEBUG::2013-03-01 14:05:28,071::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2270::DEBUG::2013-03-01 14:05:28,072::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2270::INFO::2013-03-01 14:05:28,072::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2270::DEBUG::2013-03-01 14:05:28,072::task::1151::TaskManager.Task::(prepare) Task=`8c338693-0f15-47ea-b66d-b8007d395a16`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2270::DEBUG::2013-03-01 14:05:28,073::task::568::TaskManager.Task::(_updateState) Task=`8c338693-0f15-47ea-b66d-b8007d395a16`::moving from state preparing -> state finished >Thread-2270::DEBUG::2013-03-01 14:05:28,073::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2270::DEBUG::2013-03-01 14:05:28,073::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2270::DEBUG::2013-03-01 14:05:28,074::task::957::TaskManager.Task::(_decref) Task=`8c338693-0f15-47ea-b66d-b8007d395a16`::ref 0 aborting False >Thread-2274::DEBUG::2013-03-01 14:05:29,226::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2274::DEBUG::2013-03-01 14:05:29,227::task::568::TaskManager.Task::(_updateState) Task=`df02ec7e-7d9e-4f55-a878-1a7e6c22a2fe`::moving from state init -> state preparing >Thread-2274::INFO::2013-03-01 14:05:29,227::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2274::INFO::2013-03-01 14:05:29,227::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2274::DEBUG::2013-03-01 14:05:29,228::task::1151::TaskManager.Task::(prepare) Task=`df02ec7e-7d9e-4f55-a878-1a7e6c22a2fe`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2274::DEBUG::2013-03-01 14:05:29,228::task::568::TaskManager.Task::(_updateState) Task=`df02ec7e-7d9e-4f55-a878-1a7e6c22a2fe`::moving from state preparing -> state finished >Thread-2274::DEBUG::2013-03-01 14:05:29,228::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2274::DEBUG::2013-03-01 14:05:29,228::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2274::DEBUG::2013-03-01 14:05:29,228::task::957::TaskManager.Task::(_decref) Task=`df02ec7e-7d9e-4f55-a878-1a7e6c22a2fe`::ref 0 aborting False >Thread-2275::DEBUG::2013-03-01 14:05:29,258::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2275::DEBUG::2013-03-01 14:05:29,259::task::568::TaskManager.Task::(_updateState) Task=`c865a72b-07e5-42d4-b575-3c541f136a4e`::moving from state init -> state preparing >Thread-2275::INFO::2013-03-01 14:05:29,259::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2275::DEBUG::2013-03-01 14:05:29,262::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-2275::INFO::2013-03-01 14:05:29,306::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2275::DEBUG::2013-03-01 14:05:29,307::task::1151::TaskManager.Task::(prepare) Task=`c865a72b-07e5-42d4-b575-3c541f136a4e`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2275::DEBUG::2013-03-01 14:05:29,307::task::568::TaskManager.Task::(_updateState) Task=`c865a72b-07e5-42d4-b575-3c541f136a4e`::moving from state preparing -> state finished >Thread-2275::DEBUG::2013-03-01 14:05:29,307::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2275::DEBUG::2013-03-01 14:05:29,308::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2275::DEBUG::2013-03-01 14:05:29,308::task::957::TaskManager.Task::(_decref) Task=`c865a72b-07e5-42d4-b575-3c541f136a4e`::ref 0 aborting False >Thread-2276::DEBUG::2013-03-01 14:05:29,346::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2276::DEBUG::2013-03-01 14:05:29,346::task::568::TaskManager.Task::(_updateState) Task=`5f3239ab-7d28-49d3-b638-08c50a24383d`::moving from state init -> state preparing >Thread-2276::INFO::2013-03-01 14:05:29,347::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', hostID=1, scsiKey='35b6dfb7-cf75-44b4-9bc5-c190faab989d', msdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', masterVersion=1, options=None) >Thread-2276::DEBUG::2013-03-01 14:05:29,348::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`ebf28254-669b-4b80-9e96-8e5a97a86e33`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2276::DEBUG::2013-03-01 14:05:29,348::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2276::DEBUG::2013-03-01 14:05:29,348::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2276::DEBUG::2013-03-01 14:05:29,349::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`ebf28254-669b-4b80-9e96-8e5a97a86e33`::Granted request >Thread-2276::INFO::2013-03-01 14:05:29,349::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 35b6dfb7-cf75-44b4-9bc5-c190faab989d with master domain: 0de0ade6-8103-4d0e-b5cc-88c1447338cc (ver = 1) >Thread-2276::DEBUG::2013-03-01 14:05:29,350::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:29,350::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:29,351::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:29,351::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:29,351::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:29,352::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:29,352::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2276::DEBUG::2013-03-01 14:05:29,352::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2276::DEBUG::2013-03-01 14:05:29,353::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2276::DEBUG::2013-03-01 14:05:29,353::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2276::DEBUG::2013-03-01 14:05:29,353::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2276::DEBUG::2013-03-01 14:05:29,368::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2276::DEBUG::2013-03-01 14:05:29,369::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:29,371::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-2277::DEBUG::2013-03-01 14:05:30,342::task::568::TaskManager.Task::(_updateState) Task=`4bf1273e-ca79-457c-ac37-4dd95b35ae89`::moving from state init -> state preparing >Thread-2277::INFO::2013-03-01 14:05:30,343::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2277::INFO::2013-03-01 14:05:30,343::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2277::DEBUG::2013-03-01 14:05:30,343::task::1151::TaskManager.Task::(prepare) Task=`4bf1273e-ca79-457c-ac37-4dd95b35ae89`::finished: {} >Thread-2277::DEBUG::2013-03-01 14:05:30,344::task::568::TaskManager.Task::(_updateState) Task=`4bf1273e-ca79-457c-ac37-4dd95b35ae89`::moving from state preparing -> state finished >Thread-2277::DEBUG::2013-03-01 14:05:30,344::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2277::DEBUG::2013-03-01 14:05:30,344::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2277::DEBUG::2013-03-01 14:05:30,345::task::957::TaskManager.Task::(_decref) Task=`4bf1273e-ca79-457c-ac37-4dd95b35ae89`::ref 0 aborting False >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:30,376::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:31,380::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:32,384::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:33,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:34,393::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2276::DEBUG::2013-03-01 14:05:35,397::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2276::DEBUG::2013-03-01 14:05:37,437::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2276::DEBUG::2013-03-01 14:05:38,505::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2276::DEBUG::2013-03-01 14:05:38,505::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,511::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,511::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,511::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,512::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,512::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,512::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2276::DEBUG::2013-03-01 14:05:38,513::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,514::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-2276::DEBUG::2013-03-01 14:05:38,753::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-2276::WARNING::2013-03-01 14:05:38,754::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-2276::DEBUG::2013-03-01 14:05:38,755::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,808::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2276::DEBUG::2013-03-01 14:05:38,809::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2276::DEBUG::2013-03-01 14:05:38,833::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=201580bb4c9044f8c2b2dfa195d399ad0f2527b8'] >Thread-2276::DEBUG::2013-03-01 14:05:38,846::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2276::WARNING::2013-03-01 14:05:38,846::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-2276::WARNING::2013-03-01 14:05:38,846::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-2276::DEBUG::2013-03-01 14:05:38,847::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc verified, version 1 >Thread-2276::DEBUG::2013-03-01 14:05:38,847::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2276::DEBUG::2013-03-01 14:05:38,847::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2276::DEBUG::2013-03-01 14:05:38,864::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=201580bb4c9044f8c2b2dfa195d399ad0f2527b8'] >Thread-2302::DEBUG::2013-03-01 14:05:38,865::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2276::DEBUG::2013-03-01 14:05:38,865::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` started monitoring domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >Thread-2276::DEBUG::2013-03-01 14:05:38,866::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2276::DEBUG::2013-03-01 14:05:38,869::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2276::DEBUG::2013-03-01 14:05:38,875::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-2302::INFO::2013-03-01 14:05:38,931::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >Thread-2302::DEBUG::2013-03-01 14:05:38,931::clusterlock::191::SANLock::(acquireHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1) >Thread-2276::DEBUG::2013-03-01 14:05:39,038::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-2276::DEBUG::2013-03-01 14:05:39,039::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2276::INFO::2013-03-01 14:05:39,096::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2276::INFO::2013-03-01 14:05:39,097::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc to /rhev/data-center/35b6dfb7-cf75-44b4-9bc5-c190faab989d/mastersd >Thread-2276::DEBUG::2013-03-01 14:05:39,097::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2276::DEBUG::2013-03-01 14:05:39,098::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2276::DEBUG::2013-03-01 14:05:39,098::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2276::DEBUG::2013-03-01 14:05:39,098::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2276::INFO::2013-03-01 14:05:39,099::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-2276::DEBUG::2013-03-01 14:05:39,099::task::1151::TaskManager.Task::(prepare) Task=`5f3239ab-7d28-49d3-b638-08c50a24383d`::finished: True >Thread-2276::DEBUG::2013-03-01 14:05:39,099::task::568::TaskManager.Task::(_updateState) Task=`5f3239ab-7d28-49d3-b638-08c50a24383d`::moving from state preparing -> state finished >Thread-2276::DEBUG::2013-03-01 14:05:39,099::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2276::DEBUG::2013-03-01 14:05:39,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2276::DEBUG::2013-03-01 14:05:39,100::task::957::TaskManager.Task::(_decref) Task=`5f3239ab-7d28-49d3-b638-08c50a24383d`::ref 0 aborting False >Thread-2327::DEBUG::2013-03-01 14:05:39,157::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2327::DEBUG::2013-03-01 14:05:39,158::task::568::TaskManager.Task::(_updateState) Task=`6243ad16-70ad-45fa-950d-2f128966a351`::moving from state init -> state preparing >Thread-2327::INFO::2013-03-01 14:05:39,158::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2327::INFO::2013-03-01 14:05:39,159::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-2327::DEBUG::2013-03-01 14:05:39,159::task::1151::TaskManager.Task::(prepare) Task=`6243ad16-70ad-45fa-950d-2f128966a351`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-2327::DEBUG::2013-03-01 14:05:39,159::task::568::TaskManager.Task::(_updateState) Task=`6243ad16-70ad-45fa-950d-2f128966a351`::moving from state preparing -> state finished >Thread-2327::DEBUG::2013-03-01 14:05:39,159::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2327::DEBUG::2013-03-01 14:05:39,160::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2327::DEBUG::2013-03-01 14:05:39,160::task::957::TaskManager.Task::(_decref) Task=`6243ad16-70ad-45fa-950d-2f128966a351`::ref 0 aborting False >Thread-2328::DEBUG::2013-03-01 14:05:39,191::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2328::DEBUG::2013-03-01 14:05:39,192::task::568::TaskManager.Task::(_updateState) Task=`26605088-d368-484f-bb07-7cefc43856ef`::moving from state init -> state preparing >Thread-2328::INFO::2013-03-01 14:05:39,192::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-2328::DEBUG::2013-03-01 14:05:39,193::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`462da300-39c0-4918-8d28-70da8e38a1d2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2328::DEBUG::2013-03-01 14:05:39,193::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2328::DEBUG::2013-03-01 14:05:39,193::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2328::DEBUG::2013-03-01 14:05:39,194::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`462da300-39c0-4918-8d28-70da8e38a1d2`::Granted request >Thread-2328::DEBUG::2013-03-01 14:05:39,194::task::794::TaskManager.Task::(resourceAcquired) Task=`26605088-d368-484f-bb07-7cefc43856ef`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2328::DEBUG::2013-03-01 14:05:39,195::task::957::TaskManager.Task::(_decref) Task=`26605088-d368-484f-bb07-7cefc43856ef`::ref 1 aborting False >Thread-2328::INFO::2013-03-01 14:05:39,195::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-2328::DEBUG::2013-03-01 14:05:39,195::task::1146::TaskManager.Task::(prepare) Task=`26605088-d368-484f-bb07-7cefc43856ef`::Prepare: 1 jobs exist, move to acquiring >Thread-2328::DEBUG::2013-03-01 14:05:39,195::task::568::TaskManager.Task::(_updateState) Task=`26605088-d368-484f-bb07-7cefc43856ef`::moving from state preparing -> state acquiring >Thread-2328::DEBUG::2013-03-01 14:05:39,196::task::568::TaskManager.Task::(_updateState) Task=`26605088-d368-484f-bb07-7cefc43856ef`::moving from state acquiring -> state queued >Thread-2328::DEBUG::2013-03-01 14:05:39,196::taskManager::50::TaskManager::(_queueTask) queuing task: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2328::DEBUG::2013-03-01 14:05:39,196::taskManager::56::TaskManager::(_queueTask) task queued: 26605088-d368-484f-bb07-7cefc43856ef >2aecfdc5-10ef-4b2f-aeea-21ac80a6eb45::DEBUG::2013-03-01 14:05:39,197::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-2328::DEBUG::2013-03-01 14:05:39,198::task::1148::TaskManager.Task::(prepare) Task=`26605088-d368-484f-bb07-7cefc43856ef`::returning >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,199::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 26605088-d368-484f-bb07-7cefc43856ef running: <bound method Task.commit of <storage.task.Task instance at 0x7fbb6812c5a8>> with: None >Thread-2328::DEBUG::2013-03-01 14:05:39,200::task::957::TaskManager.Task::(_decref) Task=`26605088-d368-484f-bb07-7cefc43856ef`::ref 0 aborting False >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,200::task::1159::TaskManager.Task::(commit) Task=`26605088-d368-484f-bb07-7cefc43856ef`::committing task: 26605088-d368-484f-bb07-7cefc43856ef >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,202::task::568::TaskManager.Task::(_updateState) Task=`26605088-d368-484f-bb07-7cefc43856ef`::moving from state queued -> state running >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,205::task::872::TaskManager.Task::(_runJobs) Task=`26605088-d368-484f-bb07-7cefc43856ef`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fbb780c4b50>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,205::task::304::TaskManager.Task::(run) Task=`26605088-d368-484f-bb07-7cefc43856ef`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fbb780c4b50>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,206::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,206::misc::1055::SamplingMethod::(__call__) Got in to sampling method >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,222::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=201580bb4c9044f8c2b2dfa195d399ad0f2527b8'] >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,223::misc::1063::SamplingMethod::(__call__) Returning last result >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:05:39,240::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=201580bb4c9044f8c2b2dfa195d399ad0f2527b8'] >26605088-d368-484f-bb07-7cefc43856ef::INFO::2013-03-01 14:05:39,241::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >Thread-2330::DEBUG::2013-03-01 14:05:40,231::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2330::DEBUG::2013-03-01 14:05:40,232::task::568::TaskManager.Task::(_updateState) Task=`cbb872ef-b0ad-4795-be20-b4853f991f39`::moving from state init -> state preparing >Thread-2330::INFO::2013-03-01 14:05:40,232::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2330::DEBUG::2013-03-01 14:05:40,232::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2330::DEBUG::2013-03-01 14:05:40,233::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2330::INFO::2013-03-01 14:05:40,233::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2330::DEBUG::2013-03-01 14:05:40,233::task::1151::TaskManager.Task::(prepare) Task=`cbb872ef-b0ad-4795-be20-b4853f991f39`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2330::DEBUG::2013-03-01 14:05:40,233::task::568::TaskManager.Task::(_updateState) Task=`cbb872ef-b0ad-4795-be20-b4853f991f39`::moving from state preparing -> state finished >Thread-2330::DEBUG::2013-03-01 14:05:40,234::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2330::DEBUG::2013-03-01 14:05:40,234::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2330::DEBUG::2013-03-01 14:05:40,234::task::957::TaskManager.Task::(_decref) Task=`cbb872ef-b0ad-4795-be20-b4853f991f39`::ref 0 aborting False >Thread-2331::DEBUG::2013-03-01 14:05:41,262::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2331::DEBUG::2013-03-01 14:05:41,262::task::568::TaskManager.Task::(_updateState) Task=`24e364c8-af21-4e3c-8560-3451e6517dd0`::moving from state init -> state preparing >Thread-2331::INFO::2013-03-01 14:05:41,263::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2331::DEBUG::2013-03-01 14:05:41,263::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2331::DEBUG::2013-03-01 14:05:41,263::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2331::INFO::2013-03-01 14:05:41,263::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2331::DEBUG::2013-03-01 14:05:41,263::task::1151::TaskManager.Task::(prepare) Task=`24e364c8-af21-4e3c-8560-3451e6517dd0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2331::DEBUG::2013-03-01 14:05:41,264::task::568::TaskManager.Task::(_updateState) Task=`24e364c8-af21-4e3c-8560-3451e6517dd0`::moving from state preparing -> state finished >Thread-2331::DEBUG::2013-03-01 14:05:41,264::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2331::DEBUG::2013-03-01 14:05:41,264::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2331::DEBUG::2013-03-01 14:05:41,264::task::957::TaskManager.Task::(_decref) Task=`24e364c8-af21-4e3c-8560-3451e6517dd0`::ref 0 aborting False >Thread-2332::DEBUG::2013-03-01 14:05:42,292::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2332::DEBUG::2013-03-01 14:05:42,292::task::568::TaskManager.Task::(_updateState) Task=`c4a9a253-ea24-4275-9f07-bbbdc9201cec`::moving from state init -> state preparing >Thread-2332::INFO::2013-03-01 14:05:42,293::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2332::DEBUG::2013-03-01 14:05:42,293::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2332::DEBUG::2013-03-01 14:05:42,293::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2332::INFO::2013-03-01 14:05:42,293::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2332::DEBUG::2013-03-01 14:05:42,294::task::1151::TaskManager.Task::(prepare) Task=`c4a9a253-ea24-4275-9f07-bbbdc9201cec`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2332::DEBUG::2013-03-01 14:05:42,294::task::568::TaskManager.Task::(_updateState) Task=`c4a9a253-ea24-4275-9f07-bbbdc9201cec`::moving from state preparing -> state finished >Thread-2332::DEBUG::2013-03-01 14:05:42,294::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2332::DEBUG::2013-03-01 14:05:42,294::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2332::DEBUG::2013-03-01 14:05:42,294::task::957::TaskManager.Task::(_decref) Task=`c4a9a253-ea24-4275-9f07-bbbdc9201cec`::ref 0 aborting False >Thread-2334::DEBUG::2013-03-01 14:05:43,323::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2334::DEBUG::2013-03-01 14:05:43,323::task::568::TaskManager.Task::(_updateState) Task=`f2b6febf-9c8e-4e18-839c-8b68f7fc2641`::moving from state init -> state preparing >Thread-2334::INFO::2013-03-01 14:05:43,323::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2334::DEBUG::2013-03-01 14:05:43,323::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2334::DEBUG::2013-03-01 14:05:43,324::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2334::INFO::2013-03-01 14:05:43,324::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2334::DEBUG::2013-03-01 14:05:43,324::task::1151::TaskManager.Task::(prepare) Task=`f2b6febf-9c8e-4e18-839c-8b68f7fc2641`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2334::DEBUG::2013-03-01 14:05:43,324::task::568::TaskManager.Task::(_updateState) Task=`f2b6febf-9c8e-4e18-839c-8b68f7fc2641`::moving from state preparing -> state finished >Thread-2334::DEBUG::2013-03-01 14:05:43,325::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2334::DEBUG::2013-03-01 14:05:43,325::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2334::DEBUG::2013-03-01 14:05:43,325::task::957::TaskManager.Task::(_decref) Task=`f2b6febf-9c8e-4e18-839c-8b68f7fc2641`::ref 0 aborting False >Thread-2335::DEBUG::2013-03-01 14:05:44,353::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2335::DEBUG::2013-03-01 14:05:44,353::task::568::TaskManager.Task::(_updateState) Task=`306b5b1c-dd57-484b-a1a7-8b536c1ab1e2`::moving from state init -> state preparing >Thread-2335::INFO::2013-03-01 14:05:44,354::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2335::DEBUG::2013-03-01 14:05:44,354::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2335::DEBUG::2013-03-01 14:05:44,354::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2335::INFO::2013-03-01 14:05:44,354::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2335::DEBUG::2013-03-01 14:05:44,354::task::1151::TaskManager.Task::(prepare) Task=`306b5b1c-dd57-484b-a1a7-8b536c1ab1e2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2335::DEBUG::2013-03-01 14:05:44,355::task::568::TaskManager.Task::(_updateState) Task=`306b5b1c-dd57-484b-a1a7-8b536c1ab1e2`::moving from state preparing -> state finished >Thread-2335::DEBUG::2013-03-01 14:05:44,355::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2335::DEBUG::2013-03-01 14:05:44,355::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2335::DEBUG::2013-03-01 14:05:44,355::task::957::TaskManager.Task::(_decref) Task=`306b5b1c-dd57-484b-a1a7-8b536c1ab1e2`::ref 0 aborting False >Thread-2336::DEBUG::2013-03-01 14:05:45,383::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2336::DEBUG::2013-03-01 14:05:45,383::task::568::TaskManager.Task::(_updateState) Task=`ef8bb1f8-ad82-43a9-b276-b564bad31ebc`::moving from state init -> state preparing >Thread-2336::INFO::2013-03-01 14:05:45,384::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2336::DEBUG::2013-03-01 14:05:45,384::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2336::DEBUG::2013-03-01 14:05:45,384::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2336::INFO::2013-03-01 14:05:45,384::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2336::DEBUG::2013-03-01 14:05:45,385::task::1151::TaskManager.Task::(prepare) Task=`ef8bb1f8-ad82-43a9-b276-b564bad31ebc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2336::DEBUG::2013-03-01 14:05:45,385::task::568::TaskManager.Task::(_updateState) Task=`ef8bb1f8-ad82-43a9-b276-b564bad31ebc`::moving from state preparing -> state finished >Thread-2336::DEBUG::2013-03-01 14:05:45,385::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2336::DEBUG::2013-03-01 14:05:45,385::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2336::DEBUG::2013-03-01 14:05:45,385::task::957::TaskManager.Task::(_decref) Task=`ef8bb1f8-ad82-43a9-b276-b564bad31ebc`::ref 0 aborting False >Thread-2337::DEBUG::2013-03-01 14:05:45,558::task::568::TaskManager.Task::(_updateState) Task=`accd8ae2-7930-434c-a72b-bc7e8300cff5`::moving from state init -> state preparing >Thread-2337::INFO::2013-03-01 14:05:45,558::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2337::INFO::2013-03-01 14:05:45,558::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.014631986618', 'lastCheck': '6.6', 'code': 0, 'valid': True}} >Thread-2337::DEBUG::2013-03-01 14:05:45,559::task::1151::TaskManager.Task::(prepare) Task=`accd8ae2-7930-434c-a72b-bc7e8300cff5`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.014631986618', 'lastCheck': '6.6', 'code': 0, 'valid': True}} >Thread-2337::DEBUG::2013-03-01 14:05:45,559::task::568::TaskManager.Task::(_updateState) Task=`accd8ae2-7930-434c-a72b-bc7e8300cff5`::moving from state preparing -> state finished >Thread-2337::DEBUG::2013-03-01 14:05:45,559::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2337::DEBUG::2013-03-01 14:05:45,559::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2337::DEBUG::2013-03-01 14:05:45,560::task::957::TaskManager.Task::(_decref) Task=`accd8ae2-7930-434c-a72b-bc7e8300cff5`::ref 0 aborting False >Thread-2339::DEBUG::2013-03-01 14:05:46,413::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2339::DEBUG::2013-03-01 14:05:46,413::task::568::TaskManager.Task::(_updateState) Task=`7676d20a-8ac7-4819-affa-4440f126cf08`::moving from state init -> state preparing >Thread-2339::INFO::2013-03-01 14:05:46,445::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2339::DEBUG::2013-03-01 14:05:46,446::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2339::DEBUG::2013-03-01 14:05:46,446::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2339::INFO::2013-03-01 14:05:46,446::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2339::DEBUG::2013-03-01 14:05:46,446::task::1151::TaskManager.Task::(prepare) Task=`7676d20a-8ac7-4819-affa-4440f126cf08`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2339::DEBUG::2013-03-01 14:05:46,447::task::568::TaskManager.Task::(_updateState) Task=`7676d20a-8ac7-4819-affa-4440f126cf08`::moving from state preparing -> state finished >Thread-2339::DEBUG::2013-03-01 14:05:46,447::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2339::DEBUG::2013-03-01 14:05:46,447::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2339::DEBUG::2013-03-01 14:05:46,447::task::957::TaskManager.Task::(_decref) Task=`7676d20a-8ac7-4819-affa-4440f126cf08`::ref 0 aborting False >Thread-2340::DEBUG::2013-03-01 14:05:47,475::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2340::DEBUG::2013-03-01 14:05:47,475::task::568::TaskManager.Task::(_updateState) Task=`108f620a-4096-4d8f-8a22-cd3134306aa5`::moving from state init -> state preparing >Thread-2340::INFO::2013-03-01 14:05:47,476::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2340::DEBUG::2013-03-01 14:05:47,476::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2340::DEBUG::2013-03-01 14:05:47,476::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2340::INFO::2013-03-01 14:05:47,476::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2340::DEBUG::2013-03-01 14:05:47,477::task::1151::TaskManager.Task::(prepare) Task=`108f620a-4096-4d8f-8a22-cd3134306aa5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2340::DEBUG::2013-03-01 14:05:47,477::task::568::TaskManager.Task::(_updateState) Task=`108f620a-4096-4d8f-8a22-cd3134306aa5`::moving from state preparing -> state finished >Thread-2340::DEBUG::2013-03-01 14:05:47,477::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2340::DEBUG::2013-03-01 14:05:47,477::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2340::DEBUG::2013-03-01 14:05:47,478::task::957::TaskManager.Task::(_decref) Task=`108f620a-4096-4d8f-8a22-cd3134306aa5`::ref 0 aborting False >Thread-2341::DEBUG::2013-03-01 14:05:48,506::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2341::DEBUG::2013-03-01 14:05:48,506::task::568::TaskManager.Task::(_updateState) Task=`97fb3747-095a-4828-8279-5453980d0938`::moving from state init -> state preparing >Thread-2341::INFO::2013-03-01 14:05:48,507::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2341::DEBUG::2013-03-01 14:05:48,507::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2341::DEBUG::2013-03-01 14:05:48,507::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2341::INFO::2013-03-01 14:05:48,507::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2341::DEBUG::2013-03-01 14:05:48,507::task::1151::TaskManager.Task::(prepare) Task=`97fb3747-095a-4828-8279-5453980d0938`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2341::DEBUG::2013-03-01 14:05:48,508::task::568::TaskManager.Task::(_updateState) Task=`97fb3747-095a-4828-8279-5453980d0938`::moving from state preparing -> state finished >Thread-2341::DEBUG::2013-03-01 14:05:48,508::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2341::DEBUG::2013-03-01 14:05:48,508::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2341::DEBUG::2013-03-01 14:05:48,508::task::957::TaskManager.Task::(_decref) Task=`97fb3747-095a-4828-8279-5453980d0938`::ref 0 aborting False >Thread-2343::DEBUG::2013-03-01 14:05:49,536::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2343::DEBUG::2013-03-01 14:05:49,536::task::568::TaskManager.Task::(_updateState) Task=`d68d8ba2-b55e-4317-a4b4-29f9464dc999`::moving from state init -> state preparing >Thread-2343::INFO::2013-03-01 14:05:49,536::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2343::DEBUG::2013-03-01 14:05:49,537::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2343::DEBUG::2013-03-01 14:05:49,537::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2343::INFO::2013-03-01 14:05:49,537::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2343::DEBUG::2013-03-01 14:05:49,537::task::1151::TaskManager.Task::(prepare) Task=`d68d8ba2-b55e-4317-a4b4-29f9464dc999`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2343::DEBUG::2013-03-01 14:05:49,538::task::568::TaskManager.Task::(_updateState) Task=`d68d8ba2-b55e-4317-a4b4-29f9464dc999`::moving from state preparing -> state finished >Thread-2343::DEBUG::2013-03-01 14:05:49,538::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2343::DEBUG::2013-03-01 14:05:49,538::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2343::DEBUG::2013-03-01 14:05:49,538::task::957::TaskManager.Task::(_decref) Task=`d68d8ba2-b55e-4317-a4b4-29f9464dc999`::ref 0 aborting False >Thread-2344::DEBUG::2013-03-01 14:05:50,566::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2344::DEBUG::2013-03-01 14:05:50,566::task::568::TaskManager.Task::(_updateState) Task=`01fe0b84-394e-46c5-8edf-a6bc948d0435`::moving from state init -> state preparing >Thread-2344::INFO::2013-03-01 14:05:50,566::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2344::DEBUG::2013-03-01 14:05:50,567::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2344::DEBUG::2013-03-01 14:05:50,567::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2344::INFO::2013-03-01 14:05:50,567::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2344::DEBUG::2013-03-01 14:05:50,567::task::1151::TaskManager.Task::(prepare) Task=`01fe0b84-394e-46c5-8edf-a6bc948d0435`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2344::DEBUG::2013-03-01 14:05:50,568::task::568::TaskManager.Task::(_updateState) Task=`01fe0b84-394e-46c5-8edf-a6bc948d0435`::moving from state preparing -> state finished >Thread-2344::DEBUG::2013-03-01 14:05:50,568::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2344::DEBUG::2013-03-01 14:05:50,568::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2344::DEBUG::2013-03-01 14:05:50,568::task::957::TaskManager.Task::(_decref) Task=`01fe0b84-394e-46c5-8edf-a6bc948d0435`::ref 0 aborting False >Thread-2345::DEBUG::2013-03-01 14:05:51,596::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2345::DEBUG::2013-03-01 14:05:51,596::task::568::TaskManager.Task::(_updateState) Task=`cd4ff203-e501-4c99-946f-98377062f389`::moving from state init -> state preparing >Thread-2345::INFO::2013-03-01 14:05:51,597::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2345::DEBUG::2013-03-01 14:05:51,597::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2345::DEBUG::2013-03-01 14:05:51,597::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2345::INFO::2013-03-01 14:05:51,597::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2345::DEBUG::2013-03-01 14:05:51,597::task::1151::TaskManager.Task::(prepare) Task=`cd4ff203-e501-4c99-946f-98377062f389`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2345::DEBUG::2013-03-01 14:05:51,598::task::568::TaskManager.Task::(_updateState) Task=`cd4ff203-e501-4c99-946f-98377062f389`::moving from state preparing -> state finished >Thread-2345::DEBUG::2013-03-01 14:05:51,598::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2345::DEBUG::2013-03-01 14:05:51,598::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2345::DEBUG::2013-03-01 14:05:51,598::task::957::TaskManager.Task::(_decref) Task=`cd4ff203-e501-4c99-946f-98377062f389`::ref 0 aborting False >Thread-2347::DEBUG::2013-03-01 14:05:52,626::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2347::DEBUG::2013-03-01 14:05:52,626::task::568::TaskManager.Task::(_updateState) Task=`0f044a24-1fc0-4be0-af7a-5fb7a8ecabbc`::moving from state init -> state preparing >Thread-2347::INFO::2013-03-01 14:05:52,626::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2347::DEBUG::2013-03-01 14:05:52,627::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2347::DEBUG::2013-03-01 14:05:52,627::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2347::INFO::2013-03-01 14:05:52,627::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2347::DEBUG::2013-03-01 14:05:52,627::task::1151::TaskManager.Task::(prepare) Task=`0f044a24-1fc0-4be0-af7a-5fb7a8ecabbc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2347::DEBUG::2013-03-01 14:05:52,628::task::568::TaskManager.Task::(_updateState) Task=`0f044a24-1fc0-4be0-af7a-5fb7a8ecabbc`::moving from state preparing -> state finished >Thread-2347::DEBUG::2013-03-01 14:05:52,628::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2347::DEBUG::2013-03-01 14:05:52,628::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2347::DEBUG::2013-03-01 14:05:52,628::task::957::TaskManager.Task::(_decref) Task=`0f044a24-1fc0-4be0-af7a-5fb7a8ecabbc`::ref 0 aborting False >Thread-2348::DEBUG::2013-03-01 14:05:53,656::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2348::DEBUG::2013-03-01 14:05:53,656::task::568::TaskManager.Task::(_updateState) Task=`04016542-33ca-4936-bec4-3076ff719188`::moving from state init -> state preparing >Thread-2348::INFO::2013-03-01 14:05:53,656::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2348::DEBUG::2013-03-01 14:05:53,657::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2348::DEBUG::2013-03-01 14:05:53,657::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2348::INFO::2013-03-01 14:05:53,657::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2348::DEBUG::2013-03-01 14:05:53,657::task::1151::TaskManager.Task::(prepare) Task=`04016542-33ca-4936-bec4-3076ff719188`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2348::DEBUG::2013-03-01 14:05:53,658::task::568::TaskManager.Task::(_updateState) Task=`04016542-33ca-4936-bec4-3076ff719188`::moving from state preparing -> state finished >Thread-2348::DEBUG::2013-03-01 14:05:53,658::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2348::DEBUG::2013-03-01 14:05:53,658::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2348::DEBUG::2013-03-01 14:05:53,658::task::957::TaskManager.Task::(_decref) Task=`04016542-33ca-4936-bec4-3076ff719188`::ref 0 aborting False >Thread-2349::DEBUG::2013-03-01 14:05:54,689::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2349::DEBUG::2013-03-01 14:05:54,689::task::568::TaskManager.Task::(_updateState) Task=`0452a631-6a92-4725-848f-1a4495d98d85`::moving from state init -> state preparing >Thread-2349::INFO::2013-03-01 14:05:54,690::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2349::DEBUG::2013-03-01 14:05:54,690::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2349::DEBUG::2013-03-01 14:05:54,690::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2349::INFO::2013-03-01 14:05:54,691::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2349::DEBUG::2013-03-01 14:05:54,691::task::1151::TaskManager.Task::(prepare) Task=`0452a631-6a92-4725-848f-1a4495d98d85`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2349::DEBUG::2013-03-01 14:05:54,691::task::568::TaskManager.Task::(_updateState) Task=`0452a631-6a92-4725-848f-1a4495d98d85`::moving from state preparing -> state finished >Thread-2349::DEBUG::2013-03-01 14:05:54,692::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2349::DEBUG::2013-03-01 14:05:54,692::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2349::DEBUG::2013-03-01 14:05:54,692::task::957::TaskManager.Task::(_decref) Task=`0452a631-6a92-4725-848f-1a4495d98d85`::ref 0 aborting False >Thread-2351::DEBUG::2013-03-01 14:05:55,720::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2351::DEBUG::2013-03-01 14:05:55,721::task::568::TaskManager.Task::(_updateState) Task=`37f01664-703f-4c05-85e8-d1e550c67ed8`::moving from state init -> state preparing >Thread-2351::INFO::2013-03-01 14:05:55,721::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2351::DEBUG::2013-03-01 14:05:55,721::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2351::DEBUG::2013-03-01 14:05:55,721::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2351::INFO::2013-03-01 14:05:55,722::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2351::DEBUG::2013-03-01 14:05:55,722::task::1151::TaskManager.Task::(prepare) Task=`37f01664-703f-4c05-85e8-d1e550c67ed8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2351::DEBUG::2013-03-01 14:05:55,722::task::568::TaskManager.Task::(_updateState) Task=`37f01664-703f-4c05-85e8-d1e550c67ed8`::moving from state preparing -> state finished >Thread-2351::DEBUG::2013-03-01 14:05:55,722::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2351::DEBUG::2013-03-01 14:05:55,722::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2351::DEBUG::2013-03-01 14:05:55,723::task::957::TaskManager.Task::(_decref) Task=`37f01664-703f-4c05-85e8-d1e550c67ed8`::ref 0 aborting False >Thread-2352::DEBUG::2013-03-01 14:05:56,750::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2352::DEBUG::2013-03-01 14:05:56,751::task::568::TaskManager.Task::(_updateState) Task=`50b037e3-cd48-482e-886d-073696958438`::moving from state init -> state preparing >Thread-2352::INFO::2013-03-01 14:05:56,751::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2352::DEBUG::2013-03-01 14:05:56,751::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2352::DEBUG::2013-03-01 14:05:56,751::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2352::INFO::2013-03-01 14:05:56,752::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2352::DEBUG::2013-03-01 14:05:56,752::task::1151::TaskManager.Task::(prepare) Task=`50b037e3-cd48-482e-886d-073696958438`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2352::DEBUG::2013-03-01 14:05:56,752::task::568::TaskManager.Task::(_updateState) Task=`50b037e3-cd48-482e-886d-073696958438`::moving from state preparing -> state finished >Thread-2352::DEBUG::2013-03-01 14:05:56,752::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2352::DEBUG::2013-03-01 14:05:56,753::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2352::DEBUG::2013-03-01 14:05:56,753::task::957::TaskManager.Task::(_decref) Task=`50b037e3-cd48-482e-886d-073696958438`::ref 0 aborting False >Thread-2354::DEBUG::2013-03-01 14:05:57,782::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2354::DEBUG::2013-03-01 14:05:57,782::task::568::TaskManager.Task::(_updateState) Task=`48eaef9f-498f-4bba-8962-f540c409d384`::moving from state init -> state preparing >Thread-2354::INFO::2013-03-01 14:05:57,783::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2354::DEBUG::2013-03-01 14:05:57,783::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2354::DEBUG::2013-03-01 14:05:57,783::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2354::INFO::2013-03-01 14:05:57,783::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2354::DEBUG::2013-03-01 14:05:57,784::task::1151::TaskManager.Task::(prepare) Task=`48eaef9f-498f-4bba-8962-f540c409d384`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2354::DEBUG::2013-03-01 14:05:57,784::task::568::TaskManager.Task::(_updateState) Task=`48eaef9f-498f-4bba-8962-f540c409d384`::moving from state preparing -> state finished >Thread-2354::DEBUG::2013-03-01 14:05:57,784::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2354::DEBUG::2013-03-01 14:05:57,784::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2354::DEBUG::2013-03-01 14:05:57,785::task::957::TaskManager.Task::(_decref) Task=`48eaef9f-498f-4bba-8962-f540c409d384`::ref 0 aborting False >Thread-2355::DEBUG::2013-03-01 14:05:58,815::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2355::DEBUG::2013-03-01 14:05:58,816::task::568::TaskManager.Task::(_updateState) Task=`8d28ad3a-6a76-46c1-9470-f06650737d71`::moving from state init -> state preparing >Thread-2355::INFO::2013-03-01 14:05:58,816::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2355::DEBUG::2013-03-01 14:05:58,816::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2355::DEBUG::2013-03-01 14:05:58,817::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2355::INFO::2013-03-01 14:05:58,817::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2355::DEBUG::2013-03-01 14:05:58,817::task::1151::TaskManager.Task::(prepare) Task=`8d28ad3a-6a76-46c1-9470-f06650737d71`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2355::DEBUG::2013-03-01 14:05:58,817::task::568::TaskManager.Task::(_updateState) Task=`8d28ad3a-6a76-46c1-9470-f06650737d71`::moving from state preparing -> state finished >Thread-2355::DEBUG::2013-03-01 14:05:58,818::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2355::DEBUG::2013-03-01 14:05:58,818::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2355::DEBUG::2013-03-01 14:05:58,818::task::957::TaskManager.Task::(_decref) Task=`8d28ad3a-6a76-46c1-9470-f06650737d71`::ref 0 aborting False >Thread-2356::DEBUG::2013-03-01 14:05:59,846::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2356::DEBUG::2013-03-01 14:05:59,846::task::568::TaskManager.Task::(_updateState) Task=`11fbbc09-d25a-48bc-9438-0c1402a9e886`::moving from state init -> state preparing >Thread-2356::INFO::2013-03-01 14:05:59,846::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2356::DEBUG::2013-03-01 14:05:59,847::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2356::DEBUG::2013-03-01 14:05:59,847::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2356::INFO::2013-03-01 14:05:59,847::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2356::DEBUG::2013-03-01 14:05:59,847::task::1151::TaskManager.Task::(prepare) Task=`11fbbc09-d25a-48bc-9438-0c1402a9e886`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2356::DEBUG::2013-03-01 14:05:59,848::task::568::TaskManager.Task::(_updateState) Task=`11fbbc09-d25a-48bc-9438-0c1402a9e886`::moving from state preparing -> state finished >Thread-2356::DEBUG::2013-03-01 14:05:59,848::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2356::DEBUG::2013-03-01 14:05:59,848::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2356::DEBUG::2013-03-01 14:05:59,848::task::957::TaskManager.Task::(_decref) Task=`11fbbc09-d25a-48bc-9438-0c1402a9e886`::ref 0 aborting False >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,244::clusterlock::191::SANLock::(acquireHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1) >26605088-d368-484f-bb07-7cefc43856ef::INFO::2013-03-01 14:06:00,245::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,600::clusterlock::248::SANLock::(acquire) Cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully acquired (id: 1) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,601::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,628::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=201580bb4c9044f8c2b2dfa195d399ad0f2527b8'] >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,628::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,628::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,629::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=97904b32ca8642c2abf58d342e21dbb37c002d0c'] >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,684::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,684::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`6f2f2124-c969-4f49-bb60-2f6fb1d8ee15`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,684::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,685::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,685::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`6f2f2124-c969-4f49-bb60-2f6fb1d8ee15`::Granted request >26605088-d368-484f-bb07-7cefc43856ef::INFO::2013-03-01 14:06:00,686::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,686::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`87e94458-756e-4b97-b733-b9a3b68b8bf6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,686::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,687::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,687::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`87e94458-756e-4b97-b733-b9a3b68b8bf6`::Granted request >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,687::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-2357::DEBUG::2013-03-01 14:06:00,767::task::568::TaskManager.Task::(_updateState) Task=`d2c8de1e-88c8-4241-a0d8-2ace391ece22`::moving from state init -> state preparing >Thread-2357::INFO::2013-03-01 14:06:00,767::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2357::INFO::2013-03-01 14:06:00,768::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.400228023529', 'lastCheck': '0.5', 'code': 0, 'valid': True}} >Thread-2357::DEBUG::2013-03-01 14:06:00,768::task::1151::TaskManager.Task::(prepare) Task=`d2c8de1e-88c8-4241-a0d8-2ace391ece22`::finished: {'0de0ade6-8103-4d0e-b5cc-88c1447338cc': {'delay': '0.400228023529', 'lastCheck': '0.5', 'code': 0, 'valid': True}} >Thread-2357::DEBUG::2013-03-01 14:06:00,768::task::568::TaskManager.Task::(_updateState) Task=`d2c8de1e-88c8-4241-a0d8-2ace391ece22`::moving from state preparing -> state finished >Thread-2357::DEBUG::2013-03-01 14:06:00,768::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2357::DEBUG::2013-03-01 14:06:00,768::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2357::DEBUG::2013-03-01 14:06:00,769::task::957::TaskManager.Task::(_decref) Task=`d2c8de1e-88c8-4241-a0d8-2ace391ece22`::ref 0 aborting False >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,881::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >26605088-d368-484f-bb07-7cefc43856ef::WARNING::2013-03-01 14:06:00,881::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,882::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2359::DEBUG::2013-03-01 14:06:00,897::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2359::DEBUG::2013-03-01 14:06:00,906::task::568::TaskManager.Task::(_updateState) Task=`5e1d11cc-b2e1-489f-ae4f-82eaf1fc84c3`::moving from state init -> state preparing >Thread-2359::INFO::2013-03-01 14:06:00,912::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2359::DEBUG::2013-03-01 14:06:00,917::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2359::DEBUG::2013-03-01 14:06:00,922::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2359::INFO::2013-03-01 14:06:00,927::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2359::DEBUG::2013-03-01 14:06:00,931::task::1151::TaskManager.Task::(prepare) Task=`5e1d11cc-b2e1-489f-ae4f-82eaf1fc84c3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2359::DEBUG::2013-03-01 14:06:00,936::task::568::TaskManager.Task::(_updateState) Task=`5e1d11cc-b2e1-489f-ae4f-82eaf1fc84c3`::moving from state preparing -> state finished >Thread-2359::DEBUG::2013-03-01 14:06:00,941::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2359::DEBUG::2013-03-01 14:06:00,945::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2359::DEBUG::2013-03-01 14:06:00,948::task::957::TaskManager.Task::(_decref) Task=`5e1d11cc-b2e1-489f-ae4f-82eaf1fc84c3`::ref 0 aborting False >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,952::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,954::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,982::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=0de0ade6-8103-4d0e-b5cc-88c1447338cc:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=97904b32ca8642c2abf58d342e21dbb37c002d0c'] >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,988::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >26605088-d368-484f-bb07-7cefc43856ef::WARNING::2013-03-01 14:06:00,989::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >26605088-d368-484f-bb07-7cefc43856ef::WARNING::2013-03-01 14:06:00,989::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,989::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,990::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,990::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,990::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,991::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,991::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,991::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,991::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,992::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,992::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:00,992::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,002::sp::309::Storage.StoragePool::(startSpm) ended. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,002::task::568::TaskManager.Task::(_updateState) Task=`26605088-d368-484f-bb07-7cefc43856ef`::moving from state running -> state finished >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,003::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>} >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,003::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,003::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,004::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,004::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,004::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,005::task::880::TaskManager.Task::(_runJobs) Task=`26605088-d368-484f-bb07-7cefc43856ef`::Task.run: exit - success: result >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,005::task::957::TaskManager.Task::(_decref) Task=`26605088-d368-484f-bb07-7cefc43856ef`::ref 0 aborting False >26605088-d368-484f-bb07-7cefc43856ef::DEBUG::2013-03-01 14:06:01,005::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-2379::DEBUG::2013-03-01 14:06:01,980::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2379::DEBUG::2013-03-01 14:06:01,981::task::568::TaskManager.Task::(_updateState) Task=`b6fe8930-24b8-46a1-98a7-60753447d2d0`::moving from state init -> state preparing >Thread-2379::INFO::2013-03-01 14:06:01,981::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2379::DEBUG::2013-03-01 14:06:01,981::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2379::DEBUG::2013-03-01 14:06:01,982::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'} >Thread-2379::INFO::2013-03-01 14:06:01,982::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2379::DEBUG::2013-03-01 14:06:01,982::task::1151::TaskManager.Task::(prepare) Task=`b6fe8930-24b8-46a1-98a7-60753447d2d0`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '26605088-d368-484f-bb07-7cefc43856ef'}} >Thread-2379::DEBUG::2013-03-01 14:06:01,982::task::568::TaskManager.Task::(_updateState) Task=`b6fe8930-24b8-46a1-98a7-60753447d2d0`::moving from state preparing -> state finished >Thread-2379::DEBUG::2013-03-01 14:06:01,983::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2379::DEBUG::2013-03-01 14:06:01,983::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2379::DEBUG::2013-03-01 14:06:01,983::task::957::TaskManager.Task::(_decref) Task=`b6fe8930-24b8-46a1-98a7-60753447d2d0`::ref 0 aborting False >Thread-2380::DEBUG::2013-03-01 14:06:02,008::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2380::DEBUG::2013-03-01 14:06:02,008::task::568::TaskManager.Task::(_updateState) Task=`140da2a2-e08f-4824-8ace-49a9dffffb1f`::moving from state init -> state preparing >Thread-2380::INFO::2013-03-01 14:06:02,009::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2380::INFO::2013-03-01 14:06:02,009::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-2380::DEBUG::2013-03-01 14:06:02,009::task::1151::TaskManager.Task::(prepare) Task=`140da2a2-e08f-4824-8ace-49a9dffffb1f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-2380::DEBUG::2013-03-01 14:06:02,009::task::568::TaskManager.Task::(_updateState) Task=`140da2a2-e08f-4824-8ace-49a9dffffb1f`::moving from state preparing -> state finished >Thread-2380::DEBUG::2013-03-01 14:06:02,010::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2380::DEBUG::2013-03-01 14:06:02,010::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2380::DEBUG::2013-03-01 14:06:02,010::task::957::TaskManager.Task::(_decref) Task=`140da2a2-e08f-4824-8ace-49a9dffffb1f`::ref 0 aborting False >Thread-2381::DEBUG::2013-03-01 14:06:02,038::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2381::DEBUG::2013-03-01 14:06:02,038::task::568::TaskManager.Task::(_updateState) Task=`790618b0-f47e-4ae2-8bc6-1d025b0983e8`::moving from state init -> state preparing >Thread-2381::INFO::2013-03-01 14:06:02,039::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='26605088-d368-484f-bb07-7cefc43856ef', spUUID=None, options=None) >Thread-2381::DEBUG::2013-03-01 14:06:02,039::taskManager::161::TaskManager::(clearTask) Entry. taskID: 26605088-d368-484f-bb07-7cefc43856ef >Thread-2381::DEBUG::2013-03-01 14:06:02,039::taskManager::166::TaskManager::(clearTask) Return. >Thread-2381::INFO::2013-03-01 14:06:02,039::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-2381::DEBUG::2013-03-01 14:06:02,039::task::1151::TaskManager.Task::(prepare) Task=`790618b0-f47e-4ae2-8bc6-1d025b0983e8`::finished: None >Thread-2381::DEBUG::2013-03-01 14:06:02,040::task::568::TaskManager.Task::(_updateState) Task=`790618b0-f47e-4ae2-8bc6-1d025b0983e8`::moving from state preparing -> state finished >Thread-2381::DEBUG::2013-03-01 14:06:02,040::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2381::DEBUG::2013-03-01 14:06:02,040::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2381::DEBUG::2013-03-01 14:06:02,040::task::957::TaskManager.Task::(_decref) Task=`790618b0-f47e-4ae2-8bc6-1d025b0983e8`::ref 0 aborting False >Thread-2382::DEBUG::2013-03-01 14:06:02,078::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2382::DEBUG::2013-03-01 14:06:02,078::task::568::TaskManager.Task::(_updateState) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::moving from state init -> state preparing >Thread-2382::INFO::2013-03-01 14:06:02,079::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', hostID=1, scsiKey='35b6dfb7-cf75-44b4-9bc5-c190faab989d', options=None) >Thread-2382::INFO::2013-03-01 14:06:02,079::hsm::1042::Storage.HSM::(destroyStoragePool) spUUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-2382::DEBUG::2013-03-01 14:06:02,079::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`4ad38cdf-eecf-4c4b-9334-4414d1eb21a6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2382::DEBUG::2013-03-01 14:06:02,080::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2382::DEBUG::2013-03-01 14:06:02,080::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2382::DEBUG::2013-03-01 14:06:02,080::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`4ad38cdf-eecf-4c4b-9334-4414d1eb21a6`::Granted request >Thread-2382::DEBUG::2013-03-01 14:06:02,081::task::794::TaskManager.Task::(resourceAcquired) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::_resourcesAcquired: Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d (exclusive) >Thread-2382::DEBUG::2013-03-01 14:06:02,081::task::957::TaskManager.Task::(_decref) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::ref 1 aborting False >Thread-2382::DEBUG::2013-03-01 14:06:02,082::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`fd7c5594-5552-4631-856a-a0df3f71162d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2382::DEBUG::2013-03-01 14:06:02,082::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >Thread-2382::DEBUG::2013-03-01 14:06:02,082::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >Thread-2382::DEBUG::2013-03-01 14:06:02,082::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`fd7c5594-5552-4631-856a-a0df3f71162d`::Granted request >Thread-2382::DEBUG::2013-03-01 14:06:02,083::task::794::TaskManager.Task::(resourceAcquired) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::_resourcesAcquired: Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc (exclusive) >Thread-2382::DEBUG::2013-03-01 14:06:02,083::task::957::TaskManager.Task::(_decref) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::ref 1 aborting False >Thread-2382::WARNING::2013-03-01 14:06:02,083::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >Thread-2382::DEBUG::2013-03-01 14:06:02,084::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2382::DEBUG::2013-03-01 14:06:02,084::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2382::DEBUG::2013-03-01 14:06:02,085::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=523a4484c5e4f76702a3217d08c1a90b7189cfd6'] >Thread-2382::DEBUG::2013-03-01 14:06:02,210::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2382::DEBUG::2013-03-01 14:06:02,210::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-2382::DEBUG::2013-03-01 14:06:02,210::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`676fac61-644e-4094-bbb1-2cc3c4fbf435`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2382::DEBUG::2013-03-01 14:06:02,211::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' for lock type 'exclusive' >Thread-2382::DEBUG::2013-03-01 14:06:02,211::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free. Now locking as 'exclusive' (1 active user) >Thread-2382::DEBUG::2013-03-01 14:06:02,211::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d`ReqID=`676fac61-644e-4094-bbb1-2cc3c4fbf435`::Granted request >Thread-2382::DEBUG::2013-03-01 14:06:02,212::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2382::DEBUG::2013-03-01 14:06:02,212::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2382::DEBUG::2013-03-01 14:06:02,212::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2382::DEBUG::2013-03-01 14:06:02,213::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2382::DEBUG::2013-03-01 14:06:02,217::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,219::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,221::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,223::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,225::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,228::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,230::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,232::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,234::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,236::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,238::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,241::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,243::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,245::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,247::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,249::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,252::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,254::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,256::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,258::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,260::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,262::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,264::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,267::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,269::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,271::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,273::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,275::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,277::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,280::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,282::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,284::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,286::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,288::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,290::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,293::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >Thread-2382::DEBUG::2013-03-01 14:06:02,293::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2382::DEBUG::2013-03-01 14:06:02,293::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2382::DEBUG::2013-03-01 14:06:02,293::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a1804a02523340bcfb6e21f710f72a41ed08b8b9'] >Thread-2382::DEBUG::2013-03-01 14:06:02,350::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2382::INFO::2013-03-01 14:06:02,350::clusterlock::252::SANLock::(release) Releasing cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2382::DEBUG::2013-03-01 14:06:02,393::clusterlock::263::SANLock::(release) Cluster lock for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc successfully released >Thread-2382::DEBUG::2013-03-01 14:06:02,394::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2382::DEBUG::2013-03-01 14:06:02,394::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2382::DEBUG::2013-03-01 14:06:02,430::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a1804a02523340bcfb6e21f710f72a41ed08b8b9'] >Thread-2302::DEBUG::2013-03-01 14:06:02,431::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2302::INFO::2013-03-01 14:06:02,431::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc (id: 1) >Thread-2302::DEBUG::2013-03-01 14:06:05,433::clusterlock::206::SANLock::(releaseHostId) Host id for domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc released successfully (id: 1) >Thread-2382::DEBUG::2013-03-01 14:06:05,433::sp::1559::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `35b6dfb7-cf75-44b4-9bc5-c190faab989d` stopped monitoring domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` >Thread-2382::DEBUG::2013-03-01 14:06:05,433::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2382::DEBUG::2013-03-01 14:06:05,434::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `0de0ade6-8103-4d0e-b5cc-88c1447338cc` is done >Thread-2382::DEBUG::2013-03-01 14:06:05,463::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=35b6dfb7-cf75-44b4-9bc5-c190faab989d', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Master', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a1804a02523340bcfb6e21f710f72a41ed08b8b9'] >Thread-2382::DEBUG::2013-03-01 14:06:05,463::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-2382::DEBUG::2013-03-01 14:06:05,464::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-2382::DEBUG::2013-03-01 14:06:05,464::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-2382::DEBUG::2013-03-01 14:06:05,464::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-2382::DEBUG::2013-03-01 14:06:05,464::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f8da51a8d4bee071033a4671f8e7704a62ec2e2'] >Thread-2382::DEBUG::2013-03-01 14:06:05,525::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-2382::DEBUG::2013-03-01 14:06:05,525::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-2382::DEBUG::2013-03-01 14:06:05,525::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2382::DEBUG::2013-03-01 14:06:05,564::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f8da51a8d4bee071033a4671f8e7704a62ec2e2'] >Thread-2382::DEBUG::2013-03-01 14:06:05,564::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2382::INFO::2013-03-01 14:06:05,564::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 35b6dfb7-cf75-44b4-9bc5-c190faab989d >Thread-2382::INFO::2013-03-01 14:06:05,565::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-2382::DEBUG::2013-03-01 14:06:05,565::task::1151::TaskManager.Task::(prepare) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::finished: True >Thread-2382::DEBUG::2013-03-01 14:06:05,565::task::568::TaskManager.Task::(_updateState) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::moving from state preparing -> state finished >Thread-2382::DEBUG::2013-03-01 14:06:05,565::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d': < ResourceRef 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', isValid: 'True' obj: 'None'>, 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc': < ResourceRef 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', isValid: 'True' obj: 'None'>} >Thread-2382::DEBUG::2013-03-01 14:06:05,566::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2382::DEBUG::2013-03-01 14:06:05,566::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' >Thread-2382::DEBUG::2013-03-01 14:06:05,566::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' (0 active users) >Thread-2382::DEBUG::2013-03-01 14:06:05,567::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d' is free, finding out if anyone is waiting for it. >Thread-2382::DEBUG::2013-03-01 14:06:05,567::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.35b6dfb7-cf75-44b4-9bc5-c190faab989d', Clearing records. >Thread-2382::DEBUG::2013-03-01 14:06:05,567::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >Thread-2382::DEBUG::2013-03-01 14:06:05,568::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >Thread-2382::DEBUG::2013-03-01 14:06:05,568::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >Thread-2382::DEBUG::2013-03-01 14:06:05,568::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >Thread-2382::DEBUG::2013-03-01 14:06:05,568::task::957::TaskManager.Task::(_decref) Task=`0ddb0991-c872-4808-a7ad-b2181ac69e80`::ref 0 aborting False >Thread-2384::DEBUG::2013-03-01 14:06:05,608::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2384::DEBUG::2013-03-01 14:06:05,609::task::568::TaskManager.Task::(_updateState) Task=`7edcaf1f-bb53-480f-997e-8cf38564fdf6`::moving from state init -> state preparing >Thread-2384::INFO::2013-03-01 14:06:05,609::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2384::DEBUG::2013-03-01 14:06:05,610::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-2384::DEBUG::2013-03-01 14:06:05,676::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2384::DEBUG::2013-03-01 14:06:05,677::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2384::DEBUG::2013-03-01 14:06:05,677::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2384::DEBUG::2013-03-01 14:06:05,677::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2384::DEBUG::2013-03-01 14:06:05,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2384::DEBUG::2013-03-01 14:06:05,693::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2384::DEBUG::2013-03-01 14:06:05,694::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:05,698::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:06,702::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:06,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:06,708::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:06,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:06,714::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2384::DEBUG::2013-03-01 14:06:07,718::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2384::DEBUG::2013-03-01 14:06:09,721::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2384::DEBUG::2013-03-01 14:06:10,316::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2384::DEBUG::2013-03-01 14:06:10,317::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2384::DEBUG::2013-03-01 14:06:10,317::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2384::DEBUG::2013-03-01 14:06:10,318::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2384::DEBUG::2013-03-01 14:06:10,318::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2384::DEBUG::2013-03-01 14:06:10,319::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2384::DEBUG::2013-03-01 14:06:10,319::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2384::DEBUG::2013-03-01 14:06:10,319::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2384::INFO::2013-03-01 14:06:10,320::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2384::DEBUG::2013-03-01 14:06:10,320::task::1151::TaskManager.Task::(prepare) Task=`7edcaf1f-bb53-480f-997e-8cf38564fdf6`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2384::DEBUG::2013-03-01 14:06:10,320::task::568::TaskManager.Task::(_updateState) Task=`7edcaf1f-bb53-480f-997e-8cf38564fdf6`::moving from state preparing -> state finished >Thread-2384::DEBUG::2013-03-01 14:06:10,321::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2384::DEBUG::2013-03-01 14:06:10,321::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2384::DEBUG::2013-03-01 14:06:10,321::task::957::TaskManager.Task::(_decref) Task=`7edcaf1f-bb53-480f-997e-8cf38564fdf6`::ref 0 aborting False >Thread-2387::DEBUG::2013-03-01 14:06:10,354::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2387::DEBUG::2013-03-01 14:06:10,355::task::568::TaskManager.Task::(_updateState) Task=`9a545637-ea22-4e74-b7c9-ab26a3125078`::moving from state init -> state preparing >Thread-2387::INFO::2013-03-01 14:06:10,355::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='35b6dfb7-cf75-44b4-9bc5-c190faab989d', hostID=1, scsiKey='35b6dfb7-cf75-44b4-9bc5-c190faab989d', remove=False, options=None) >Thread-2387::WARNING::2013-03-01 14:06:10,356::hsm::1008::Storage.HSM::(disconnectStoragePool) disconnect sp: 35b6dfb7-cf75-44b4-9bc5-c190faab989d failed. Known pools {} >Thread-2387::INFO::2013-03-01 14:06:10,356::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-2387::DEBUG::2013-03-01 14:06:10,356::task::1151::TaskManager.Task::(prepare) Task=`9a545637-ea22-4e74-b7c9-ab26a3125078`::finished: None >Thread-2387::DEBUG::2013-03-01 14:06:10,356::task::568::TaskManager.Task::(_updateState) Task=`9a545637-ea22-4e74-b7c9-ab26a3125078`::moving from state preparing -> state finished >Thread-2387::DEBUG::2013-03-01 14:06:10,357::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2387::DEBUG::2013-03-01 14:06:10,357::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2387::DEBUG::2013-03-01 14:06:10,357::task::957::TaskManager.Task::(_decref) Task=`9a545637-ea22-4e74-b7c9-ab26a3125078`::ref 0 aborting False >Thread-2388::DEBUG::2013-03-01 14:06:11,304::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2388::DEBUG::2013-03-01 14:06:11,305::task::568::TaskManager.Task::(_updateState) Task=`3176e97c-4944-41ba-a81e-64013d4ab1eb`::moving from state init -> state preparing >Thread-2388::INFO::2013-03-01 14:06:11,305::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2388::INFO::2013-03-01 14:06:11,305::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2388::DEBUG::2013-03-01 14:06:11,305::task::1151::TaskManager.Task::(prepare) Task=`3176e97c-4944-41ba-a81e-64013d4ab1eb`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2388::DEBUG::2013-03-01 14:06:11,306::task::568::TaskManager.Task::(_updateState) Task=`3176e97c-4944-41ba-a81e-64013d4ab1eb`::moving from state preparing -> state finished >Thread-2388::DEBUG::2013-03-01 14:06:11,306::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2388::DEBUG::2013-03-01 14:06:11,306::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2388::DEBUG::2013-03-01 14:06:11,307::task::957::TaskManager.Task::(_decref) Task=`3176e97c-4944-41ba-a81e-64013d4ab1eb`::ref 0 aborting False >Thread-2389::DEBUG::2013-03-01 14:06:11,336::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2389::DEBUG::2013-03-01 14:06:11,337::task::568::TaskManager.Task::(_updateState) Task=`1bd03414-7683-458e-82f4-5f71a585f40a`::moving from state init -> state preparing >Thread-2389::INFO::2013-03-01 14:06:11,337::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2389::DEBUG::2013-03-01 14:06:11,341::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-2389::INFO::2013-03-01 14:06:11,505::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2389::DEBUG::2013-03-01 14:06:11,505::task::1151::TaskManager.Task::(prepare) Task=`1bd03414-7683-458e-82f4-5f71a585f40a`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2389::DEBUG::2013-03-01 14:06:11,505::task::568::TaskManager.Task::(_updateState) Task=`1bd03414-7683-458e-82f4-5f71a585f40a`::moving from state preparing -> state finished >Thread-2389::DEBUG::2013-03-01 14:06:11,506::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2389::DEBUG::2013-03-01 14:06:11,506::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2389::DEBUG::2013-03-01 14:06:11,506::task::957::TaskManager.Task::(_decref) Task=`1bd03414-7683-458e-82f4-5f71a585f40a`::ref 0 aborting False >Thread-2390::DEBUG::2013-03-01 14:06:11,536::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2390::DEBUG::2013-03-01 14:06:11,537::task::568::TaskManager.Task::(_updateState) Task=`2040609f-0529-4976-8aa6-81cea634c07d`::moving from state init -> state preparing >Thread-2390::INFO::2013-03-01 14:06:11,537::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='0de0ade6-8103-4d0e-b5cc-88c1447338cc', autoDetach=False, options=None) >Thread-2390::DEBUG::2013-03-01 14:06:11,537::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2390::DEBUG::2013-03-01 14:06:11,538::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2390::DEBUG::2013-03-01 14:06:11,538::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2390::DEBUG::2013-03-01 14:06:11,553::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2390::DEBUG::2013-03-01 14:06:11,554::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:11,556::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:12,561::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:13,566::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:13,569::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:13,572::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:13,575::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:14,579::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2392::DEBUG::2013-03-01 14:06:15,996::task::568::TaskManager.Task::(_updateState) Task=`bdbe586c-8744-490b-8237-de5fcaa623a7`::moving from state init -> state preparing >Thread-2392::INFO::2013-03-01 14:06:15,997::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2392::INFO::2013-03-01 14:06:15,997::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2392::DEBUG::2013-03-01 14:06:15,997::task::1151::TaskManager.Task::(prepare) Task=`bdbe586c-8744-490b-8237-de5fcaa623a7`::finished: {} >Thread-2392::DEBUG::2013-03-01 14:06:15,997::task::568::TaskManager.Task::(_updateState) Task=`bdbe586c-8744-490b-8237-de5fcaa623a7`::moving from state preparing -> state finished >Thread-2392::DEBUG::2013-03-01 14:06:15,997::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2392::DEBUG::2013-03-01 14:06:15,998::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2392::DEBUG::2013-03-01 14:06:15,998::task::957::TaskManager.Task::(_decref) Task=`bdbe586c-8744-490b-8237-de5fcaa623a7`::ref 0 aborting False >Thread-2390::DEBUG::2013-03-01 14:06:16,582::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2390::DEBUG::2013-03-01 14:06:17,723::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2390::DEBUG::2013-03-01 14:06:17,724::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`43f87550-6c25-420d-985f-403e67fed9b3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2390::DEBUG::2013-03-01 14:06:17,730::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' for lock type 'exclusive' >Thread-2390::DEBUG::2013-03-01 14:06:17,731::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free. Now locking as 'exclusive' (1 active user) >Thread-2390::DEBUG::2013-03-01 14:06:17,731::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc`ReqID=`43f87550-6c25-420d-985f-403e67fed9b3`::Granted request >Thread-2390::DEBUG::2013-03-01 14:06:17,732::task::794::TaskManager.Task::(resourceAcquired) Task=`2040609f-0529-4976-8aa6-81cea634c07d`::_resourcesAcquired: Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc (exclusive) >Thread-2390::DEBUG::2013-03-01 14:06:17,732::task::957::TaskManager.Task::(_decref) Task=`2040609f-0529-4976-8aa6-81cea634c07d`::ref 1 aborting False >Thread-2390::DEBUG::2013-03-01 14:06:17,777::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f8da51a8d4bee071033a4671f8e7704a62ec2e2'] >Thread-2390::DEBUG::2013-03-01 14:06:17,778::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2390::DEBUG::2013-03-01 14:06:17,778::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2390::DEBUG::2013-03-01 14:06:17,778::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2390::DEBUG::2013-03-01 14:06:17,779::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2390::DEBUG::2013-03-01 14:06:17,779::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2390::DEBUG::2013-03-01 14:06:17,794::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2390::DEBUG::2013-03-01 14:06:17,795::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:17,796::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:18,801::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:19,805::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:19,808::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:19,811::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:19,814::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2390::DEBUG::2013-03-01 14:06:20,818::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2390::DEBUG::2013-03-01 14:06:22,822::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2390::DEBUG::2013-03-01 14:06:23,924::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2390::DEBUG::2013-03-01 14:06:23,925::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,925::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,925::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,926::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,926::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,926::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,926::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2390::DEBUG::2013-03-01 14:06:23,927::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:23,928::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 0de0ade6-8103-4d0e-b5cc-88c1447338cc' (cwd None) >Thread-2390::DEBUG::2013-03-01 14:06:24,188::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found\n'; <rc> = 5 >Thread-2390::WARNING::2013-03-01 14:06:24,190::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "0de0ade6-8103-4d0e-b5cc-88c1447338cc" not found'] >Thread-2390::DEBUG::2013-03-01 14:06:24,191::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2390::DEBUG::2013-03-01 14:06:24,234::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234/0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2390::DEBUG::2013-03-01 14:06:24,235::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2390::DEBUG::2013-03-01 14:06:24,243::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfsStorageTest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'ROLE=Regular', 'SDUUID=0de0ade6-8103-4d0e-b5cc-88c1447338cc', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f8da51a8d4bee071033a4671f8e7704a62ec2e2'] >Thread-2390::DEBUG::2013-03-01 14:06:24,249::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2390::WARNING::2013-03-01 14:06:24,249::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_imageNS already registered >Thread-2390::WARNING::2013-03-01 14:06:24,250::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0de0ade6-8103-4d0e-b5cc-88c1447338cc_volumeNS already registered >Thread-2390::INFO::2013-03-01 14:06:24,250::fileSD::404::Storage.StorageDomain::(format) Formatting domain 0de0ade6-8103-4d0e-b5cc-88c1447338cc >Thread-2390::INFO::2013-03-01 14:06:24,432::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-2390::DEBUG::2013-03-01 14:06:24,432::task::1151::TaskManager.Task::(prepare) Task=`2040609f-0529-4976-8aa6-81cea634c07d`::finished: None >Thread-2390::DEBUG::2013-03-01 14:06:24,433::task::568::TaskManager.Task::(_updateState) Task=`2040609f-0529-4976-8aa6-81cea634c07d`::moving from state preparing -> state finished >Thread-2390::DEBUG::2013-03-01 14:06:24,433::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc': < ResourceRef 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', isValid: 'True' obj: 'None'>} >Thread-2390::DEBUG::2013-03-01 14:06:24,433::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2390::DEBUG::2013-03-01 14:06:24,434::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' >Thread-2390::DEBUG::2013-03-01 14:06:24,434::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' (0 active users) >Thread-2390::DEBUG::2013-03-01 14:06:24,434::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc' is free, finding out if anyone is waiting for it. >Thread-2390::DEBUG::2013-03-01 14:06:24,434::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0de0ade6-8103-4d0e-b5cc-88c1447338cc', Clearing records. >Thread-2390::DEBUG::2013-03-01 14:06:24,435::task::957::TaskManager.Task::(_decref) Task=`2040609f-0529-4976-8aa6-81cea634c07d`::ref 0 aborting False >Thread-2430::DEBUG::2013-03-01 14:06:24,468::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2430::DEBUG::2013-03-01 14:06:24,469::task::568::TaskManager.Task::(_updateState) Task=`7e860855-04a0-4ca4-a8ad-07054ff5c246`::moving from state init -> state preparing >Thread-2430::INFO::2013-03-01 14:06:24,469::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_25_588234', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea', 'port': ''}], options=None) >Thread-2430::DEBUG::2013-03-01 14:06:24,470::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__25__588234' (cwd None) >Thread-2430::DEBUG::2013-03-01 14:06:24,516::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2430::DEBUG::2013-03-01 14:06:24,517::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2430::DEBUG::2013-03-01 14:06:24,517::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2430::DEBUG::2013-03-01 14:06:24,517::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2430::DEBUG::2013-03-01 14:06:24,517::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2430::DEBUG::2013-03-01 14:06:24,533::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2430::DEBUG::2013-03-01 14:06:24,533::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:24,537::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:25,541::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:26,546::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:27,550::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:27,553::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:27,556::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2430::DEBUG::2013-03-01 14:06:27,559::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2430::DEBUG::2013-03-01 14:06:29,562::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2430::DEBUG::2013-03-01 14:06:30,630::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2430::DEBUG::2013-03-01 14:06:30,630::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2430::DEBUG::2013-03-01 14:06:30,631::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2430::DEBUG::2013-03-01 14:06:30,631::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2430::DEBUG::2013-03-01 14:06:30,631::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2430::DEBUG::2013-03-01 14:06:30,632::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2430::DEBUG::2013-03-01 14:06:30,632::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2430::DEBUG::2013-03-01 14:06:30,632::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2430::INFO::2013-03-01 14:06:30,633::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2430::DEBUG::2013-03-01 14:06:30,633::task::1151::TaskManager.Task::(prepare) Task=`7e860855-04a0-4ca4-a8ad-07054ff5c246`::finished: {'statuslist': [{'status': 0, 'id': '9c543aa1-d1b0-46ca-bb92-04a7018134ea'}]} >Thread-2430::DEBUG::2013-03-01 14:06:30,633::task::568::TaskManager.Task::(_updateState) Task=`7e860855-04a0-4ca4-a8ad-07054ff5c246`::moving from state preparing -> state finished >Thread-2430::DEBUG::2013-03-01 14:06:30,634::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2430::DEBUG::2013-03-01 14:06:30,634::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2430::DEBUG::2013-03-01 14:06:30,634::task::957::TaskManager.Task::(_decref) Task=`7e860855-04a0-4ca4-a8ad-07054ff5c246`::ref 0 aborting False >Thread-2433::DEBUG::2013-03-01 14:06:31,209::task::568::TaskManager.Task::(_updateState) Task=`2607f458-3c01-480f-8639-b2c29a0377c2`::moving from state init -> state preparing >Thread-2433::INFO::2013-03-01 14:06:31,210::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2433::INFO::2013-03-01 14:06:31,210::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2433::DEBUG::2013-03-01 14:06:31,210::task::1151::TaskManager.Task::(prepare) Task=`2607f458-3c01-480f-8639-b2c29a0377c2`::finished: {} >Thread-2433::DEBUG::2013-03-01 14:06:31,211::task::568::TaskManager.Task::(_updateState) Task=`2607f458-3c01-480f-8639-b2c29a0377c2`::moving from state preparing -> state finished >Thread-2433::DEBUG::2013-03-01 14:06:31,211::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2433::DEBUG::2013-03-01 14:06:31,211::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2433::DEBUG::2013-03-01 14:06:31,211::task::957::TaskManager.Task::(_decref) Task=`2607f458-3c01-480f-8639-b2c29a0377c2`::ref 0 aborting False >Thread-2435::DEBUG::2013-03-01 14:06:31,575::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2435::DEBUG::2013-03-01 14:06:31,576::task::568::TaskManager.Task::(_updateState) Task=`a2b31e38-bc27-4f07-9d92-b51368907436`::moving from state init -> state preparing >Thread-2435::INFO::2013-03-01 14:06:31,576::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2435::INFO::2013-03-01 14:06:31,576::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2435::DEBUG::2013-03-01 14:06:31,576::task::1151::TaskManager.Task::(prepare) Task=`a2b31e38-bc27-4f07-9d92-b51368907436`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2435::DEBUG::2013-03-01 14:06:31,577::task::568::TaskManager.Task::(_updateState) Task=`a2b31e38-bc27-4f07-9d92-b51368907436`::moving from state preparing -> state finished >Thread-2435::DEBUG::2013-03-01 14:06:31,577::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2435::DEBUG::2013-03-01 14:06:31,577::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2435::DEBUG::2013-03-01 14:06:31,577::task::957::TaskManager.Task::(_decref) Task=`a2b31e38-bc27-4f07-9d92-b51368907436`::ref 0 aborting False >Thread-2436::DEBUG::2013-03-01 14:06:31,607::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2436::DEBUG::2013-03-01 14:06:31,608::task::568::TaskManager.Task::(_updateState) Task=`15c25a58-e14b-45ce-99f5-a06b69c412de`::moving from state init -> state preparing >Thread-2436::INFO::2013-03-01 14:06:31,608::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2436::DEBUG::2013-03-01 14:06:31,611::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-2436::INFO::2013-03-01 14:06:31,762::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2436::DEBUG::2013-03-01 14:06:31,763::task::1151::TaskManager.Task::(prepare) Task=`15c25a58-e14b-45ce-99f5-a06b69c412de`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2436::DEBUG::2013-03-01 14:06:31,763::task::568::TaskManager.Task::(_updateState) Task=`15c25a58-e14b-45ce-99f5-a06b69c412de`::moving from state preparing -> state finished >Thread-2436::DEBUG::2013-03-01 14:06:31,763::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2436::DEBUG::2013-03-01 14:06:31,764::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2436::DEBUG::2013-03-01 14:06:31,764::task::957::TaskManager.Task::(_decref) Task=`15c25a58-e14b-45ce-99f5-a06b69c412de`::ref 0 aborting False >Thread-2437::DEBUG::2013-03-01 14:06:31,794::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2437::DEBUG::2013-03-01 14:06:31,794::task::568::TaskManager.Task::(_updateState) Task=`e07100d2-1943-42e7-b021-be5074205407`::moving from state init -> state preparing >Thread-2437::INFO::2013-03-01 14:06:31,795::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='49d8a532-e3af-4ed8-b859-bacb52bd2eb0', autoDetach=False, options=None) >Thread-2437::DEBUG::2013-03-01 14:06:31,795::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2437::DEBUG::2013-03-01 14:06:31,795::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2437::DEBUG::2013-03-01 14:06:31,796::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2437::DEBUG::2013-03-01 14:06:31,811::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2437::DEBUG::2013-03-01 14:06:31,812::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:31,814::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:32,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:33,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:34,827::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:35,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:35,834::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:36,838::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2437::DEBUG::2013-03-01 14:06:38,841::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2437::DEBUG::2013-03-01 14:06:39,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2437::DEBUG::2013-03-01 14:06:39,923::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`c37dbcee-9942-4b51-8a41-16909d7892cc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2437::DEBUG::2013-03-01 14:06:39,923::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' for lock type 'exclusive' >Thread-2437::DEBUG::2013-03-01 14:06:39,924::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free. Now locking as 'exclusive' (1 active user) >Thread-2437::DEBUG::2013-03-01 14:06:39,924::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0`ReqID=`c37dbcee-9942-4b51-8a41-16909d7892cc`::Granted request >Thread-2437::DEBUG::2013-03-01 14:06:39,924::task::794::TaskManager.Task::(resourceAcquired) Task=`e07100d2-1943-42e7-b021-be5074205407`::_resourcesAcquired: Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0 (exclusive) >Thread-2437::DEBUG::2013-03-01 14:06:39,925::task::957::TaskManager.Task::(_decref) Task=`e07100d2-1943-42e7-b021-be5074205407`::ref 1 aborting False >Thread-2437::DEBUG::2013-03-01 14:06:39,925::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2437::DEBUG::2013-03-01 14:06:39,925::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2437::DEBUG::2013-03-01 14:06:39,926::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2437::DEBUG::2013-03-01 14:06:39,926::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2437::DEBUG::2013-03-01 14:06:39,926::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2437::DEBUG::2013-03-01 14:06:39,942::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2437::DEBUG::2013-03-01 14:06:39,942::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:39,944::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:40,948::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:40,951::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:40,954::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:41,958::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:41,961::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2437::DEBUG::2013-03-01 14:06:41,999::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2437::DEBUG::2013-03-01 14:06:44,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2437::DEBUG::2013-03-01 14:06:45,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2437::DEBUG::2013-03-01 14:06:45,053::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,053::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,054::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,054::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,055::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,055::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,055::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2437::DEBUG::2013-03-01 14:06:45,056::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,057::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-2437::DEBUG::2013-03-01 14:06:45,227::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-2437::WARNING::2013-03-01 14:06:45,228::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-2437::DEBUG::2013-03-01 14:06:45,229::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,279::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-2437::DEBUG::2013-03-01 14:06:45,279::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2437::DEBUG::2013-03-01 14:06:45,312::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f750573841a8efbd6c760672df3821255d89ee35'] >Thread-2437::DEBUG::2013-03-01 14:06:45,327::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2437::WARNING::2013-03-01 14:06:45,327::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-2437::WARNING::2013-03-01 14:06:45,327::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-2437::DEBUG::2013-03-01 14:06:45,347::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f750573841a8efbd6c760672df3821255d89ee35'] >Thread-2437::DEBUG::2013-03-01 14:06:45,347::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (cwd None) >Thread-2437::DEBUG::2013-03-01 14:06:45,520::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found\n'; <rc> = 5 >Thread-2437::WARNING::2013-03-01 14:06:45,521::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "49d8a532-e3af-4ed8-b859-bacb52bd2eb0" not found'] >Thread-2437::DEBUG::2013-03-01 14:06:45,522::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2437::DEBUG::2013-03-01 14:06:45,558::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042/49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-2437::DEBUG::2013-03-01 14:06:45,558::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2437::DEBUG::2013-03-01 14:06:45,578::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfsStorageTest_data_domain_1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'ROLE=Regular', 'SDUUID=49d8a532-e3af-4ed8-b859-bacb52bd2eb0', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f750573841a8efbd6c760672df3821255d89ee35'] >Thread-2437::DEBUG::2013-03-01 14:06:45,584::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2437::WARNING::2013-03-01 14:06:45,584::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_imageNS already registered >Thread-2437::WARNING::2013-03-01 14:06:45,585::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 49d8a532-e3af-4ed8-b859-bacb52bd2eb0_volumeNS already registered >Thread-2437::INFO::2013-03-01 14:06:45,585::fileSD::404::Storage.StorageDomain::(format) Formatting domain 49d8a532-e3af-4ed8-b859-bacb52bd2eb0 >Thread-2437::INFO::2013-03-01 14:06:45,759::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-2437::DEBUG::2013-03-01 14:06:45,759::task::1151::TaskManager.Task::(prepare) Task=`e07100d2-1943-42e7-b021-be5074205407`::finished: None >Thread-2437::DEBUG::2013-03-01 14:06:45,760::task::568::TaskManager.Task::(_updateState) Task=`e07100d2-1943-42e7-b021-be5074205407`::moving from state preparing -> state finished >Thread-2437::DEBUG::2013-03-01 14:06:45,760::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0': < ResourceRef 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', isValid: 'True' obj: 'None'>} >Thread-2437::DEBUG::2013-03-01 14:06:45,760::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2437::DEBUG::2013-03-01 14:06:45,761::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' >Thread-2437::DEBUG::2013-03-01 14:06:45,761::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' (0 active users) >Thread-2437::DEBUG::2013-03-01 14:06:45,761::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0' is free, finding out if anyone is waiting for it. >Thread-2437::DEBUG::2013-03-01 14:06:45,762::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.49d8a532-e3af-4ed8-b859-bacb52bd2eb0', Clearing records. >Thread-2437::DEBUG::2013-03-01 14:06:45,762::task::957::TaskManager.Task::(_decref) Task=`e07100d2-1943-42e7-b021-be5074205407`::ref 0 aborting False >Thread-2485::DEBUG::2013-03-01 14:06:45,794::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2485::DEBUG::2013-03-01 14:06:45,795::task::568::TaskManager.Task::(_updateState) Task=`99c47ce4-ae8a-42ad-91f5-aea8b6a4837b`::moving from state init -> state preparing >Thread-2485::INFO::2013-03-01 14:06:45,795::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_27_82042', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a', 'port': ''}], options=None) >Thread-2485::DEBUG::2013-03-01 14:06:45,796::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__27__82042' (cwd None) >Thread-2485::DEBUG::2013-03-01 14:06:45,828::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2485::DEBUG::2013-03-01 14:06:45,829::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2485::DEBUG::2013-03-01 14:06:45,829::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2485::DEBUG::2013-03-01 14:06:45,829::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2485::DEBUG::2013-03-01 14:06:45,830::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2485::DEBUG::2013-03-01 14:06:45,845::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2485::DEBUG::2013-03-01 14:06:45,846::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:45,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-2486::DEBUG::2013-03-01 14:06:46,443::task::568::TaskManager.Task::(_updateState) Task=`0b691207-85c1-4634-a10e-2d4e6868499e`::moving from state init -> state preparing >Thread-2486::INFO::2013-03-01 14:06:46,444::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2486::INFO::2013-03-01 14:06:46,444::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2486::DEBUG::2013-03-01 14:06:46,444::task::1151::TaskManager.Task::(prepare) Task=`0b691207-85c1-4634-a10e-2d4e6868499e`::finished: {} >Thread-2486::DEBUG::2013-03-01 14:06:46,444::task::568::TaskManager.Task::(_updateState) Task=`0b691207-85c1-4634-a10e-2d4e6868499e`::moving from state preparing -> state finished >Thread-2486::DEBUG::2013-03-01 14:06:46,445::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2486::DEBUG::2013-03-01 14:06:46,445::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2486::DEBUG::2013-03-01 14:06:46,445::task::957::TaskManager.Task::(_decref) Task=`0b691207-85c1-4634-a10e-2d4e6868499e`::ref 0 aborting False >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:46,852::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:47,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:47,859::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:47,862::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:48,866::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2485::DEBUG::2013-03-01 14:06:49,870::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2485::DEBUG::2013-03-01 14:06:51,873::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2485::DEBUG::2013-03-01 14:06:53,005::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2485::DEBUG::2013-03-01 14:06:53,005::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2485::DEBUG::2013-03-01 14:06:53,006::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2485::DEBUG::2013-03-01 14:06:53,006::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2485::DEBUG::2013-03-01 14:06:53,006::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2485::DEBUG::2013-03-01 14:06:53,007::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2485::DEBUG::2013-03-01 14:06:53,007::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2485::DEBUG::2013-03-01 14:06:53,008::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2485::INFO::2013-03-01 14:06:53,008::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2485::DEBUG::2013-03-01 14:06:53,008::task::1151::TaskManager.Task::(prepare) Task=`99c47ce4-ae8a-42ad-91f5-aea8b6a4837b`::finished: {'statuslist': [{'status': 0, 'id': '67dd61d7-8db1-4ff1-9dae-75ee5191a67a'}]} >Thread-2485::DEBUG::2013-03-01 14:06:53,008::task::568::TaskManager.Task::(_updateState) Task=`99c47ce4-ae8a-42ad-91f5-aea8b6a4837b`::moving from state preparing -> state finished >Thread-2485::DEBUG::2013-03-01 14:06:53,009::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2485::DEBUG::2013-03-01 14:06:53,009::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2485::DEBUG::2013-03-01 14:06:53,009::task::957::TaskManager.Task::(_decref) Task=`99c47ce4-ae8a-42ad-91f5-aea8b6a4837b`::ref 0 aborting False >Thread-2490::DEBUG::2013-03-01 14:06:53,934::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2490::DEBUG::2013-03-01 14:06:53,935::task::568::TaskManager.Task::(_updateState) Task=`79ba1142-5f64-4eb2-a4c1-37ae64b4a95c`::moving from state init -> state preparing >Thread-2490::INFO::2013-03-01 14:06:53,935::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2490::INFO::2013-03-01 14:06:53,935::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2490::DEBUG::2013-03-01 14:06:53,936::task::1151::TaskManager.Task::(prepare) Task=`79ba1142-5f64-4eb2-a4c1-37ae64b4a95c`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2490::DEBUG::2013-03-01 14:06:53,936::task::568::TaskManager.Task::(_updateState) Task=`79ba1142-5f64-4eb2-a4c1-37ae64b4a95c`::moving from state preparing -> state finished >Thread-2490::DEBUG::2013-03-01 14:06:53,936::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2490::DEBUG::2013-03-01 14:06:53,936::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2490::DEBUG::2013-03-01 14:06:53,937::task::957::TaskManager.Task::(_decref) Task=`79ba1142-5f64-4eb2-a4c1-37ae64b4a95c`::ref 0 aborting False >Thread-2491::DEBUG::2013-03-01 14:06:53,967::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2491::DEBUG::2013-03-01 14:06:53,967::task::568::TaskManager.Task::(_updateState) Task=`6c41ad45-91fd-4aae-a5d9-6c926e0682ff`::moving from state init -> state preparing >Thread-2491::INFO::2013-03-01 14:06:53,967::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2491::DEBUG::2013-03-01 14:06:53,971::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-2491::INFO::2013-03-01 14:06:54,112::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2491::DEBUG::2013-03-01 14:06:54,113::task::1151::TaskManager.Task::(prepare) Task=`6c41ad45-91fd-4aae-a5d9-6c926e0682ff`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2491::DEBUG::2013-03-01 14:06:54,113::task::568::TaskManager.Task::(_updateState) Task=`6c41ad45-91fd-4aae-a5d9-6c926e0682ff`::moving from state preparing -> state finished >Thread-2491::DEBUG::2013-03-01 14:06:54,113::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2491::DEBUG::2013-03-01 14:06:54,114::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2491::DEBUG::2013-03-01 14:06:54,114::task::957::TaskManager.Task::(_decref) Task=`6c41ad45-91fd-4aae-a5d9-6c926e0682ff`::ref 0 aborting False >Thread-2492::DEBUG::2013-03-01 14:06:54,155::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2492::DEBUG::2013-03-01 14:06:54,156::task::568::TaskManager.Task::(_updateState) Task=`3b3a78b4-a4b9-40cf-92fb-902f87b20ea0`::moving from state init -> state preparing >Thread-2492::INFO::2013-03-01 14:06:54,156::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='edd0d33d-dba0-4943-9c48-6112a2ddcdfc', autoDetach=False, options=None) >Thread-2492::DEBUG::2013-03-01 14:06:54,156::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2492::DEBUG::2013-03-01 14:06:54,157::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2492::DEBUG::2013-03-01 14:06:54,157::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2492::DEBUG::2013-03-01 14:06:54,173::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2492::DEBUG::2013-03-01 14:06:54,173::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2492::DEBUG::2013-03-01 14:06:54,176::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:06:55,180::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:06:56,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:06:57,189::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:06:58,193::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:06:59,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:00,201::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2495::DEBUG::2013-03-01 14:07:01,650::task::568::TaskManager.Task::(_updateState) Task=`70e01540-704f-403b-918e-0e6d61608016`::moving from state init -> state preparing >Thread-2495::INFO::2013-03-01 14:07:01,650::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2495::INFO::2013-03-01 14:07:01,651::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2495::DEBUG::2013-03-01 14:07:01,651::task::1151::TaskManager.Task::(prepare) Task=`70e01540-704f-403b-918e-0e6d61608016`::finished: {} >Thread-2495::DEBUG::2013-03-01 14:07:01,651::task::568::TaskManager.Task::(_updateState) Task=`70e01540-704f-403b-918e-0e6d61608016`::moving from state preparing -> state finished >Thread-2495::DEBUG::2013-03-01 14:07:01,651::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2495::DEBUG::2013-03-01 14:07:01,651::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2495::DEBUG::2013-03-01 14:07:01,652::task::957::TaskManager.Task::(_decref) Task=`70e01540-704f-403b-918e-0e6d61608016`::ref 0 aborting False >Thread-2492::DEBUG::2013-03-01 14:07:02,205::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2492::DEBUG::2013-03-01 14:07:03,245::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2492::DEBUG::2013-03-01 14:07:03,247::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`f1a309ce-8066-46bd-9c29-f9938f614283`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-2492::DEBUG::2013-03-01 14:07:03,247::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' for lock type 'exclusive' >Thread-2492::DEBUG::2013-03-01 14:07:03,247::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free. Now locking as 'exclusive' (1 active user) >Thread-2492::DEBUG::2013-03-01 14:07:03,248::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc`ReqID=`f1a309ce-8066-46bd-9c29-f9938f614283`::Granted request >Thread-2492::DEBUG::2013-03-01 14:07:03,248::task::794::TaskManager.Task::(resourceAcquired) Task=`3b3a78b4-a4b9-40cf-92fb-902f87b20ea0`::_resourcesAcquired: Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc (exclusive) >Thread-2492::DEBUG::2013-03-01 14:07:03,249::task::957::TaskManager.Task::(_decref) Task=`3b3a78b4-a4b9-40cf-92fb-902f87b20ea0`::ref 1 aborting False >Thread-2492::DEBUG::2013-03-01 14:07:03,249::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2492::DEBUG::2013-03-01 14:07:03,249::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2492::DEBUG::2013-03-01 14:07:03,250::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2492::DEBUG::2013-03-01 14:07:03,250::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2492::DEBUG::2013-03-01 14:07:03,250::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2492::DEBUG::2013-03-01 14:07:03,265::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2492::DEBUG::2013-03-01 14:07:03,266::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:03,267::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:04,272::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:05,276::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:06,280::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:07,284::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:08,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2492::DEBUG::2013-03-01 14:07:09,352::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2492::DEBUG::2013-03-01 14:07:11,355::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2492::DEBUG::2013-03-01 14:07:12,455::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2492::DEBUG::2013-03-01 14:07:12,456::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,456::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,456::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,457::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,457::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,457::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,458::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2492::DEBUG::2013-03-01 14:07:12,458::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-2492::DEBUG::2013-03-01 14:07:12,668::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-2492::WARNING::2013-03-01 14:07:12,669::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-2492::DEBUG::2013-03-01 14:07:12,669::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,716::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2492::DEBUG::2013-03-01 14:07:12,716::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2492::DEBUG::2013-03-01 14:07:12,721::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8911a7db9cbbe5333609fa055adbead85bb01744'] >Thread-2492::DEBUG::2013-03-01 14:07:12,723::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2492::WARNING::2013-03-01 14:07:12,724::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-2492::WARNING::2013-03-01 14:07:12,724::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-2492::DEBUG::2013-03-01 14:07:12,728::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8911a7db9cbbe5333609fa055adbead85bb01744'] >Thread-2492::DEBUG::2013-03-01 14:07:12,728::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,729::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (cwd None) >Thread-2492::DEBUG::2013-03-01 14:07:12,950::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found\n'; <rc> = 5 >Thread-2492::WARNING::2013-03-01 14:07:12,951::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "edd0d33d-dba0-4943-9c48-6112a2ddcdfc" not found'] >Thread-2492::DEBUG::2013-03-01 14:07:12,951::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-2492::DEBUG::2013-03-01 14:07:12,993::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069/edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2492::DEBUG::2013-03-01 14:07:12,993::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-2492::DEBUG::2013-03-01 14:07:12,996::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nfsStorageTest_ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'ROLE=Regular', 'SDUUID=edd0d33d-dba0-4943-9c48-6112a2ddcdfc', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8911a7db9cbbe5333609fa055adbead85bb01744'] >Thread-2492::DEBUG::2013-03-01 14:07:12,998::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-2492::WARNING::2013-03-01 14:07:12,999::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_imageNS already registered >Thread-2492::WARNING::2013-03-01 14:07:12,999::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace edd0d33d-dba0-4943-9c48-6112a2ddcdfc_volumeNS already registered >Thread-2492::INFO::2013-03-01 14:07:12,999::fileSD::404::Storage.StorageDomain::(format) Formatting domain edd0d33d-dba0-4943-9c48-6112a2ddcdfc >Thread-2492::INFO::2013-03-01 14:07:13,117::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-2492::DEBUG::2013-03-01 14:07:13,117::task::1151::TaskManager.Task::(prepare) Task=`3b3a78b4-a4b9-40cf-92fb-902f87b20ea0`::finished: None >Thread-2492::DEBUG::2013-03-01 14:07:13,117::task::568::TaskManager.Task::(_updateState) Task=`3b3a78b4-a4b9-40cf-92fb-902f87b20ea0`::moving from state preparing -> state finished >Thread-2492::DEBUG::2013-03-01 14:07:13,118::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc': < ResourceRef 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', isValid: 'True' obj: 'None'>} >Thread-2492::DEBUG::2013-03-01 14:07:13,118::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2492::DEBUG::2013-03-01 14:07:13,119::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' >Thread-2492::DEBUG::2013-03-01 14:07:13,119::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' (0 active users) >Thread-2492::DEBUG::2013-03-01 14:07:13,119::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc' is free, finding out if anyone is waiting for it. >Thread-2492::DEBUG::2013-03-01 14:07:13,119::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.edd0d33d-dba0-4943-9c48-6112a2ddcdfc', Clearing records. >Thread-2492::DEBUG::2013-03-01 14:07:13,120::task::957::TaskManager.Task::(_decref) Task=`3b3a78b4-a4b9-40cf-92fb-902f87b20ea0`::ref 0 aborting False >Thread-2549::DEBUG::2013-03-01 14:07:13,152::BindingXMLRPC::161::vds::(wrapper) [10.35.161.2] >Thread-2549::DEBUG::2013-03-01 14:07:13,153::task::568::TaskManager.Task::(_updateState) Task=`e0a91bba-3da8-4b8d-b055-085f5065feb8`::moving from state init -> state preparing >Thread-2549::INFO::2013-03-01 14:07:13,153::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-09_nfs_2013_03_01_13_45_28_672069', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '652528e2-e705-435f-a0d9-c0b4515560ba', 'port': ''}], options=None) >Thread-2549::DEBUG::2013-03-01 14:07:13,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-09__nfs__2013__03__01__13__45__28__672069' (cwd None) >Thread-2549::DEBUG::2013-03-01 14:07:13,186::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-2549::DEBUG::2013-03-01 14:07:13,187::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2549::DEBUG::2013-03-01 14:07:13,187::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-2549::DEBUG::2013-03-01 14:07:13,187::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-2549::DEBUG::2013-03-01 14:07:13,188::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-2549::DEBUG::2013-03-01 14:07:13,203::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-2549::DEBUG::2013-03-01 14:07:13,204::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:13,206::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:13,209::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:14,213::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:15,218::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:16,222::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-2551::DEBUG::2013-03-01 14:07:16,858::task::568::TaskManager.Task::(_updateState) Task=`74986047-a6af-4755-b4eb-6bc7500a5a40`::moving from state init -> state preparing >Thread-2551::INFO::2013-03-01 14:07:16,859::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2551::INFO::2013-03-01 14:07:16,859::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2551::DEBUG::2013-03-01 14:07:16,859::task::1151::TaskManager.Task::(prepare) Task=`74986047-a6af-4755-b4eb-6bc7500a5a40`::finished: {} >Thread-2551::DEBUG::2013-03-01 14:07:16,859::task::568::TaskManager.Task::(_updateState) Task=`74986047-a6af-4755-b4eb-6bc7500a5a40`::moving from state preparing -> state finished >Thread-2551::DEBUG::2013-03-01 14:07:16,860::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2551::DEBUG::2013-03-01 14:07:16,860::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2551::DEBUG::2013-03-01 14:07:16,860::task::957::TaskManager.Task::(_decref) Task=`74986047-a6af-4755-b4eb-6bc7500a5a40`::ref 0 aborting False >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:17,227::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-2549::DEBUG::2013-03-01 14:07:17,230::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-2549::DEBUG::2013-03-01 14:07:19,233::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-2549::DEBUG::2013-03-01 14:07:20,298::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-2549::DEBUG::2013-03-01 14:07:20,299::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2549::DEBUG::2013-03-01 14:07:20,299::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2549::DEBUG::2013-03-01 14:07:20,299::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2549::DEBUG::2013-03-01 14:07:20,300::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2549::DEBUG::2013-03-01 14:07:20,300::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-2549::DEBUG::2013-03-01 14:07:20,300::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-2549::DEBUG::2013-03-01 14:07:20,301::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-2549::INFO::2013-03-01 14:07:20,301::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2549::DEBUG::2013-03-01 14:07:20,301::task::1151::TaskManager.Task::(prepare) Task=`e0a91bba-3da8-4b8d-b055-085f5065feb8`::finished: {'statuslist': [{'status': 0, 'id': '652528e2-e705-435f-a0d9-c0b4515560ba'}]} >Thread-2549::DEBUG::2013-03-01 14:07:20,302::task::568::TaskManager.Task::(_updateState) Task=`e0a91bba-3da8-4b8d-b055-085f5065feb8`::moving from state preparing -> state finished >Thread-2549::DEBUG::2013-03-01 14:07:20,302::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2549::DEBUG::2013-03-01 14:07:20,302::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2549::DEBUG::2013-03-01 14:07:20,303::task::957::TaskManager.Task::(_decref) Task=`e0a91bba-3da8-4b8d-b055-085f5065feb8`::ref 0 aborting False >Thread-2554::DEBUG::2013-03-01 14:07:23,080::task::568::TaskManager.Task::(_updateState) Task=`382a4ea0-8744-44be-aeaa-f6a7691b7f40`::moving from state init -> state preparing >Thread-2554::INFO::2013-03-01 14:07:23,104::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-2554::INFO::2013-03-01 14:07:23,104::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-2554::DEBUG::2013-03-01 14:07:23,104::task::1151::TaskManager.Task::(prepare) Task=`382a4ea0-8744-44be-aeaa-f6a7691b7f40`::finished: {} >Thread-2554::DEBUG::2013-03-01 14:07:23,104::task::568::TaskManager.Task::(_updateState) Task=`382a4ea0-8744-44be-aeaa-f6a7691b7f40`::moving from state preparing -> state finished >Thread-2554::DEBUG::2013-03-01 14:07:23,116::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-2554::DEBUG::2013-03-01 14:07:23,116::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-2554::DEBUG::2013-03-01 14:07:23,116::task::957::TaskManager.Task::(_decref) Task=`382a4ea0-8744-44be-aeaa-f6a7691b7f40`::ref 0 aborting False >Thread-2556::DEBUG::2013-03-01 14:10:58,417::BindingXMLRPC::913::vds::(wrapper) client [10.35.160.55]::call getCapabilities with () {} >Thread-2556::DEBUG::2013-03-01 14:10:58,480::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.2'}} >MainThread::INFO::2013-03-01 14:11:58,425::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-03-01 14:11:58,432::task::568::TaskManager.Task::(_updateState) Task=`174a2d1a-b0f0-4ddb-8257-bb169fcd13e9`::moving from state init -> state preparing >MainThread::INFO::2013-03-01 14:11:58,433::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-03-01 14:11:58,433::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2013-03-01 14:11:58,438::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,440::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,442::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,443::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,445::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,447::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,449::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,450::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,452::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,453::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,454::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,455::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,457::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,458::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,459::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,461::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,462::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,463::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,464::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,466::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,467::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,468::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,470::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,471::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,472::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,473::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,475::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,476::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,477::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,479::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,480::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,481::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,482::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,484::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,485::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,486::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:11:58,592::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-03-01 14:11:58,592::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-03-01 14:11:58,592::task::1151::TaskManager.Task::(prepare) Task=`174a2d1a-b0f0-4ddb-8257-bb169fcd13e9`::finished: None >MainThread::DEBUG::2013-03-01 14:11:58,593::task::568::TaskManager.Task::(_updateState) Task=`174a2d1a-b0f0-4ddb-8257-bb169fcd13e9`::moving from state preparing -> state finished >MainThread::DEBUG::2013-03-01 14:11:58,593::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-03-01 14:11:58,593::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-03-01 14:11:58,593::task::957::TaskManager.Task::(_decref) Task=`174a2d1a-b0f0-4ddb-8257-bb169fcd13e9`::ref 0 aborting False >MainThread::INFO::2013-03-01 14:11:58,593::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-03-01 14:11:58,593::vdsm::99::vds::(run) <_MainThread(MainThread, started 140444387751680)> >MainThread::INFO::2013-03-01 14:11:58,594::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140444293859072)> >MainThread::INFO::2013-03-01 14:11:58,594::vdsm::99::vds::(run) <WorkerThread(d04a8954-3853-4139-b943-52c1a9fed7bf, started daemon 140443752855296)> >MainThread::INFO::2013-03-01 14:11:58,594::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-03-01 14:11:58,594::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 140443251623680)> >MainThread::INFO::2013-03-01 14:11:58,594::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 140444113549056)> >MainThread::INFO::2013-03-01 14:11:58,594::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 140444145018624)> >MainThread::INFO::2013-03-01 14:11:58,594::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 140443721385728)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 140444134528768)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 140443742365440)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 140444124038912)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 140444155508480)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 140444103059200)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140443272603392)> >MainThread::INFO::2013-03-01 14:11:58,595::vdsm::99::vds::(run) <WorkerThread(26605088-d368-484f-bb07-7cefc43856ef, started daemon 140443731875584)> >MainThread::INFO::2013-03-01 14:16:05,055::vdsm::89::vds::(run) I am the actual vdsm 4.10-10.0 puma23.scl.lab.tlv.redhat.com (2.6.32-358.el6.x86_64) >MainThread::DEBUG::2013-03-01 14:16:05,388::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-03-01 14:16:05,388::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-03-01 14:16:05,406::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-03-01 14:16:06,131::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,133::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,134::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,136::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,137::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,138::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,140::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,141::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,142::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,143::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,145::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,146::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,148::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,149::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,150::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,151::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,153::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,154::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,156::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,157::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,158::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,160::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,161::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,162::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,163::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,165::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,166::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,167::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,169::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,170::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,171::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,173::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,174::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,175::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,176::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,178::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:16:06,290::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2013-03-01 14:16:06,291::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py ee959dd6-776d-484d-a640-f8f3fc78ea0a 10358 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2013-03-01 14:16:06,607::supervdsmServer::373::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2013-03-01 14:16:06,608::supervdsmServer::377::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2013-03-01 14:16:06,608::supervdsmServer::381::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2013-03-01 14:16:06,608::supervdsmServer::388::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2013-03-01 14:16:06,608::supervdsmServer::392::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2013-03-01 14:16:06,609::supervdsmServer::400::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2013-03-01 14:16:06,611::supervdsmServer::412::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2013-03-01 14:16:08,298::supervdsm::179::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2013-03-01 14:16:08,717::multipath::107::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2013-03-01 14:16:08,717::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-03-01 14:16:08,950::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-03-01 14:16:08,951::hsm::432::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-03-01 14:16:08,954::hsm::464::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-03-01 14:16:08,954::hsm::465::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-03-01 14:16:08,954::hsm::467::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-03-01 14:16:09,001::hsm::510::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-03-01 14:16:09,003::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2013-03-01 14:16:09,003::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:09,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::DEBUG::2013-03-01 14:16:09,036::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-03-01 14:16:09,080::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-03-01 14:16:09,080::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 139 >KsmMonitor::DEBUG::2013-03-01 14:16:09,081::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-03-01 14:16:09,085::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2013-03-01 14:16:09,086::vmChannels::127::vds::(run) Starting VM channels listener thread. >KsmMonitor::DEBUG::2013-03-01 14:16:09,115::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-03-01 14:16:09,115::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-03-01 14:16:09,143::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 14:16:09,245::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 14:16:09,245::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:09,245::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:09,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >storageRefresh::DEBUG::2013-03-01 14:16:15,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 14:16:15,746::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:15,752::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-03-01 14:16:15,993::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 14:16:15,999::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-03-01 14:16:15,999::misc::1055::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-03-01 14:16:15,999::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-03-01 14:16:16,000::misc::1055::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-03-01 14:16:16,000::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-03-01 14:16:16,026::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 14:16:16,026::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:16,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,035::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,037::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,039::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,041::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,043::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|storageRefresh::DEBUG::2013-03-01 14:16:17,045::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2013-03-01 14:16:19,048::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2013-03-01 14:16:20,235::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-03-01 14:16:20,236::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:20,236::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:20,236::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:20,237::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:20,237::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:20,237::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-03-01 14:16:20,238::misc::1063::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-03-01 14:16:20,238::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-13::DEBUG::2013-03-01 14:17:09,229::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.121]::call getCapabilities with () {} >Thread-13::DEBUG::2013-03-01 14:17:09,550::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-03-01 14:17:09,686::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.121]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-03-01 14:17:09,746::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2013-03-01 14:17:10,043::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.121]::call getCapabilities with () {} >Thread-15::DEBUG::2013-03-01 14:17:10,153::BindingXMLRPC::920::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.el6.x86_64', 'buildtime': 1359452861.0, 'version': '2.6.32'}, 'spice-server': {'release': '12.el6', 'buildtime': 1358331735L, 'version': '0.12.0'}, 'vdsm': {'release': '10.0.el6ev', 'buildtime': 1361961134L, 'version': '4.10.2'}, 'qemu-kvm': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}, 'libvirt': {'release': '18.el6', 'buildtime': 1359405942L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.348.el6', 'buildtime': 1355930976L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5645 @ 2.40GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.160.254', 'ports': ['eth2']}}, 'bridges': {'rhevm': {'addr': '10.35.160.55', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ports': ['eth2']}}, 'uuid': '70a2f218-c088-4421-a726-dce0602f06f0', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'addr': '', 'cfg': {'UUID': '8995c9e1-3acb-4157-bd42-cdfd7bdaf093', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:9C:02:B0:CF:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:cc', 'speed': 0}, 'eth2': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:9c:02:b0:cf:c8', 'DEVICE': 'eth2', 'ONBOOT': 'yes', 'UUID': '279d51c8-d89d-465a-a4a8-c3023c93dcfb'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:9c:02:b0:cf:c8', 'speed': 10000}, 'eth1': {'addr': '', 'cfg': {'UUID': 'd81ee7f1-2460-4bcd-9a67-61fc397c10e9', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E1', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e1', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'UUID': 'b58f8a53-4c76-440b-aea8-30f75689fe1a', 'DHCP_HOSTNAME': 'puma23.scl.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '44:1E:A1:73:39:E0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '44:1e:a1:73:39:e0', 'speed': 0}}, 'software_revision': '10.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1', '3.2'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e4c7cf7162', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '32099', 'cpuSpeed': '1600.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.121'}} >Thread-16::DEBUG::2013-03-01 14:17:10,217::BindingXMLRPC::913::vds::(wrapper) client [10.35.161.121]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-03-01 14:17:10,218::BindingXMLRPC::920::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL170e G6', 'systemSerialNumber': 'CZ3211B65T', 'systemFamily': 'ProLiant DL2000 Multinode Platform', 'systemVersion': '', 'systemUUID': '30393036-3539-5A43-3332-313142363554', 'systemManufacturer': 'HP'}} >Thread-18::DEBUG::2013-03-01 14:17:13,459::task::568::TaskManager.Task::(_updateState) Task=`75131bc9-bb3c-47e1-b53a-867466df5a09`::moving from state init -> state preparing >Thread-18::INFO::2013-03-01 14:17:13,459::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::INFO::2013-03-01 14:17:13,460::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-18::DEBUG::2013-03-01 14:17:13,460::task::1151::TaskManager.Task::(prepare) Task=`75131bc9-bb3c-47e1-b53a-867466df5a09`::finished: {} >Thread-18::DEBUG::2013-03-01 14:17:13,460::task::568::TaskManager.Task::(_updateState) Task=`75131bc9-bb3c-47e1-b53a-867466df5a09`::moving from state preparing -> state finished >Thread-18::DEBUG::2013-03-01 14:17:13,460::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2013-03-01 14:17:13,460::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2013-03-01 14:17:13,461::task::957::TaskManager.Task::(_decref) Task=`75131bc9-bb3c-47e1-b53a-867466df5a09`::ref 0 aborting False >Thread-20::DEBUG::2013-03-01 14:17:15,426::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-20::DEBUG::2013-03-01 14:17:15,426::task::568::TaskManager.Task::(_updateState) Task=`fdf3f62b-389a-4f4b-9721-41f44a80460d`::moving from state init -> state preparing >Thread-20::INFO::2013-03-01 14:17:15,426::logUtils::37::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.7', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-20::DEBUG::2013-03-01 14:17:15,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-20::DEBUG::2013-03-01 14:17:15,472::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-03-01 14:17:15,473::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-20::DEBUG::2013-03-01 14:17:15,487::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: Cannot modify node.startup. Invalid param name.\n'; <rc> = 7 >Thread-20::DEBUG::2013-03-01 14:17:15,488::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-20::DEBUG::2013-03-01 14:17:15,520::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-03-01 14:17:15,521::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --discover' (cwd None) >Thread-20::DEBUG::2013-03-01 14:17:15,551::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-03-01 14:17:15,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=delete' (cwd None) >Thread-20::DEBUG::2013-03-01 14:17:15,567::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::INFO::2013-03-01 14:17:15,567::logUtils::39::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-20::DEBUG::2013-03-01 14:17:15,568::task::1151::TaskManager.Task::(prepare) Task=`fdf3f62b-389a-4f4b-9721-41f44a80460d`::finished: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-20::DEBUG::2013-03-01 14:17:15,568::task::568::TaskManager.Task::(_updateState) Task=`fdf3f62b-389a-4f4b-9721-41f44a80460d`::moving from state preparing -> state finished >Thread-20::DEBUG::2013-03-01 14:17:15,568::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2013-03-01 14:17:15,569::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2013-03-01 14:17:15,569::task::957::TaskManager.Task::(_decref) Task=`fdf3f62b-389a-4f4b-9721-41f44a80460d`::ref 0 aborting False >Thread-22::DEBUG::2013-03-01 14:17:16,658::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-22::DEBUG::2013-03-01 14:17:16,659::task::568::TaskManager.Task::(_updateState) Task=`9d2a240c-b4b6-472f-ad39-a125717cd07e`::moving from state init -> state preparing >Thread-22::INFO::2013-03-01 14:17:16,659::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-22::INFO::2013-03-01 14:17:16,659::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-22::DEBUG::2013-03-01 14:17:16,659::task::1151::TaskManager.Task::(prepare) Task=`9d2a240c-b4b6-472f-ad39-a125717cd07e`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-22::DEBUG::2013-03-01 14:17:16,660::task::568::TaskManager.Task::(_updateState) Task=`9d2a240c-b4b6-472f-ad39-a125717cd07e`::moving from state preparing -> state finished >Thread-22::DEBUG::2013-03-01 14:17:16,660::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2013-03-01 14:17:16,660::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2013-03-01 14:17:16,660::task::957::TaskManager.Task::(_decref) Task=`9d2a240c-b4b6-472f-ad39-a125717cd07e`::ref 0 aborting False >Thread-23::DEBUG::2013-03-01 14:17:16,718::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-23::DEBUG::2013-03-01 14:17:16,719::task::568::TaskManager.Task::(_updateState) Task=`9956c200-8d16-4cd8-b375-ca40ac3998bb`::moving from state init -> state preparing >Thread-23::INFO::2013-03-01 14:17:16,719::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-23::DEBUG::2013-03-01 14:17:16,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-23::DEBUG::2013-03-01 14:17:16,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2013-03-01 14:17:16,736::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-23::DEBUG::2013-03-01 14:17:16,752::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2013-03-01 14:17:16,753::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-23::DEBUG::2013-03-01 14:17:16,768::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::INFO::2013-03-01 14:17:16,769::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-23::DEBUG::2013-03-01 14:17:16,769::task::1151::TaskManager.Task::(prepare) Task=`9956c200-8d16-4cd8-b375-ca40ac3998bb`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-23::DEBUG::2013-03-01 14:17:16,770::task::568::TaskManager.Task::(_updateState) Task=`9956c200-8d16-4cd8-b375-ca40ac3998bb`::moving from state preparing -> state finished >Thread-23::DEBUG::2013-03-01 14:17:16,770::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-23::DEBUG::2013-03-01 14:17:16,770::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-23::DEBUG::2013-03-01 14:17:16,770::task::957::TaskManager.Task::(_decref) Task=`9956c200-8d16-4cd8-b375-ca40ac3998bb`::ref 0 aborting False >Thread-24::DEBUG::2013-03-01 14:17:17,475::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-24::DEBUG::2013-03-01 14:17:17,476::task::568::TaskManager.Task::(_updateState) Task=`9dc7cdce-be39-43b7-9757-d3c6893c8285`::moving from state init -> state preparing >Thread-24::INFO::2013-03-01 14:17:17,476::logUtils::37::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.7', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-24::DEBUG::2013-03-01 14:17:17,476::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-24::DEBUG::2013-03-01 14:17:17,490::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-03-01 14:17:17,491::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-24::DEBUG::2013-03-01 14:17:17,505::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: Cannot modify node.startup. Invalid param name.\n'; <rc> = 7 >Thread-24::DEBUG::2013-03-01 14:17:17,505::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-24::DEBUG::2013-03-01 14:17:17,521::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-03-01 14:17:17,522::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --discover' (cwd None) >Thread-24::DEBUG::2013-03-01 14:17:17,539::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-03-01 14:17:17,540::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=delete' (cwd None) >Thread-24::DEBUG::2013-03-01 14:17:17,553::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::INFO::2013-03-01 14:17:17,554::logUtils::39::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-24::DEBUG::2013-03-01 14:17:17,554::task::1151::TaskManager.Task::(prepare) Task=`9dc7cdce-be39-43b7-9757-d3c6893c8285`::finished: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-24::DEBUG::2013-03-01 14:17:17,554::task::568::TaskManager.Task::(_updateState) Task=`9dc7cdce-be39-43b7-9757-d3c6893c8285`::moving from state preparing -> state finished >Thread-24::DEBUG::2013-03-01 14:17:17,554::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2013-03-01 14:17:17,555::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2013-03-01 14:17:17,555::task::957::TaskManager.Task::(_decref) Task=`9dc7cdce-be39-43b7-9757-d3c6893c8285`::ref 0 aborting False >Thread-25::DEBUG::2013-03-01 14:17:18,259::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-25::DEBUG::2013-03-01 14:17:18,260::task::568::TaskManager.Task::(_updateState) Task=`d6d07ae5-a0bb-4867-b455-15c9f89c68da`::moving from state init -> state preparing >Thread-25::INFO::2013-03-01 14:17:18,260::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-25::INFO::2013-03-01 14:17:18,260::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-25::DEBUG::2013-03-01 14:17:18,260::task::1151::TaskManager.Task::(prepare) Task=`d6d07ae5-a0bb-4867-b455-15c9f89c68da`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-25::DEBUG::2013-03-01 14:17:18,260::task::568::TaskManager.Task::(_updateState) Task=`d6d07ae5-a0bb-4867-b455-15c9f89c68da`::moving from state preparing -> state finished >Thread-25::DEBUG::2013-03-01 14:17:18,261::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-25::DEBUG::2013-03-01 14:17:18,261::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-25::DEBUG::2013-03-01 14:17:18,261::task::957::TaskManager.Task::(_decref) Task=`d6d07ae5-a0bb-4867-b455-15c9f89c68da`::ref 0 aborting False >Thread-26::DEBUG::2013-03-01 14:17:18,307::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-26::DEBUG::2013-03-01 14:17:18,307::task::568::TaskManager.Task::(_updateState) Task=`578cf176-c19d-4908-b4c3-4a436f40ce97`::moving from state init -> state preparing >Thread-26::INFO::2013-03-01 14:17:18,308::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-26::DEBUG::2013-03-01 14:17:18,309::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-26::DEBUG::2013-03-01 14:17:18,323::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2013-03-01 14:17:18,324::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-26::DEBUG::2013-03-01 14:17:18,339::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2013-03-01 14:17:18,340::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-26::DEBUG::2013-03-01 14:17:18,354::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::INFO::2013-03-01 14:17:18,355::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-26::DEBUG::2013-03-01 14:17:18,355::task::1151::TaskManager.Task::(prepare) Task=`578cf176-c19d-4908-b4c3-4a436f40ce97`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-26::DEBUG::2013-03-01 14:17:18,356::task::568::TaskManager.Task::(_updateState) Task=`578cf176-c19d-4908-b4c3-4a436f40ce97`::moving from state preparing -> state finished >Thread-26::DEBUG::2013-03-01 14:17:18,356::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26::DEBUG::2013-03-01 14:17:18,356::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26::DEBUG::2013-03-01 14:17:18,356::task::957::TaskManager.Task::(_decref) Task=`578cf176-c19d-4908-b4c3-4a436f40ce97`::ref 0 aborting False >Thread-28::DEBUG::2013-03-01 14:17:19,803::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-28::DEBUG::2013-03-01 14:17:19,804::task::568::TaskManager.Task::(_updateState) Task=`baa62bc7-5a78-4d02-b04b-3e229271a74a`::moving from state init -> state preparing >Thread-28::INFO::2013-03-01 14:17:19,804::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-28::INFO::2013-03-01 14:17:19,804::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-28::DEBUG::2013-03-01 14:17:19,805::task::1151::TaskManager.Task::(prepare) Task=`baa62bc7-5a78-4d02-b04b-3e229271a74a`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-28::DEBUG::2013-03-01 14:17:19,805::task::568::TaskManager.Task::(_updateState) Task=`baa62bc7-5a78-4d02-b04b-3e229271a74a`::moving from state preparing -> state finished >Thread-28::DEBUG::2013-03-01 14:17:19,805::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2013-03-01 14:17:19,805::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2013-03-01 14:17:19,806::task::957::TaskManager.Task::(_decref) Task=`baa62bc7-5a78-4d02-b04b-3e229271a74a`::ref 0 aborting False >Thread-29::DEBUG::2013-03-01 14:17:19,856::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-29::DEBUG::2013-03-01 14:17:19,857::task::568::TaskManager.Task::(_updateState) Task=`f3c3c982-44f0-4aab-8d1d-97d87f837f98`::moving from state init -> state preparing >Thread-29::INFO::2013-03-01 14:17:19,857::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-29::DEBUG::2013-03-01 14:17:19,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-29::DEBUG::2013-03-01 14:17:19,874::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2013-03-01 14:17:19,874::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-29::DEBUG::2013-03-01 14:17:19,890::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2013-03-01 14:17:19,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-29::DEBUG::2013-03-01 14:17:19,905::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::INFO::2013-03-01 14:17:19,905::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2013-03-01 14:17:19,905::task::1151::TaskManager.Task::(prepare) Task=`f3c3c982-44f0-4aab-8d1d-97d87f837f98`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2013-03-01 14:17:19,906::task::568::TaskManager.Task::(_updateState) Task=`f3c3c982-44f0-4aab-8d1d-97d87f837f98`::moving from state preparing -> state finished >Thread-29::DEBUG::2013-03-01 14:17:19,906::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2013-03-01 14:17:19,906::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2013-03-01 14:17:19,906::task::957::TaskManager.Task::(_decref) Task=`f3c3c982-44f0-4aab-8d1d-97d87f837f98`::ref 0 aborting False >Thread-30::DEBUG::2013-03-01 14:17:19,973::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-30::DEBUG::2013-03-01 14:17:19,974::task::568::TaskManager.Task::(_updateState) Task=`ae9a4945-5aff-4dec-9abc-5e39519bfdfe`::moving from state init -> state preparing >Thread-30::INFO::2013-03-01 14:17:19,974::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-30::DEBUG::2013-03-01 14:17:19,974::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-30::DEBUG::2013-03-01 14:17:19,974::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-30::DEBUG::2013-03-01 14:17:19,974::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-30::DEBUG::2013-03-01 14:17:19,975::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-30::DEBUG::2013-03-01 14:17:19,975::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-30::DEBUG::2013-03-01 14:17:20,002::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2013-03-01 14:17:20,002::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:20,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:21,007::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:22,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:22,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:22,015::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:22,017::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:22,019::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:22,021::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-30::DEBUG::2013-03-01 14:17:24,024::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-30::DEBUG::2013-03-01 14:17:26,739::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2013-03-01 14:17:26,740::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,746::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,746::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,747::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,747::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,747::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,748::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-30::DEBUG::2013-03-01 14:17:26,748::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2013-03-01 14:17:26,751::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-30::DEBUG::2013-03-01 14:17:27,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2013-03-01 14:17:27,017::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,024::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,033::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,036::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-0' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,039::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,042::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-1' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,048::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-2' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,053::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,056::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,062::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,064::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-4' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,067::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,070::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-5' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,073::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,075::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-6' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,082::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,085::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-7' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,088::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,091::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-8' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,095::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,098::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-9' (cwd None) >MainProcess|Thread-30::DEBUG::2013-03-01 14:17:27,101::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2013-03-01 14:17:27,103::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a00047d /dev/mapper/3514f0c542a00047c /dev/mapper/3514f0c542a00048d /dev/mapper/3514f0c542a00048e /dev/mapper/3514f0c542a0004af /dev/mapper/3514f0c542a0004b0 /dev/mapper/3514f0c542a0004b1 /dev/mapper/3514f0c542a0004c2 /dev/mapper/3514f0c542a0004c3 /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-30::DEBUG::2013-03-01 14:17:27,378::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a00048d" of volume group "bf265c3d-3861-497d-88b8-523fb1f33269" without -ff\n'; <rc> = 5 >Thread-30::DEBUG::2013-03-01 14:17:27,380::lvm::809::Storage.LVM::(testPVCreate) rc: 5, out: [' Physical volume "/dev/mapper/3514f0c542a00047d" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00047c" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00048e" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004af" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b0" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b1" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004c2" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004c3" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004c4" successfully created'], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a00048d" of volume group "bf265c3d-3861-497d-88b8-523fb1f33269" without -ff'], unusedDevs: set(['/dev/mapper/3514f0c542a0004b0', '/dev/mapper/3514f0c542a0004b1', '/dev/mapper/3514f0c542a00048e', '/dev/mapper/3514f0c542a00047d', '/dev/mapper/3514f0c542a0004c3', '/dev/mapper/3514f0c542a00047c', '/dev/mapper/3514f0c542a0004c2', '/dev/mapper/3514f0c542a0004af', '/dev/mapper/3514f0c542a0004c4']), usedDevs: set(['/dev/mapper/3514f0c542a00048d']) >Thread-30::INFO::2013-03-01 14:17:27,382::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '38'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_7723745efa38428dbd0ceb0a1e7fcce6', 'GUID': '3514f0c542a00047d', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '21474836480', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '37'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_dd63542a8f454e9280ade8ee509a55dd', 'GUID': '3514f0c542a00047c', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'fwrev': '1.05', 'vgUUID': 'oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '39'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j', 'serial': 'SXtremIO_XtremApp_0f7d11d5e5ad4a7b8f97f591308efa8d', 'GUID': '3514f0c542a00048d', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '40'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_dca9feab8cc24243b7f6e14187925513', 'GUID': '3514f0c542a00048e', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '41'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_730ce2ad17314accb85a04521f5c86ad', 'GUID': '3514f0c542a0004af', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '42'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_afe467793e564a2da74785debfa27ead', 'GUID': '3514f0c542a0004b0', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '43'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_4e91dcfebfcb41ceb96af14c09bfe78b', 'GUID': '3514f0c542a0004b1', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '44'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '45'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdk', 'type': 'iSCSI', 'state': 'active', 'lun': '46'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'productID': 'XtremApp'}]} >Thread-30::DEBUG::2013-03-01 14:17:27,382::task::1151::TaskManager.Task::(prepare) Task=`ae9a4945-5aff-4dec-9abc-5e39519bfdfe`::finished: {'devList': [{'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_7723745efa38428dbd0ceb0a1e7fcce6', 'GUID': '3514f0c542a00047d', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdc', 'state': 'active', 'type': 'iSCSI', 'lun': '38'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_dd63542a8f454e9280ade8ee509a55dd', 'GUID': '3514f0c542a00047c', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '21474836480', 'pathstatus': [{'physdev': 'sdb', 'state': 'active', 'type': 'iSCSI', 'lun': '37'}], 'pvUUID': ''}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_0f7d11d5e5ad4a7b8f97f591308efa8d', 'GUID': '3514f0c542a00048d', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'pathstatus': [{'physdev': 'sdd', 'state': 'active', 'type': 'iSCSI', 'lun': '39'}], 'pvUUID': 'fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j'}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_dca9feab8cc24243b7f6e14187925513', 'GUID': '3514f0c542a00048e', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '40'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_730ce2ad17314accb85a04521f5c86ad', 'GUID': '3514f0c542a0004af', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '41'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_afe467793e564a2da74785debfa27ead', 'GUID': '3514f0c542a0004b0', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdg', 'state': 'active', 'type': 'iSCSI', 'lun': '42'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_4e91dcfebfcb41ceb96af14c09bfe78b', 'GUID': '3514f0c542a0004b1', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdh', 'state': 'active', 'type': 'iSCSI', 'lun': '43'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdi', 'state': 'active', 'type': 'iSCSI', 'lun': '44'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdj', 'state': 'active', 'type': 'iSCSI', 'lun': '45'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdk', 'state': 'active', 'type': 'iSCSI', 'lun': '46'}], 'pvUUID': ''}]} >Thread-30::DEBUG::2013-03-01 14:17:27,382::task::568::TaskManager.Task::(_updateState) Task=`ae9a4945-5aff-4dec-9abc-5e39519bfdfe`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-03-01 14:17:27,383::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-03-01 14:17:27,383::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-03-01 14:17:27,383::task::957::TaskManager.Task::(_decref) Task=`ae9a4945-5aff-4dec-9abc-5e39519bfdfe`::ref 0 aborting False >Thread-33::DEBUG::2013-03-01 14:17:27,592::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-33::DEBUG::2013-03-01 14:17:27,593::task::568::TaskManager.Task::(_updateState) Task=`b8ecf67e-b9f5-4a36-baed-ddfbe098fed4`::moving from state init -> state preparing >Thread-33::INFO::2013-03-01 14:17:27,593::logUtils::37::dispatcher::(wrapper) Run and protect: createVG(vgname='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', devlist=['3514f0c542a0004c2'], force=False, options=None) >Thread-33::DEBUG::2013-03-01 14:17:27,596::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a0004c2' (cwd None) >Thread-33::DEBUG::2013-03-01 14:17:27,767::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2013-03-01 14:17:27,767::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:27,768::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:27,768::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/3514f0c542a0004c2' (cwd None) >Thread-33::DEBUG::2013-03-01 14:17:28,008::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2013-03-01 14:17:28,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 5dd04e7f-8474-4d0a-ae61-24f8fd2556de /dev/mapper/3514f0c542a0004c2' (cwd None) >Thread-33::DEBUG::2013-03-01 14:17:28,677::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2013-03-01 14:17:28,678::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:28,678::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:28,678::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:28,679::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:28,679::lvm::880::Storage.LVM::(createVG) Cache after createvg {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': Stub(name='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', stale=True)} >Thread-33::DEBUG::2013-03-01 14:17:28,679::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2013-03-01 14:17:28,680::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-34::DEBUG::2013-03-01 14:17:28,865::task::568::TaskManager.Task::(_updateState) Task=`bf5da6f5-eb63-4e40-a16d-4a01c53fd2e2`::moving from state init -> state preparing >Thread-34::INFO::2013-03-01 14:17:28,866::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-34::INFO::2013-03-01 14:17:28,866::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-34::DEBUG::2013-03-01 14:17:28,866::task::1151::TaskManager.Task::(prepare) Task=`bf5da6f5-eb63-4e40-a16d-4a01c53fd2e2`::finished: {} >Thread-34::DEBUG::2013-03-01 14:17:28,867::task::568::TaskManager.Task::(_updateState) Task=`bf5da6f5-eb63-4e40-a16d-4a01c53fd2e2`::moving from state preparing -> state finished >Thread-34::DEBUG::2013-03-01 14:17:28,867::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2013-03-01 14:17:28,867::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2013-03-01 14:17:28,867::task::957::TaskManager.Task::(_decref) Task=`bf5da6f5-eb63-4e40-a16d-4a01c53fd2e2`::ref 0 aborting False >Thread-33::DEBUG::2013-03-01 14:17:28,927::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2013-03-01 14:17:28,928::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::INFO::2013-03-01 14:17:28,929::logUtils::39::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ'} >Thread-33::DEBUG::2013-03-01 14:17:28,929::task::1151::TaskManager.Task::(prepare) Task=`b8ecf67e-b9f5-4a36-baed-ddfbe098fed4`::finished: {'uuid': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ'} >Thread-33::DEBUG::2013-03-01 14:17:28,929::task::568::TaskManager.Task::(_updateState) Task=`b8ecf67e-b9f5-4a36-baed-ddfbe098fed4`::moving from state preparing -> state finished >Thread-33::DEBUG::2013-03-01 14:17:28,929::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2013-03-01 14:17:28,929::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-33::DEBUG::2013-03-01 14:17:28,930::task::957::TaskManager.Task::(_decref) Task=`b8ecf67e-b9f5-4a36-baed-ddfbe098fed4`::ref 0 aborting False >Thread-36::DEBUG::2013-03-01 14:17:28,969::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-36::DEBUG::2013-03-01 14:17:28,969::task::568::TaskManager.Task::(_updateState) Task=`42470876-eecb-4463-9c58-e2f6dda9d1c1`::moving from state init -> state preparing >Thread-36::INFO::2013-03-01 14:17:28,970::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', domainName='iscsiStorageTest_data_domain0', typeSpecificArg='NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', domClass=1, domVersion='3', options=None) >Thread-36::INFO::2013-03-01 14:17:29,322::blockSD::459::Storage.StorageDomain::(create) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de domainName=iscsiStorageTest_data_domain0 domClass=1 vgUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ storageType=3 version=3 >Thread-36::DEBUG::2013-03-01 14:17:29,322::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:29,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:29,575::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:29,578::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:29,578::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:29,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:29,830::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:29,831::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:29,831::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:29,832::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3514f0c542a0004c2' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:30,084::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:30,085::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-36::INFO::2013-03-01 14:17:30,085::blockSD::444::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-36::DEBUG::2013-03-01 14:17:30,086::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:31,593::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:31,594::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:31,594::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:31,595::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:31,595::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:31,595::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:31,596::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:31,852::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:31,854::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-36::INFO::2013-03-01 14:17:31,855::blockSD::630::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/3514f0c542a0004c2'] >Thread-36::DEBUG::2013-03-01 14:17:31,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:33,367::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:33,368::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:33,368::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:33,368::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:33,369::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:33,369::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/leases' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:33,383::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:33,384::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:34,856::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:34,857::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:34,857::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:34,858::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:34,858::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:34,859::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/ids' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:34,873::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:34,874::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:36,403::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:36,403::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:36,403::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:36,404::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:36,404::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:36,405::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:38,053::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:38,054::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:38,054::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:38,055::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:38,055::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:38,056::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:39,688::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:39,688::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:39,688::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:39,689::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:39,689::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:39,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:39,703::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:39,704::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:39,939::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:39,940::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:40,205::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:40,205::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,206::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,206::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:40,343::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.117381 s, 357 MB/s\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:40,344::misc::344::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.117381 s, 357 MB/s'], size: 41943040 >Thread-36::DEBUG::2013-03-01 14:17:40,344::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:40,355::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00381628 s, 268 MB/s\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:40,355::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00381628 s, 268 MB/s'], size: 1024000 >Thread-36::DEBUG::2013-03-01 14:17:40,356::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:40,365::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00268432 s, 381 MB/s\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:40,365::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00268432 s, 381 MB/s'], size: 1024000 >Thread-36::DEBUG::2013-03-01 14:17:40,365::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-36::DEBUG::2013-03-01 14:17:40,366::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,366::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,367::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,367::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,367::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,368::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:40,904::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:40,906::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,906::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-36::WARNING::2013-03-01 14:17:40,907::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-36::DEBUG::2013-03-01 14:17:40,908::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-36::DEBUG::2013-03-01 14:17:40,908::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-36::DEBUG::2013-03-01 14:17:40,909::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485'] >Thread-36::DEBUG::2013-03-01 14:17:40,909::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,909::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,910::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,910::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,910::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:40,911::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:41,164::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:41,166::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:41,166::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ, MDT_ROLE=Regular, MDT_POOL_UUID=, MDT_LEASERETRIES=3, MDT_CLASS=Data, MDT_LOCKRENEWALINTERVALSEC=5, MDT_LOGBLKSIZE=512, MDT_DESCRIPTION=iscsiStorageTest_data_domain0, MDT_SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de, MDT_LEASETIMESEC=5, MDT__SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485, MDT_VERSION=3, MDT_LOCKPOLICY=, MDT_PV0=pv:3514f0c542a0004c2&44&uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn&44&pestart:0&44&pecount:397&44&mapoffset:0, MDT_TYPE=ISCSI, MDT_PHYBLKSIZE=4096, MDT_IOOPTIMEOUTSEC=1 removing= >Thread-36::DEBUG::2013-03-01 14:17:41,168::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_PHYBLKSIZE=4096 --addtag MDT_ROLE=Regular --addtag MDT_DESCRIPTION=iscsiStorageTest_data_domain0 --addtag MDT_VERSION=3 --addtag MDT_TYPE=ISCSI --addtag MDT_VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ --addtag MDT_PV0=pv:3514f0c542a0004c2&44&uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn&44&pestart:0&44&pecount:397&44&mapoffset:0 --addtag MDT_LOGBLKSIZE=512 --addtag MDT_LEASERETRIES=3 --addtag MDT_LEASETIMESEC=5 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_LOCKPOLICY= --addtag MDT_POOL_UUID= --addtag MDT_IOOPTIMEOUTSEC=1 --addtag MDT_CLASS=Data --addtag MDT__SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485 --addtag MDT_SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:41,598::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:41,598::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:41,599::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:41,599::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-36::DEBUG::2013-03-01 14:17:41,600::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:42,034::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:42,035::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,035::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,036::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-36::DEBUG::2013-03-01 14:17:42,036::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:42,043::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000269726 s, 7.6 MB/s\n'; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:42,044::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000269726 s, 7.6 MB/s'], size: 2048 >Thread-36::DEBUG::2013-03-01 14:17:42,044::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-36::WARNING::2013-03-01 14:17:42,044::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-36::DEBUG::2013-03-01 14:17:42,045::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-36::DEBUG::2013-03-01 14:17:42,045::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,045::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,046::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,046::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,047::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,048::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:42,299::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:42,301::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:42,302::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', '_SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de'] >Thread-36::DEBUG::2013-03-01 14:17:42,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-36::DEBUG::2013-03-01 14:17:43,955::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2013-03-01 14:17:43,956::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:43,956::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-36::DEBUG::2013-03-01 14:17:43,957::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS' >Thread-36::DEBUG::2013-03-01 14:17:43,957::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS' >Thread-36::DEBUG::2013-03-01 14:17:43,958::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS' >Thread-36::DEBUG::2013-03-01 14:17:43,958::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-36::DEBUG::2013-03-01 14:17:43,969::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-36::INFO::2013-03-01 14:17:43,969::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-36::DEBUG::2013-03-01 14:17:43,969::task::1151::TaskManager.Task::(prepare) Task=`42470876-eecb-4463-9c58-e2f6dda9d1c1`::finished: None >Thread-36::DEBUG::2013-03-01 14:17:43,969::task::568::TaskManager.Task::(_updateState) Task=`42470876-eecb-4463-9c58-e2f6dda9d1c1`::moving from state preparing -> state finished >Thread-36::DEBUG::2013-03-01 14:17:43,969::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2013-03-01 14:17:43,970::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2013-03-01 14:17:43,970::task::957::TaskManager.Task::(_decref) Task=`42470876-eecb-4463-9c58-e2f6dda9d1c1`::ref 0 aborting False >Thread-64::DEBUG::2013-03-01 14:17:44,024::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-64::DEBUG::2013-03-01 14:17:44,025::task::568::TaskManager.Task::(_updateState) Task=`c6a2390f-dfe2-48f8-82e2-dcfce455fccd`::moving from state init -> state preparing >Thread-64::INFO::2013-03-01 14:17:44,025::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', options=None) >Thread-64::DEBUG::2013-03-01 14:17:44,025::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`74d85b20-de8e-4661-99da-cf205ab79465`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-64::DEBUG::2013-03-01 14:17:44,025::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' for lock type 'shared' >Thread-64::DEBUG::2013-03-01 14:17:44,026::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free. Now locking as 'shared' (1 active user) >Thread-64::DEBUG::2013-03-01 14:17:44,026::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`74d85b20-de8e-4661-99da-cf205ab79465`::Granted request >Thread-64::DEBUG::2013-03-01 14:17:44,026::task::794::TaskManager.Task::(resourceAcquired) Task=`c6a2390f-dfe2-48f8-82e2-dcfce455fccd`::_resourcesAcquired: Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de (shared) >Thread-64::DEBUG::2013-03-01 14:17:44,027::task::957::TaskManager.Task::(_decref) Task=`c6a2390f-dfe2-48f8-82e2-dcfce455fccd`::ref 1 aborting False >Thread-64::DEBUG::2013-03-01 14:17:44,042::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 14:17:44,042::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 14:17:44,043::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 14:17:44,043::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2013-03-01 14:17:44,043::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-64::DEBUG::2013-03-01 14:17:44,044::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-64::DEBUG::2013-03-01 14:17:44,051::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000306855 s, 6.7 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2013-03-01 14:17:44,052::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000306855 s, 6.7 MB/s'], size: 2048 >Thread-64::DEBUG::2013-03-01 14:17:44,052::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-64::WARNING::2013-03-01 14:17:44,052::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-64::DEBUG::2013-03-01 14:17:44,053::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-64::DEBUG::2013-03-01 14:17:44,053::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2013-03-01 14:17:44,054::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-65::DEBUG::2013-03-01 14:17:44,245::task::568::TaskManager.Task::(_updateState) Task=`d063c297-1fb9-4090-aa1c-69846b38a336`::moving from state init -> state preparing >Thread-65::INFO::2013-03-01 14:17:44,246::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-65::INFO::2013-03-01 14:17:44,246::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-65::DEBUG::2013-03-01 14:17:44,246::task::1151::TaskManager.Task::(prepare) Task=`d063c297-1fb9-4090-aa1c-69846b38a336`::finished: {} >Thread-65::DEBUG::2013-03-01 14:17:44,247::task::568::TaskManager.Task::(_updateState) Task=`d063c297-1fb9-4090-aa1c-69846b38a336`::moving from state preparing -> state finished >Thread-65::DEBUG::2013-03-01 14:17:44,247::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-65::DEBUG::2013-03-01 14:17:44,247::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2013-03-01 14:17:44,247::task::957::TaskManager.Task::(_decref) Task=`d063c297-1fb9-4090-aa1c-69846b38a336`::ref 0 aborting False >Thread-64::DEBUG::2013-03-01 14:17:44,259::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2013-03-01 14:17:44,260::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::INFO::2013-03-01 14:17:44,261::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-64::DEBUG::2013-03-01 14:17:44,261::task::1151::TaskManager.Task::(prepare) Task=`c6a2390f-dfe2-48f8-82e2-dcfce455fccd`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-64::DEBUG::2013-03-01 14:17:44,261::task::568::TaskManager.Task::(_updateState) Task=`c6a2390f-dfe2-48f8-82e2-dcfce455fccd`::moving from state preparing -> state finished >Thread-64::DEBUG::2013-03-01 14:17:44,261::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de': < ResourceRef 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', isValid: 'True' obj: 'None'>} >Thread-64::DEBUG::2013-03-01 14:17:44,261::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2013-03-01 14:17:44,262::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' >Thread-64::DEBUG::2013-03-01 14:17:44,262::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (0 active users) >Thread-64::DEBUG::2013-03-01 14:17:44,262::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free, finding out if anyone is waiting for it. >Thread-64::DEBUG::2013-03-01 14:17:44,262::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', Clearing records. >Thread-64::DEBUG::2013-03-01 14:17:44,263::task::957::TaskManager.Task::(_decref) Task=`c6a2390f-dfe2-48f8-82e2-dcfce455fccd`::ref 0 aborting False >Thread-67::DEBUG::2013-03-01 14:17:44,398::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-67::DEBUG::2013-03-01 14:17:44,398::task::568::TaskManager.Task::(_updateState) Task=`77e95e0d-d39e-41a5-af70-cb2f216f5b49`::moving from state init -> state preparing >Thread-67::INFO::2013-03-01 14:17:44,399::logUtils::37::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', options=None) >MainProcess|Thread-67::DEBUG::2013-03-01 14:17:44,400::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-67::DEBUG::2013-03-01 14:17:44,404::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-67::DEBUG::2013-03-01 14:17:44,411::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-7' (cwd None) >MainProcess|Thread-67::DEBUG::2013-03-01 14:17:44,414::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-67::INFO::2013-03-01 14:17:44,418::logUtils::39::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'vgfree': '49123688448', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'state': 'active', 'type': 'iSCSI', 'lun': '44'}], 'devtype': 'iSCSI', 'pvUUID': 'S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-67::DEBUG::2013-03-01 14:17:44,419::task::1151::TaskManager.Task::(prepare) Task=`77e95e0d-d39e-41a5-af70-cb2f216f5b49`::finished: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'vgfree': '49123688448', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'state': 'active', 'type': 'iSCSI', 'lun': '44'}], 'devtype': 'iSCSI', 'pvUUID': 'S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-67::DEBUG::2013-03-01 14:17:44,419::task::568::TaskManager.Task::(_updateState) Task=`77e95e0d-d39e-41a5-af70-cb2f216f5b49`::moving from state preparing -> state finished >Thread-67::DEBUG::2013-03-01 14:17:44,419::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2013-03-01 14:17:44,419::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2013-03-01 14:17:44,420::task::957::TaskManager.Task::(_decref) Task=`77e95e0d-d39e-41a5-af70-cb2f216f5b49`::ref 0 aborting False >Thread-68::DEBUG::2013-03-01 14:17:45,947::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-68::DEBUG::2013-03-01 14:17:45,947::task::568::TaskManager.Task::(_updateState) Task=`74eebe69-c6c1-462c-87ef-4ba865c2190d`::moving from state init -> state preparing >Thread-68::INFO::2013-03-01 14:17:45,947::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-68::INFO::2013-03-01 14:17:45,948::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-68::DEBUG::2013-03-01 14:17:45,948::task::1151::TaskManager.Task::(prepare) Task=`74eebe69-c6c1-462c-87ef-4ba865c2190d`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-68::DEBUG::2013-03-01 14:17:45,948::task::568::TaskManager.Task::(_updateState) Task=`74eebe69-c6c1-462c-87ef-4ba865c2190d`::moving from state preparing -> state finished >Thread-68::DEBUG::2013-03-01 14:17:45,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-68::DEBUG::2013-03-01 14:17:45,948::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2013-03-01 14:17:45,948::task::957::TaskManager.Task::(_decref) Task=`74eebe69-c6c1-462c-87ef-4ba865c2190d`::ref 0 aborting False >Thread-69::DEBUG::2013-03-01 14:17:45,994::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-69::DEBUG::2013-03-01 14:17:45,995::task::568::TaskManager.Task::(_updateState) Task=`db58d125-c04d-4a5b-a29f-f4d1016bbe41`::moving from state init -> state preparing >Thread-69::INFO::2013-03-01 14:17:45,995::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-69::DEBUG::2013-03-01 14:17:45,995::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-69::DEBUG::2013-03-01 14:17:46,013::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-69::DEBUG::2013-03-01 14:17:46,014::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-69::DEBUG::2013-03-01 14:17:46,031::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-69::DEBUG::2013-03-01 14:17:46,031::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-69::DEBUG::2013-03-01 14:17:46,046::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-69::INFO::2013-03-01 14:17:46,047::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-69::DEBUG::2013-03-01 14:17:46,047::task::1151::TaskManager.Task::(prepare) Task=`db58d125-c04d-4a5b-a29f-f4d1016bbe41`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-69::DEBUG::2013-03-01 14:17:46,048::task::568::TaskManager.Task::(_updateState) Task=`db58d125-c04d-4a5b-a29f-f4d1016bbe41`::moving from state preparing -> state finished >Thread-69::DEBUG::2013-03-01 14:17:46,048::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69::DEBUG::2013-03-01 14:17:46,048::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2013-03-01 14:17:46,049::task::957::TaskManager.Task::(_decref) Task=`db58d125-c04d-4a5b-a29f-f4d1016bbe41`::ref 0 aborting False >Thread-70::DEBUG::2013-03-01 14:17:46,092::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-70::DEBUG::2013-03-01 14:17:46,093::task::568::TaskManager.Task::(_updateState) Task=`266d9783-cb07-4788-903a-be09c2b07d36`::moving from state init -> state preparing >Thread-70::INFO::2013-03-01 14:17:46,093::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-70::DEBUG::2013-03-01 14:17:46,094::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-70::DEBUG::2013-03-01 14:17:46,094::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-70::DEBUG::2013-03-01 14:17:46,094::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-70::DEBUG::2013-03-01 14:17:46,094::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-70::DEBUG::2013-03-01 14:17:46,095::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-70::DEBUG::2013-03-01 14:17:46,122::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-70::DEBUG::2013-03-01 14:17:46,123::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:46,124::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:47,128::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:47,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:47,133::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:47,136::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:47,138::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:47,139::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:48,142::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-70::DEBUG::2013-03-01 14:17:50,146::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-70::DEBUG::2013-03-01 14:17:52,924::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-70::DEBUG::2013-03-01 14:17:52,925::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,925::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,926::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,926::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,926::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,926::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,927::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-70::DEBUG::2013-03-01 14:17:52,927::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-70::DEBUG::2013-03-01 14:17:52,930::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-70::DEBUG::2013-03-01 14:17:53,144::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-70::DEBUG::2013-03-01 14:17:53,144::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,148::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-0' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,154::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,157::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-1' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,160::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,162::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-2' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,164::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,167::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,170::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-4' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,175::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,177::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-5' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,180::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,182::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-6' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,184::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,187::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-7' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,189::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,192::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-8' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,194::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,196::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-9' (cwd None) >MainProcess|Thread-70::DEBUG::2013-03-01 14:17:53,198::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-70::DEBUG::2013-03-01 14:17:53,201::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a00047d /dev/mapper/3514f0c542a00047c /dev/mapper/3514f0c542a00048d /dev/mapper/3514f0c542a00048e /dev/mapper/3514f0c542a0004af /dev/mapper/3514f0c542a0004b0 /dev/mapper/3514f0c542a0004b1 /dev/mapper/3514f0c542a0004c2 /dev/mapper/3514f0c542a0004c3 /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-70::DEBUG::2013-03-01 14:17:53,493::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a00048d" of volume group "bf265c3d-3861-497d-88b8-523fb1f33269" without -ff\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004c2" of volume group "5dd04e7f-8474-4d0a-ae61-24f8fd2556de" without -ff\n'; <rc> = 5 >Thread-70::DEBUG::2013-03-01 14:17:53,497::lvm::809::Storage.LVM::(testPVCreate) rc: 5, out: [' Physical volume "/dev/mapper/3514f0c542a00047d" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00047c" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00048e" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004af" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b0" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b1" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004c3" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004c4" successfully created'], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a00048d" of volume group "bf265c3d-3861-497d-88b8-523fb1f33269" without -ff', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004c2" of volume group "5dd04e7f-8474-4d0a-ae61-24f8fd2556de" without -ff'], unusedDevs: set(['/dev/mapper/3514f0c542a0004b0', '/dev/mapper/3514f0c542a0004b1', '/dev/mapper/3514f0c542a00048e', '/dev/mapper/3514f0c542a00047d', '/dev/mapper/3514f0c542a0004c3', '/dev/mapper/3514f0c542a00047c', '/dev/mapper/3514f0c542a0004af', '/dev/mapper/3514f0c542a0004c4']), usedDevs: set(['/dev/mapper/3514f0c542a0004c2', '/dev/mapper/3514f0c542a00048d']) >Thread-70::INFO::2013-03-01 14:17:53,498::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '38'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_7723745efa38428dbd0ceb0a1e7fcce6', 'GUID': '3514f0c542a00047d', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '21474836480', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '37'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_dd63542a8f454e9280ade8ee509a55dd', 'GUID': '3514f0c542a00047c', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'fwrev': '1.05', 'vgUUID': 'oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '39'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j', 'serial': 'SXtremIO_XtremApp_0f7d11d5e5ad4a7b8f97f591308efa8d', 'GUID': '3514f0c542a00048d', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '40'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_dca9feab8cc24243b7f6e14187925513', 'GUID': '3514f0c542a00048e', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '41'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_730ce2ad17314accb85a04521f5c86ad', 'GUID': '3514f0c542a0004af', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '42'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_afe467793e564a2da74785debfa27ead', 'GUID': '3514f0c542a0004b0', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '43'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_4e91dcfebfcb41ceb96af14c09bfe78b', 'GUID': '3514f0c542a0004b1', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '44'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '45'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdk', 'type': 'iSCSI', 'state': 'active', 'lun': '46'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'productID': 'XtremApp'}]} >Thread-70::DEBUG::2013-03-01 14:17:53,499::task::1151::TaskManager.Task::(prepare) Task=`266d9783-cb07-4788-903a-be09c2b07d36`::finished: {'devList': [{'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_7723745efa38428dbd0ceb0a1e7fcce6', 'GUID': '3514f0c542a00047d', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdc', 'state': 'active', 'type': 'iSCSI', 'lun': '38'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_dd63542a8f454e9280ade8ee509a55dd', 'GUID': '3514f0c542a00047c', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '21474836480', 'pathstatus': [{'physdev': 'sdb', 'state': 'active', 'type': 'iSCSI', 'lun': '37'}], 'pvUUID': ''}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_0f7d11d5e5ad4a7b8f97f591308efa8d', 'GUID': '3514f0c542a00048d', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'pathstatus': [{'physdev': 'sdd', 'state': 'active', 'type': 'iSCSI', 'lun': '39'}], 'pvUUID': 'fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j'}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_dca9feab8cc24243b7f6e14187925513', 'GUID': '3514f0c542a00048e', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '40'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_730ce2ad17314accb85a04521f5c86ad', 'GUID': '3514f0c542a0004af', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '41'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_afe467793e564a2da74785debfa27ead', 'GUID': '3514f0c542a0004b0', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdg', 'state': 'active', 'type': 'iSCSI', 'lun': '42'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_4e91dcfebfcb41ceb96af14c09bfe78b', 'GUID': '3514f0c542a0004b1', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdh', 'state': 'active', 'type': 'iSCSI', 'lun': '43'}], 'pvUUID': ''}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdi', 'state': 'active', 'type': 'iSCSI', 'lun': '44'}], 'pvUUID': 'S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn'}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdj', 'state': 'active', 'type': 'iSCSI', 'lun': '45'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdk', 'state': 'active', 'type': 'iSCSI', 'lun': '46'}], 'pvUUID': ''}]} >Thread-70::DEBUG::2013-03-01 14:17:53,499::task::568::TaskManager.Task::(_updateState) Task=`266d9783-cb07-4788-903a-be09c2b07d36`::moving from state preparing -> state finished >Thread-70::DEBUG::2013-03-01 14:17:53,499::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2013-03-01 14:17:53,500::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2013-03-01 14:17:53,500::task::957::TaskManager.Task::(_decref) Task=`266d9783-cb07-4788-903a-be09c2b07d36`::ref 0 aborting False >Thread-74::DEBUG::2013-03-01 14:17:53,654::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-74::DEBUG::2013-03-01 14:17:53,654::task::568::TaskManager.Task::(_updateState) Task=`ba518b1c-98be-43de-b161-1c629874de15`::moving from state init -> state preparing >Thread-74::INFO::2013-03-01 14:17:53,655::logUtils::37::dispatcher::(wrapper) Run and protect: createVG(vgname='04bf19fa-db6c-4c8f-845f-b87411d8e898', devlist=['3514f0c542a0004c3'], force=False, options=None) >Thread-74::DEBUG::2013-03-01 14:17:53,657::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a0004c3' (cwd None) >Thread-74::DEBUG::2013-03-01 14:17:53,866::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2013-03-01 14:17:53,867::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:53,867::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:53,868::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/3514f0c542a0004c3' (cwd None) >Thread-74::DEBUG::2013-03-01 14:17:54,161::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2013-03-01 14:17:54,162::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 04bf19fa-db6c-4c8f-845f-b87411d8e898 /dev/mapper/3514f0c542a0004c3' (cwd None) >Thread-74::DEBUG::2013-03-01 14:17:54,723::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2013-03-01 14:17:54,724::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:54,724::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:54,725::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:54,725::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:54,725::lvm::880::Storage.LVM::(createVG) Cache after createvg {'04bf19fa-db6c-4c8f-845f-b87411d8e898': Stub(name='04bf19fa-db6c-4c8f-845f-b87411d8e898', stale=True)} >Thread-74::DEBUG::2013-03-01 14:17:54,725::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-74::DEBUG::2013-03-01 14:17:54,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-74::DEBUG::2013-03-01 14:17:54,937::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2013-03-01 14:17:54,939::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-74::INFO::2013-03-01 14:17:54,939::logUtils::39::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD'} >Thread-74::DEBUG::2013-03-01 14:17:54,939::task::1151::TaskManager.Task::(prepare) Task=`ba518b1c-98be-43de-b161-1c629874de15`::finished: {'uuid': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD'} >Thread-74::DEBUG::2013-03-01 14:17:54,940::task::568::TaskManager.Task::(_updateState) Task=`ba518b1c-98be-43de-b161-1c629874de15`::moving from state preparing -> state finished >Thread-74::DEBUG::2013-03-01 14:17:54,940::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-74::DEBUG::2013-03-01 14:17:54,940::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2013-03-01 14:17:54,940::task::957::TaskManager.Task::(_decref) Task=`ba518b1c-98be-43de-b161-1c629874de15`::ref 0 aborting False >Thread-75::DEBUG::2013-03-01 14:17:54,994::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-75::DEBUG::2013-03-01 14:17:54,994::task::568::TaskManager.Task::(_updateState) Task=`ca6b63bb-02a6-4180-b499-48c41c1c0e07`::moving from state init -> state preparing >Thread-75::INFO::2013-03-01 14:17:54,994::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='04bf19fa-db6c-4c8f-845f-b87411d8e898', domainName='iscsiStorageTest_data_domain1', typeSpecificArg='GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', domClass=1, domVersion='3', options=None) >Thread-75::INFO::2013-03-01 14:17:55,032::blockSD::459::Storage.StorageDomain::(create) sdUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898 domainName=iscsiStorageTest_data_domain1 domClass=1 vgUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD storageType=3 version=3 >Thread-75::DEBUG::2013-03-01 14:17:55,032::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:55,032::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:55,251::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:55,255::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:55,255::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:55,256::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:55,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:55,459::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:55,460::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:55,460::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3514f0c542a0004c3' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:55,667::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:55,668::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-75::INFO::2013-03-01 14:17:55,668::blockSD::444::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-75::DEBUG::2013-03-01 14:17:55,669::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:57,340::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:57,340::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:57,341::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:57,341::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:57,341::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:57,342::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:57,342::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:57,540::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:57,542::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-75::INFO::2013-03-01 14:17:57,542::blockSD::630::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/3514f0c542a0004c3'] >Thread-75::DEBUG::2013-03-01 14:17:57,543::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:59,211::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:59,211::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:59,212::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:59,212::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:59,213::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:17:59,213::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/leases' (cwd None) >Thread-75::DEBUG::2013-03-01 14:17:59,227::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:17:59,228::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-100::DEBUG::2013-03-01 14:17:59,634::task::568::TaskManager.Task::(_updateState) Task=`9b4eb00d-a5d9-4f52-a99d-ed2df425eb1d`::moving from state init -> state preparing >Thread-100::INFO::2013-03-01 14:17:59,635::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-100::INFO::2013-03-01 14:17:59,635::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-100::DEBUG::2013-03-01 14:17:59,635::task::1151::TaskManager.Task::(prepare) Task=`9b4eb00d-a5d9-4f52-a99d-ed2df425eb1d`::finished: {} >Thread-100::DEBUG::2013-03-01 14:17:59,635::task::568::TaskManager.Task::(_updateState) Task=`9b4eb00d-a5d9-4f52-a99d-ed2df425eb1d`::moving from state preparing -> state finished >Thread-100::DEBUG::2013-03-01 14:17:59,636::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2013-03-01 14:17:59,636::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2013-03-01 14:17:59,636::task::957::TaskManager.Task::(_decref) Task=`9b4eb00d-a5d9-4f52-a99d-ed2df425eb1d`::ref 0 aborting False >Thread-75::DEBUG::2013-03-01 14:18:01,410::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:01,410::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:01,410::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:01,410::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:01,411::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:01,411::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/ids' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:01,425::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:01,426::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:03,399::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:03,399::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:03,400::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:03,400::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:03,401::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:03,402::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:05,216::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:05,217::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:05,223::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:05,224::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:05,224::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:05,225::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,061::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,062::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,062::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,062::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,063::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/master' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,078::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,078::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/master' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,230::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,231::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 04bf19fa-db6c-4c8f-845f-b87411d8e898/master' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,450::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,450::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,450::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,451::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,579::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.120982 s, 347 MB/s\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,579::misc::344::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.120982 s, 347 MB/s'], size: 41943040 >Thread-75::DEBUG::2013-03-01 14:18:07,580::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,590::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00347876 s, 294 MB/s\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,591::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00347876 s, 294 MB/s'], size: 1024000 >Thread-75::DEBUG::2013-03-01 14:18:07,591::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:07,601::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00323941 s, 316 MB/s\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:07,601::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00323941 s, 316 MB/s'], size: 1024000 >Thread-75::DEBUG::2013-03-01 14:18:07,602::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-75::DEBUG::2013-03-01 14:18:07,602::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,603::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,603::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,603::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,604::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:07,604::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:08,127::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:08,129::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,129::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-75::WARNING::2013-03-01 14:18:08,129::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-75::DEBUG::2013-03-01 14:18:08,131::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-75::DEBUG::2013-03-01 14:18:08,131::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-75::DEBUG::2013-03-01 14:18:08,132::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', '_SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0'] >Thread-75::DEBUG::2013-03-01 14:18:08,132::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,132::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,133::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,133::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,133::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,134::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:08,333::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:08,335::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,335::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD, MDT_POOL_UUID=, MDT_SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898, MDT_LEASERETRIES=3, MDT_CLASS=Data, MDT_LOCKRENEWALINTERVALSEC=5, MDT_LOGBLKSIZE=512, MDT_LEASETIMESEC=5, MDT_PV0=pv:3514f0c542a0004c3&44&uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo&44&pestart:0&44&pecount:397&44&mapoffset:0, MDT_VERSION=3, MDT__SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0, MDT_ROLE=Regular, MDT_DESCRIPTION=iscsiStorageTest_data_domain1, MDT_LOCKPOLICY=, MDT_TYPE=ISCSI, MDT_PHYBLKSIZE=4096, MDT_IOOPTIMEOUTSEC=1 removing= >Thread-75::DEBUG::2013-03-01 14:18:08,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_PHYBLKSIZE=4096 --addtag MDT_PV0=pv:3514f0c542a0004c3&44&uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo&44&pestart:0&44&pecount:397&44&mapoffset:0 --addtag MDT_CLASS=Data --addtag MDT_VERSION=3 --addtag MDT_TYPE=ISCSI --addtag MDT_LOGBLKSIZE=512 --addtag MDT_LEASERETRIES=3 --addtag MDT_LEASETIMESEC=5 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_ROLE=Regular --addtag MDT_SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898 --addtag MDT__SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0 --addtag MDT_VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD --addtag MDT_IOOPTIMEOUTSEC=1 --addtag MDT_POOL_UUID= --addtag MDT_LOCKPOLICY= --addtag MDT_DESCRIPTION=iscsiStorageTest_data_domain1 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:08,830::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:08,830::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,831::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:08,831::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-75::DEBUG::2013-03-01 14:18:08,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:09,248::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:09,249::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,249::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,249::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-75::DEBUG::2013-03-01 14:18:09,250::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:09,257::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00032241 s, 6.4 MB/s\n'; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:09,257::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00032241 s, 6.4 MB/s'], size: 2048 >Thread-75::DEBUG::2013-03-01 14:18:09,257::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-75::WARNING::2013-03-01 14:18:09,258::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-75::DEBUG::2013-03-01 14:18:09,258::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-75::DEBUG::2013-03-01 14:18:09,259::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,259::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,259::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,260::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,260::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:09,481::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:09,482::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:09,483::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', '_SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1'] >Thread-75::DEBUG::2013-03-01 14:18:09,484::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 04bf19fa-db6c-4c8f-845f-b87411d8e898/master' (cwd None) >Thread-75::DEBUG::2013-03-01 14:18:11,305::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-75::DEBUG::2013-03-01 14:18:11,305::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:11,306::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-75::DEBUG::2013-03-01 14:18:11,306::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '04bf19fa-db6c-4c8f-845f-b87411d8e898_imageNS' >Thread-75::DEBUG::2013-03-01 14:18:11,307::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '04bf19fa-db6c-4c8f-845f-b87411d8e898_volumeNS' >Thread-75::DEBUG::2013-03-01 14:18:11,307::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '04bf19fa-db6c-4c8f-845f-b87411d8e898_lvmActivationNS' >Thread-75::DEBUG::2013-03-01 14:18:11,307::clusterlock::136::initSANLock::(initSANLock) Initializing SANLock for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-75::DEBUG::2013-03-01 14:18:11,317::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-75::INFO::2013-03-01 14:18:11,317::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-75::DEBUG::2013-03-01 14:18:11,317::task::1151::TaskManager.Task::(prepare) Task=`ca6b63bb-02a6-4180-b499-48c41c1c0e07`::finished: None >Thread-75::DEBUG::2013-03-01 14:18:11,317::task::568::TaskManager.Task::(_updateState) Task=`ca6b63bb-02a6-4180-b499-48c41c1c0e07`::moving from state preparing -> state finished >Thread-75::DEBUG::2013-03-01 14:18:11,318::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-75::DEBUG::2013-03-01 14:18:11,318::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-75::DEBUG::2013-03-01 14:18:11,318::task::957::TaskManager.Task::(_decref) Task=`ca6b63bb-02a6-4180-b499-48c41c1c0e07`::ref 0 aborting False >Thread-105::DEBUG::2013-03-01 14:18:11,353::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-105::DEBUG::2013-03-01 14:18:11,353::task::568::TaskManager.Task::(_updateState) Task=`916902b2-3faa-474d-b313-3985f53b9a64`::moving from state init -> state preparing >Thread-105::INFO::2013-03-01 14:18:11,353::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='04bf19fa-db6c-4c8f-845f-b87411d8e898', options=None) >Thread-105::DEBUG::2013-03-01 14:18:11,354::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`18562b2c-a9e6-4363-a95a-9d8614dca7dd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-105::DEBUG::2013-03-01 14:18:11,354::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' for lock type 'shared' >Thread-105::DEBUG::2013-03-01 14:18:11,354::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free. Now locking as 'shared' (1 active user) >Thread-105::DEBUG::2013-03-01 14:18:11,355::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`18562b2c-a9e6-4363-a95a-9d8614dca7dd`::Granted request >Thread-105::DEBUG::2013-03-01 14:18:11,355::task::794::TaskManager.Task::(resourceAcquired) Task=`916902b2-3faa-474d-b313-3985f53b9a64`::_resourcesAcquired: Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898 (shared) >Thread-105::DEBUG::2013-03-01 14:18:11,355::task::957::TaskManager.Task::(_decref) Task=`916902b2-3faa-474d-b313-3985f53b9a64`::ref 1 aborting False >Thread-105::DEBUG::2013-03-01 14:18:11,357::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 14:18:11,357::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 14:18:11,358::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 14:18:11,358::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2013-03-01 14:18:11,358::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-105::DEBUG::2013-03-01 14:18:11,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-105::DEBUG::2013-03-01 14:18:11,364::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00029133 s, 7.0 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2013-03-01 14:18:11,365::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00029133 s, 7.0 MB/s'], size: 2048 >Thread-105::DEBUG::2013-03-01 14:18:11,365::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-105::WARNING::2013-03-01 14:18:11,365::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-105::DEBUG::2013-03-01 14:18:11,366::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-105::DEBUG::2013-03-01 14:18:11,366::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-105::DEBUG::2013-03-01 14:18:11,367::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-105::DEBUG::2013-03-01 14:18:11,612::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2013-03-01 14:18:11,614::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-105::INFO::2013-03-01 14:18:11,614::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-105::DEBUG::2013-03-01 14:18:11,614::task::1151::TaskManager.Task::(prepare) Task=`916902b2-3faa-474d-b313-3985f53b9a64`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67104768'}} >Thread-105::DEBUG::2013-03-01 14:18:11,614::task::568::TaskManager.Task::(_updateState) Task=`916902b2-3faa-474d-b313-3985f53b9a64`::moving from state preparing -> state finished >Thread-105::DEBUG::2013-03-01 14:18:11,615::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898': < ResourceRef 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', isValid: 'True' obj: 'None'>} >Thread-105::DEBUG::2013-03-01 14:18:11,615::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2013-03-01 14:18:11,615::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' >Thread-105::DEBUG::2013-03-01 14:18:11,616::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' (0 active users) >Thread-105::DEBUG::2013-03-01 14:18:11,616::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free, finding out if anyone is waiting for it. >Thread-105::DEBUG::2013-03-01 14:18:11,616::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', Clearing records. >Thread-105::DEBUG::2013-03-01 14:18:11,617::task::957::TaskManager.Task::(_decref) Task=`916902b2-3faa-474d-b313-3985f53b9a64`::ref 0 aborting False >Thread-106::DEBUG::2013-03-01 14:18:11,656::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-106::DEBUG::2013-03-01 14:18:11,657::task::568::TaskManager.Task::(_updateState) Task=`82b7497c-8029-4ca7-b7b0-961c0519f938`::moving from state init -> state preparing >Thread-106::INFO::2013-03-01 14:18:11,657::logUtils::37::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', options=None) >MainProcess|Thread-106::DEBUG::2013-03-01 14:18:11,660::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-106::DEBUG::2013-03-01 14:18:11,664::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-106::DEBUG::2013-03-01 14:18:11,671::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-8' (cwd None) >MainProcess|Thread-106::DEBUG::2013-03-01 14:18:11,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-106::INFO::2013-03-01 14:18:11,678::logUtils::39::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '04bf19fa-db6c-4c8f-845f-b87411d8e898', 'vgfree': '49123688448', 'vgUUID': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdj', 'state': 'active', 'type': 'iSCSI', 'lun': '45'}], 'devtype': 'iSCSI', 'pvUUID': 'nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-106::DEBUG::2013-03-01 14:18:11,679::task::1151::TaskManager.Task::(prepare) Task=`82b7497c-8029-4ca7-b7b0-961c0519f938`::finished: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '04bf19fa-db6c-4c8f-845f-b87411d8e898', 'vgfree': '49123688448', 'vgUUID': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdj', 'state': 'active', 'type': 'iSCSI', 'lun': '45'}], 'devtype': 'iSCSI', 'pvUUID': 'nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-106::DEBUG::2013-03-01 14:18:11,679::task::568::TaskManager.Task::(_updateState) Task=`82b7497c-8029-4ca7-b7b0-961c0519f938`::moving from state preparing -> state finished >Thread-106::DEBUG::2013-03-01 14:18:11,679::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-106::DEBUG::2013-03-01 14:18:11,679::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-106::DEBUG::2013-03-01 14:18:11,679::task::957::TaskManager.Task::(_decref) Task=`82b7497c-8029-4ca7-b7b0-961c0519f938`::ref 0 aborting False >Thread-108::DEBUG::2013-03-01 14:18:12,797::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-108::DEBUG::2013-03-01 14:18:12,798::task::568::TaskManager.Task::(_updateState) Task=`b41ae1cc-7ff0-4f44-b562-694ada7c4409`::moving from state init -> state preparing >Thread-108::INFO::2013-03-01 14:18:12,798::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8fd46635-c46a-47a7-b122-316b2df29251', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7', 'port': '3260'}], options=None) >Thread-108::DEBUG::2013-03-01 14:18:12,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-108::DEBUG::2013-03-01 14:18:12,818::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-108::DEBUG::2013-03-01 14:18:12,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-108::DEBUG::2013-03-01 14:18:12,834::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-108::DEBUG::2013-03-01 14:18:12,835::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-108::DEBUG::2013-03-01 14:18:12,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-108::INFO::2013-03-01 14:18:12,851::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-108::DEBUG::2013-03-01 14:18:12,851::task::1151::TaskManager.Task::(prepare) Task=`b41ae1cc-7ff0-4f44-b562-694ada7c4409`::finished: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-108::DEBUG::2013-03-01 14:18:12,851::task::568::TaskManager.Task::(_updateState) Task=`b41ae1cc-7ff0-4f44-b562-694ada7c4409`::moving from state preparing -> state finished >Thread-108::DEBUG::2013-03-01 14:18:12,852::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-108::DEBUG::2013-03-01 14:18:12,852::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-108::DEBUG::2013-03-01 14:18:12,852::task::957::TaskManager.Task::(_decref) Task=`b41ae1cc-7ff0-4f44-b562-694ada7c4409`::ref 0 aborting False >Thread-109::DEBUG::2013-03-01 14:18:12,889::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-109::DEBUG::2013-03-01 14:18:12,889::task::568::TaskManager.Task::(_updateState) Task=`57d38835-a148-43a5-a069-daf07321885a`::moving from state init -> state preparing >Thread-109::INFO::2013-03-01 14:18:12,890::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='8fd46635-c46a-47a7-b122-316b2df29251', poolName='iscsiStorageTest', masterDom='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', domList=['5dd04e7f-8474-4d0a-ae61-24f8fd2556de'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-109::DEBUG::2013-03-01 14:18:12,890::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:12,891::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:12,891::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:12,891::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:12,892::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:12,892::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:13,147::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:13,149::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,149::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', '_SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de'] >Thread-109::INFO::2013-03-01 14:18:13,150::blockSD::818::Storage.StorageDomain::(validate) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-109::DEBUG::2013-03-01 14:18:13,150::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:13,360::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:13,361::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,361::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,361::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,361::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,362::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:13,608::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:13,609::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,610::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', '_SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de'] >Thread-109::DEBUG::2013-03-01 14:18:13,611::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`c13f2340-de25-4048-9f8e-08a0f16475cc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-109::DEBUG::2013-03-01 14:18:13,611::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-109::DEBUG::2013-03-01 14:18:13,611::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-109::DEBUG::2013-03-01 14:18:13,612::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`c13f2340-de25-4048-9f8e-08a0f16475cc`::Granted request >Thread-109::DEBUG::2013-03-01 14:18:13,612::task::794::TaskManager.Task::(resourceAcquired) Task=`57d38835-a148-43a5-a069-daf07321885a`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-109::DEBUG::2013-03-01 14:18:13,612::task::957::TaskManager.Task::(_decref) Task=`57d38835-a148-43a5-a069-daf07321885a`::ref 1 aborting False >Thread-109::DEBUG::2013-03-01 14:18:13,613::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`7aa05612-367a-4742-b962-d641f03da01e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-109::DEBUG::2013-03-01 14:18:13,613::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' for lock type 'exclusive' >Thread-109::DEBUG::2013-03-01 14:18:13,613::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free. Now locking as 'exclusive' (1 active user) >Thread-109::DEBUG::2013-03-01 14:18:13,613::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`7aa05612-367a-4742-b962-d641f03da01e`::Granted request >Thread-109::DEBUG::2013-03-01 14:18:13,614::task::794::TaskManager.Task::(resourceAcquired) Task=`57d38835-a148-43a5-a069-daf07321885a`::_resourcesAcquired: Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de (exclusive) >Thread-109::DEBUG::2013-03-01 14:18:13,614::task::957::TaskManager.Task::(_decref) Task=`57d38835-a148-43a5-a069-daf07321885a`::ref 1 aborting False >Thread-109::INFO::2013-03-01 14:18:13,614::sp::543::Storage.StoragePool::(create) spUUID=8fd46635-c46a-47a7-b122-316b2df29251 poolName=iscsiStorageTest master_sd=5dd04e7f-8474-4d0a-ae61-24f8fd2556de domList=['5dd04e7f-8474-4d0a-ae61-24f8fd2556de'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-109::INFO::2013-03-01 14:18:13,614::blockSD::818::Storage.StorageDomain::(validate) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-109::DEBUG::2013-03-01 14:18:13,615::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:13,887::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:13,887::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,888::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,888::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,888::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,888::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:13,889::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:14,090::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:14,091::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,092::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', '_SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de'] >Thread-109::DEBUG::2013-03-01 14:18:14,093::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,093::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,093::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,093::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,094::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,094::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:14,295::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:14,366::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,366::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'IOOPTIMEOUTSEC=1', 'CLASS=Data', '_SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de'] >Thread-109::DEBUG::2013-03-01 14:18:14,367::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-109::DEBUG::2013-03-01 14:18:14,368::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-109::DEBUG::2013-03-01 14:18:14,368::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e'] >Thread-109::DEBUG::2013-03-01 14:18:14,368::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,369::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,369::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,369::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,370::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,371::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:14,573::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:14,575::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,575::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_LEASETIMESEC=60, MDT__SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e, MDT_IOOPTIMEOUTSEC=10 removing=MDT_IOOPTIMEOUTSEC=1, MDT_LEASETIMESEC=5, MDT__SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485 >Thread-109::DEBUG::2013-03-01 14:18:14,576::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_LEASETIMESEC=5 --deltag MDT_IOOPTIMEOUTSEC=1 --deltag MDT__SHA_CKSUM=03ef0eeeed6c18fc8b336e59addc6ceaaa3d1485 --addtag MDT_LEASETIMESEC=60 --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT__SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-110::DEBUG::2013-03-01 14:18:14,896::task::568::TaskManager.Task::(_updateState) Task=`112708f7-56d4-4662-8eb6-5ff2c9c86883`::moving from state init -> state preparing >Thread-110::INFO::2013-03-01 14:18:14,896::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-110::INFO::2013-03-01 14:18:14,897::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-110::DEBUG::2013-03-01 14:18:14,897::task::1151::TaskManager.Task::(prepare) Task=`112708f7-56d4-4662-8eb6-5ff2c9c86883`::finished: {} >Thread-110::DEBUG::2013-03-01 14:18:14,897::task::568::TaskManager.Task::(_updateState) Task=`112708f7-56d4-4662-8eb6-5ff2c9c86883`::moving from state preparing -> state finished >Thread-110::DEBUG::2013-03-01 14:18:14,897::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-110::DEBUG::2013-03-01 14:18:14,897::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-110::DEBUG::2013-03-01 14:18:14,897::task::957::TaskManager.Task::(_decref) Task=`112708f7-56d4-4662-8eb6-5ff2c9c86883`::ref 0 aborting False >Thread-109::DEBUG::2013-03-01 14:18:14,928::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:14,929::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,929::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:14,929::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-109::INFO::2013-03-01 14:18:14,929::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 250) >Thread-116::DEBUG::2013-03-01 14:18:30,214::task::568::TaskManager.Task::(_updateState) Task=`fced15f8-83a7-4823-a0af-92a490391c57`::moving from state init -> state preparing >Thread-116::INFO::2013-03-01 14:18:30,214::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-116::INFO::2013-03-01 14:18:30,214::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-116::DEBUG::2013-03-01 14:18:30,215::task::1151::TaskManager.Task::(prepare) Task=`fced15f8-83a7-4823-a0af-92a490391c57`::finished: {} >Thread-116::DEBUG::2013-03-01 14:18:30,215::task::568::TaskManager.Task::(_updateState) Task=`fced15f8-83a7-4823-a0af-92a490391c57`::moving from state preparing -> state finished >Thread-116::DEBUG::2013-03-01 14:18:30,215::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-116::DEBUG::2013-03-01 14:18:30,215::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-116::DEBUG::2013-03-01 14:18:30,216::task::957::TaskManager.Task::(_decref) Task=`fced15f8-83a7-4823-a0af-92a490391c57`::ref 0 aborting False >Thread-109::DEBUG::2013-03-01 14:18:35,936::clusterlock::191::SANLock::(acquireHostId) Host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 250) >Thread-109::WARNING::2013-03-01 14:18:35,936::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >Thread-109::WARNING::2013-03-01 14:18:35,937::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >Thread-109::DEBUG::2013-03-01 14:18:35,937::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,937::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,938::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,938::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,938::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-109::DEBUG::2013-03-01 14:18:35,938::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:35,946::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000353885 s, 5.8 MB/s\n'; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:35,946::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000353885 s, 5.8 MB/s'], size: 2048 >Thread-109::DEBUG::2013-03-01 14:18:35,946::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-109::WARNING::2013-03-01 14:18:35,947::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-109::DEBUG::2013-03-01 14:18:35,947::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-109::DEBUG::2013-03-01 14:18:35,948::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,948::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,948::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,949::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,949::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:35,950::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:36,201::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:36,203::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,204::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e'] >Thread-109::INFO::2013-03-01 14:18:36,204::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 250) >Thread-109::DEBUG::2013-03-01 14:18:36,214::clusterlock::248::SANLock::(acquire) Cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 250) >Thread-109::INFO::2013-03-01 14:18:36,214::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 8fd46635-c46a-47a7-b122-316b2df29251 on sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-109::DEBUG::2013-03-01 14:18:36,215::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-109::DEBUG::2013-03-01 14:18:36,215::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-109::DEBUG::2013-03-01 14:18:36,215::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,216::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,216::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,216::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,216::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,217::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:36,462::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:36,464::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,464::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'ROLE=Regular', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e'] >Thread-109::DEBUG::2013-03-01 14:18:36,465::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-109::DEBUG::2013-03-01 14:18:36,465::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-109::DEBUG::2013-03-01 14:18:36,466::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-109::DEBUG::2013-03-01 14:18:36,466::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-109::DEBUG::2013-03-01 14:18:36,466::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06'] >Thread-109::DEBUG::2013-03-01 14:18:36,467::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,467::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,468::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,468::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,468::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,470::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:36,722::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:36,724::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:36,725::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_ROLE=Master, MDT_POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT_POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251, MDT_POOL_DESCRIPTION=iscsiStorageTest, MDT_MASTER_VERSION=1, MDT__SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06 removing=MDT__SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e, MDT_POOL_UUID=, MDT_ROLE=Regular >Thread-109::DEBUG::2013-03-01 14:18:36,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_ROLE=Regular --deltag MDT_POOL_UUID= --deltag MDT__SHA_CKSUM=7c9ec3da0eab20d5d8f43edfb8973029e7a53a4e --addtag MDT__SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06 --addtag MDT_POOL_SPM_ID=-1 --addtag MDT_MASTER_VERSION=1 --addtag MDT_ROLE=Master --addtag MDT_POOL_DESCRIPTION=iscsiStorageTest --addtag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251 --addtag MDT_POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:37,241::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:37,242::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,242::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,243::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-109::DEBUG::2013-03-01 14:18:37,243::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de verified, version 1 >Thread-109::DEBUG::2013-03-01 14:18:37,243::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-109::DEBUG::2013-03-01 14:18:37,243::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-109::DEBUG::2013-03-01 14:18:37,244::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,244::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,244::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,244::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,245::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,245::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:37,499::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:37,501::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,501::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >Thread-109::DEBUG::2013-03-01 14:18:37,503::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8fd46635-c46a-47a7-b122-316b2df29251` started monitoring domain `5dd04e7f-8474-4d0a-ae61-24f8fd2556de` >Thread-120::DEBUG::2013-03-01 14:18:37,503::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-109::DEBUG::2013-03-01 14:18:37,504::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-109::WARNING::2013-03-01 14:18:37,506::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251 already exists >Thread-120::DEBUG::2013-03-01 14:18:37,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-109::DEBUG::2013-03-01 14:18:37,518::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2013-03-01 14:18:37,519::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-120::DEBUG::2013-03-01 14:18:37,722::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2013-03-01 14:18:37,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2013-03-01 14:18:37,730::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0002246 s, 18.2 MB/s\n'; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:37,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2013-03-01 14:18:37,739::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-109::WARNING::2013-03-01 14:18:37,778::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >Thread-109::WARNING::2013-03-01 14:18:37,778::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >Thread-109::INFO::2013-03-01 14:18:37,778::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-109::INFO::2013-03-01 14:18:37,779::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd >Thread-109::INFO::2013-03-01 14:18:37,779::clusterlock::252::SANLock::(release) Releasing cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-109::DEBUG::2013-03-01 14:18:37,780::clusterlock::263::SANLock::(release) Cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully released >Thread-109::INFO::2013-03-01 14:18:37,780::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 250) >Thread-109::DEBUG::2013-03-01 14:18:39,781::clusterlock::206::SANLock::(releaseHostId) Host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de released successfully (id: 250) >Thread-120::DEBUG::2013-03-01 14:18:39,781::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-120::INFO::2013-03-01 14:18:39,782::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 250) >Thread-120::DEBUG::2013-03-01 14:18:39,782::clusterlock::206::SANLock::(releaseHostId) Host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de released successfully (id: 250) >Thread-109::INFO::2013-03-01 14:18:39,782::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-109::DEBUG::2013-03-01 14:18:39,783::task::1151::TaskManager.Task::(prepare) Task=`57d38835-a148-43a5-a069-daf07321885a`::finished: True >Thread-109::DEBUG::2013-03-01 14:18:39,783::task::568::TaskManager.Task::(_updateState) Task=`57d38835-a148-43a5-a069-daf07321885a`::moving from state preparing -> state finished >Thread-109::DEBUG::2013-03-01 14:18:39,783::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de': < ResourceRef 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', isValid: 'True' obj: 'None'>} >Thread-109::DEBUG::2013-03-01 14:18:39,783::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2013-03-01 14:18:39,784::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-109::DEBUG::2013-03-01 14:18:39,784::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-109::DEBUG::2013-03-01 14:18:39,784::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-109::DEBUG::2013-03-01 14:18:39,784::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-109::DEBUG::2013-03-01 14:18:39,785::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' >Thread-109::DEBUG::2013-03-01 14:18:39,785::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (0 active users) >Thread-109::DEBUG::2013-03-01 14:18:39,785::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free, finding out if anyone is waiting for it. >Thread-109::DEBUG::2013-03-01 14:18:39,786::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', Clearing records. >Thread-109::DEBUG::2013-03-01 14:18:39,786::task::957::TaskManager.Task::(_decref) Task=`57d38835-a148-43a5-a069-daf07321885a`::ref 0 aborting False >Thread-145::DEBUG::2013-03-01 14:18:39,875::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-145::DEBUG::2013-03-01 14:18:39,876::task::568::TaskManager.Task::(_updateState) Task=`0263caab-b50e-4d19-bd9a-234cd232e350`::moving from state init -> state preparing >Thread-145::INFO::2013-03-01 14:18:39,876::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8fd46635-c46a-47a7-b122-316b2df29251', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7', 'port': '3260'}], options=None) >Thread-145::DEBUG::2013-03-01 14:18:39,876::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-145::DEBUG::2013-03-01 14:18:40,098::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-145::DEBUG::2013-03-01 14:18:40,099::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-145::DEBUG::2013-03-01 14:18:40,116::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-145::DEBUG::2013-03-01 14:18:40,116::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-145::DEBUG::2013-03-01 14:18:40,132::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-145::INFO::2013-03-01 14:18:40,133::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-145::DEBUG::2013-03-01 14:18:40,133::task::1151::TaskManager.Task::(prepare) Task=`0263caab-b50e-4d19-bd9a-234cd232e350`::finished: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-145::DEBUG::2013-03-01 14:18:40,133::task::568::TaskManager.Task::(_updateState) Task=`0263caab-b50e-4d19-bd9a-234cd232e350`::moving from state preparing -> state finished >Thread-145::DEBUG::2013-03-01 14:18:40,134::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-145::DEBUG::2013-03-01 14:18:40,134::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-145::DEBUG::2013-03-01 14:18:40,134::task::957::TaskManager.Task::(_decref) Task=`0263caab-b50e-4d19-bd9a-234cd232e350`::ref 0 aborting False >Thread-146::DEBUG::2013-03-01 14:18:40,224::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-146::DEBUG::2013-03-01 14:18:40,224::task::568::TaskManager.Task::(_updateState) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::moving from state init -> state preparing >Thread-146::INFO::2013-03-01 14:18:40,225::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-146::ERROR::2013-03-01 14:18:40,225::task::833::TaskManager.Task::(_setError) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 603, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 313, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('8fd46635-c46a-47a7-b122-316b2df29251',) >Thread-146::DEBUG::2013-03-01 14:18:40,227::task::852::TaskManager.Task::(_run) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::Task._run: 6e724c06-6d87-46b3-ae00-1982d7507eab ('8fd46635-c46a-47a7-b122-316b2df29251',) {} failed - stopping task >Thread-146::DEBUG::2013-03-01 14:18:40,227::task::1177::TaskManager.Task::(stop) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::stopping in state preparing (force False) >Thread-146::DEBUG::2013-03-01 14:18:40,227::task::957::TaskManager.Task::(_decref) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::ref 1 aborting True >Thread-146::INFO::2013-03-01 14:18:40,227::task::1134::TaskManager.Task::(prepare) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-146::DEBUG::2013-03-01 14:18:40,228::task::1139::TaskManager.Task::(prepare) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::Prepare: aborted: Unknown pool id, pool not connected >Thread-146::DEBUG::2013-03-01 14:18:40,228::task::957::TaskManager.Task::(_decref) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::ref 0 aborting True >Thread-146::DEBUG::2013-03-01 14:18:40,228::task::892::TaskManager.Task::(_doAbort) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::Task._doAbort: force False >Thread-146::DEBUG::2013-03-01 14:18:40,228::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-03-01 14:18:40,229::task::568::TaskManager.Task::(_updateState) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::moving from state preparing -> state aborting >Thread-146::DEBUG::2013-03-01 14:18:40,229::task::523::TaskManager.Task::(__state_aborting) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::_aborting: recover policy none >Thread-146::DEBUG::2013-03-01 14:18:40,229::task::568::TaskManager.Task::(_updateState) Task=`6e724c06-6d87-46b3-ae00-1982d7507eab`::moving from state aborting -> state failed >Thread-146::DEBUG::2013-03-01 14:18:40,229::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-146::DEBUG::2013-03-01 14:18:40,229::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::ERROR::2013-03-01 14:18:40,230::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('8fd46635-c46a-47a7-b122-316b2df29251',)", 'code': 309}} >Thread-147::DEBUG::2013-03-01 14:18:40,310::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-147::DEBUG::2013-03-01 14:18:40,310::task::568::TaskManager.Task::(_updateState) Task=`b82b0239-2ecb-44c2-86c8-d682262c1b23`::moving from state init -> state preparing >Thread-147::INFO::2013-03-01 14:18:40,311::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', hostID=1, scsiKey='8fd46635-c46a-47a7-b122-316b2df29251', msdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', masterVersion=1, options=None) >Thread-147::DEBUG::2013-03-01 14:18:40,311::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`21b8d447-8f11-4500-91a3-04f669bb0ac1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-147::DEBUG::2013-03-01 14:18:40,312::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-147::DEBUG::2013-03-01 14:18:40,312::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-147::DEBUG::2013-03-01 14:18:40,312::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`21b8d447-8f11-4500-91a3-04f669bb0ac1`::Granted request >Thread-147::INFO::2013-03-01 14:18:40,313::sp::627::Storage.StoragePool::(connect) Connect host #1 to the storage pool 8fd46635-c46a-47a7-b122-316b2df29251 with master domain: 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (ver = 1) >Thread-147::DEBUG::2013-03-01 14:18:40,313::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:40,314::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:40,314::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:40,314::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:40,315::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:40,315::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:40,315::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-147::DEBUG::2013-03-01 14:18:40,316::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-147::DEBUG::2013-03-01 14:18:40,316::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-147::DEBUG::2013-03-01 14:18:40,316::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-147::DEBUG::2013-03-01 14:18:40,316::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:40,344::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:40,344::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,346::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,354::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,356::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-147::DEBUG::2013-03-01 14:18:40,361::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-147::DEBUG::2013-03-01 14:18:42,364::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-149::DEBUG::2013-03-01 14:18:45,442::task::568::TaskManager.Task::(_updateState) Task=`6ca977d0-47b6-49db-a323-d92795a498c4`::moving from state init -> state preparing >Thread-149::INFO::2013-03-01 14:18:45,443::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-149::INFO::2013-03-01 14:18:45,443::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-149::DEBUG::2013-03-01 14:18:45,443::task::1151::TaskManager.Task::(prepare) Task=`6ca977d0-47b6-49db-a323-d92795a498c4`::finished: {} >Thread-149::DEBUG::2013-03-01 14:18:45,443::task::568::TaskManager.Task::(_updateState) Task=`6ca977d0-47b6-49db-a323-d92795a498c4`::moving from state preparing -> state finished >Thread-149::DEBUG::2013-03-01 14:18:45,443::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-149::DEBUG::2013-03-01 14:18:45,444::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-149::DEBUG::2013-03-01 14:18:45,444::task::957::TaskManager.Task::(_decref) Task=`6ca977d0-47b6-49db-a323-d92795a498c4`::ref 0 aborting False >Thread-147::DEBUG::2013-03-01 14:18:45,551::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:45,552::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,552::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,552::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,553::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,553::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,553::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,554::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-147::DEBUG::2013-03-01 14:18:45,554::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:45,798::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:45,799::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,799::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-147::DEBUG::2013-03-01 14:18:45,800::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:45,807::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000301915 s, 6.8 MB/s\n'; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:45,808::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000301915 s, 6.8 MB/s'], size: 2048 >Thread-147::DEBUG::2013-03-01 14:18:45,808::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-147::WARNING::2013-03-01 14:18:45,808::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-147::DEBUG::2013-03-01 14:18:45,808::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-147::DEBUG::2013-03-01 14:18:45,809::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,809::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,809::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,809::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,810::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:45,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:46,010::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:46,012::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,012::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >Thread-147::DEBUG::2013-03-01 14:18:46,013::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:46,221::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:46,222::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-147::WARNING::2013-03-01 14:18:46,223::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >Thread-147::WARNING::2013-03-01 14:18:46,223::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >Thread-147::WARNING::2013-03-01 14:18:46,223::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >Thread-147::DEBUG::2013-03-01 14:18:46,224::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de verified, version 1 >Thread-147::DEBUG::2013-03-01 14:18:46,224::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-147::DEBUG::2013-03-01 14:18:46,225::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-147::DEBUG::2013-03-01 14:18:46,225::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,225::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,226::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,226::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,227::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,228::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:46,423::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:46,424::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,424::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >Thread-147::DEBUG::2013-03-01 14:18:46,425::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8fd46635-c46a-47a7-b122-316b2df29251` started monitoring domain `5dd04e7f-8474-4d0a-ae61-24f8fd2556de` >Thread-151::DEBUG::2013-03-01 14:18:46,425::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-147::DEBUG::2013-03-01 14:18:46,426::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-147::WARNING::2013-03-01 14:18:46,427::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251 already exists >Thread-147::DEBUG::2013-03-01 14:18:46,429::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-147::DEBUG::2013-03-01 14:18:46,431::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-151::DEBUG::2013-03-01 14:18:46,431::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:47,191::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:47,195::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:18:47,220::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:18:47,228::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-147::WARNING::2013-03-01 14:18:47,249::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >Thread-151::DEBUG::2013-03-01 14:18:47,250::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000254781 s, 16.1 MB/s\n'; <rc> = 0 >Thread-147::WARNING::2013-03-01 14:18:47,250::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >Thread-147::INFO::2013-03-01 14:18:47,253::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-147::INFO::2013-03-01 14:18:47,254::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd >Thread-147::DEBUG::2013-03-01 14:18:47,256::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-147::DEBUG::2013-03-01 14:18:47,262::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-151::INFO::2013-03-01 14:18:47,267::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 1) >Thread-151::DEBUG::2013-03-01 14:18:47,269::clusterlock::191::SANLock::(acquireHostId) Host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 1) >Thread-147::DEBUG::2013-03-01 14:18:47,271::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00147773 s, 2.8 MB/s\n'; <rc> = 0 >Thread-147::INFO::2013-03-01 14:18:47,272::storage_mailbox::341::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-147::DEBUG::2013-03-01 14:18:47,272::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-147::DEBUG::2013-03-01 14:18:48,280::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00069 s, 4.1 kB/s\n'; <rc> = 0 >Thread-147::DEBUG::2013-03-01 14:18:48,281::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 8fd46635-c46a-47a7-b122-316b2df29251 >Thread-147::DEBUG::2013-03-01 14:18:48,282::sp::435::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 8fd46635-c46a-47a7-b122-316b2df29251 on master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-147::DEBUG::2013-03-01 14:18:48,282::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-147::DEBUG::2013-03-01 14:18:48,282::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-147::DEBUG::2013-03-01 14:18:48,283::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-147::DEBUG::2013-03-01 14:18:48,283::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-147::INFO::2013-03-01 14:18:48,283::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-147::DEBUG::2013-03-01 14:18:48,284::task::1151::TaskManager.Task::(prepare) Task=`b82b0239-2ecb-44c2-86c8-d682262c1b23`::finished: True >Thread-147::DEBUG::2013-03-01 14:18:48,284::task::568::TaskManager.Task::(_updateState) Task=`b82b0239-2ecb-44c2-86c8-d682262c1b23`::moving from state preparing -> state finished >Thread-147::DEBUG::2013-03-01 14:18:48,284::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-147::DEBUG::2013-03-01 14:18:48,284::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-147::DEBUG::2013-03-01 14:18:48,285::task::957::TaskManager.Task::(_decref) Task=`b82b0239-2ecb-44c2-86c8-d682262c1b23`::ref 0 aborting False >Thread-181::DEBUG::2013-03-01 14:18:48,347::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-181::DEBUG::2013-03-01 14:18:48,347::task::568::TaskManager.Task::(_updateState) Task=`14317493-82a6-49ac-ae0e-95c66a3dd0ca`::moving from state init -> state preparing >Thread-181::INFO::2013-03-01 14:18:48,348::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-181::INFO::2013-03-01 14:18:48,348::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-181::DEBUG::2013-03-01 14:18:48,349::task::1151::TaskManager.Task::(prepare) Task=`14317493-82a6-49ac-ae0e-95c66a3dd0ca`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-181::DEBUG::2013-03-01 14:18:48,349::task::568::TaskManager.Task::(_updateState) Task=`14317493-82a6-49ac-ae0e-95c66a3dd0ca`::moving from state preparing -> state finished >Thread-181::DEBUG::2013-03-01 14:18:48,349::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-181::DEBUG::2013-03-01 14:18:48,349::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-181::DEBUG::2013-03-01 14:18:48,350::task::957::TaskManager.Task::(_decref) Task=`14317493-82a6-49ac-ae0e-95c66a3dd0ca`::ref 0 aborting False >Thread-182::DEBUG::2013-03-01 14:18:48,506::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-151::DEBUG::2013-03-01 14:18:57,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-182::DEBUG::2013-03-01 14:19:12,719::task::568::TaskManager.Task::(_updateState) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::moving from state init -> state preparing >Thread-182::INFO::2013-03-01 14:19:12,728::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-182::DEBUG::2013-03-01 14:19:12,731::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b8a5f331-9048-4dfc-bc91-4332fa154343`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-182::DEBUG::2013-03-01 14:19:12,732::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-182::DEBUG::2013-03-01 14:19:12,734::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-182::DEBUG::2013-03-01 14:19:12,735::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b8a5f331-9048-4dfc-bc91-4332fa154343`::Granted request >Thread-151::DEBUG::2013-03-01 14:19:12,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000406244 s, 10.1 MB/s\n'; <rc> = 0 >Thread-182::DEBUG::2013-03-01 14:19:12,738::task::794::TaskManager.Task::(resourceAcquired) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-182::DEBUG::2013-03-01 14:19:12,739::task::957::TaskManager.Task::(_decref) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::ref 1 aborting False >Thread-182::INFO::2013-03-01 14:19:12,740::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-182::DEBUG::2013-03-01 14:19:12,741::task::1146::TaskManager.Task::(prepare) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::Prepare: 1 jobs exist, move to acquiring >Thread-182::DEBUG::2013-03-01 14:19:12,742::task::568::TaskManager.Task::(_updateState) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::moving from state preparing -> state acquiring >Thread-182::DEBUG::2013-03-01 14:19:12,744::task::568::TaskManager.Task::(_updateState) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::moving from state acquiring -> state queued >Thread-182::DEBUG::2013-03-01 14:19:12,745::taskManager::50::TaskManager::(_queueTask) queuing task: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-182::DEBUG::2013-03-01 14:19:12,746::taskManager::56::TaskManager::(_queueTask) task queued: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-8::DEBUG::2013-03-01 14:19:12,746::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-182::DEBUG::2013-03-01 14:19:12,748::task::1148::TaskManager.Task::(prepare) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::returning >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,749::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 8200bd6f-8b83-47ac-8d39-99944df2c60d running: <bound method Task.commit of <storage.task.Task instance at 0x7fcf54126a28>> with: None >Thread-182::DEBUG::2013-03-01 14:19:12,749::task::957::TaskManager.Task::(_decref) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::ref 0 aborting False >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,750::task::1159::TaskManager.Task::(commit) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::committing task: 8200bd6f-8b83-47ac-8d39-99944df2c60d >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,751::task::568::TaskManager.Task::(_updateState) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::moving from state queued -> state running >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,752::task::872::TaskManager.Task::(_runJobs) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fcf28045450>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,753::task::304::TaskManager.Task::(run) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fcf28045450>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,753::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,754::misc::1055::SamplingMethod::(__call__) Got in to sampling method >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,754::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,754::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,754::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,755::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,755::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,756::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,948::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,950::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,950::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,951::misc::1063::SamplingMethod::(__call__) Returning last result >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,951::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,951::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,952::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,952::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,952::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:12,953::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-184::DEBUG::2013-03-01 14:19:13,825::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-151::DEBUG::2013-03-01 14:19:22,749::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-184::DEBUG::2013-03-01 14:19:42,938::task::568::TaskManager.Task::(_updateState) Task=`6e8a70c6-7e93-47e9-9d0e-e83ae308d4c7`::moving from state init -> state preparing >Thread-151::DEBUG::2013-03-01 14:19:42,940::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-184::INFO::2013-03-01 14:19:42,940::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='8200bd6f-8b83-47ac-8d39-99944df2c60d', spUUID=None, options=None) >Thread-184::DEBUG::2013-03-01 14:19:42,947::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-184::DEBUG::2013-03-01 14:19:42,947::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'} >Thread-184::INFO::2013-03-01 14:19:42,947::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-184::DEBUG::2013-03-01 14:19:42,948::task::1151::TaskManager.Task::(prepare) Task=`6e8a70c6-7e93-47e9-9d0e-e83ae308d4c7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-184::DEBUG::2013-03-01 14:19:42,948::task::568::TaskManager.Task::(_updateState) Task=`6e8a70c6-7e93-47e9-9d0e-e83ae308d4c7`::moving from state preparing -> state finished >Thread-184::DEBUG::2013-03-01 14:19:42,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184::DEBUG::2013-03-01 14:19:42,948::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184::DEBUG::2013-03-01 14:19:42,949::task::957::TaskManager.Task::(_decref) Task=`6e8a70c6-7e93-47e9-9d0e-e83ae308d4c7`::ref 0 aborting False >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:42,987::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:42,989::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::INFO::2013-03-01 14:19:42,990::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 1) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:42,990::clusterlock::191::SANLock::(acquireHostId) Host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 1) >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:42,991::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:42,991::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:42,992::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-151::DEBUG::2013-03-01 14:19:43,147::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:19:43,148::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:19:43,149::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,149::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,157::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,158::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,160::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,161::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-151::DEBUG::2013-03-01 14:19:43,163::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000263285 s, 15.6 MB/s\n'; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,163::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:19:43,169::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:19:43,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,181::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000232807 s, 8.8 MB/s\n'; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,181::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000232807 s, 8.8 MB/s'], size: 2048 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,181::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:43,181::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,182::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,182::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-151::DEBUG::2013-03-01 14:19:43,368::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:19:43,370::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,371::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,372::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,372::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,373::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,373::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,616::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,617::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,618::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::INFO::2013-03-01 14:19:43,619::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 1) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,629::clusterlock::248::SANLock::(acquire) Cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 1) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,629::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,630::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,630::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,630::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,631::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,631::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,632::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,825::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,827::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,828::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', '_SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_SPM_LVER=-1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,828::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,829::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,829::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=d4232d91d2386ecf4c25e50e8fb27b8eb11b51da'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,830::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,830::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,830::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,831::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,831::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:43,832::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-186::DEBUG::2013-03-01 14:19:43,996::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-186::DEBUG::2013-03-01 14:19:43,997::task::568::TaskManager.Task::(_updateState) Task=`d43e5283-4983-4950-a1f7-79060764a1b2`::moving from state init -> state preparing >Thread-186::INFO::2013-03-01 14:19:43,997::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='8200bd6f-8b83-47ac-8d39-99944df2c60d', spUUID=None, options=None) >Thread-186::DEBUG::2013-03-01 14:19:43,997::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-186::DEBUG::2013-03-01 14:19:43,997::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'} >Thread-186::INFO::2013-03-01 14:19:43,998::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-186::DEBUG::2013-03-01 14:19:43,998::task::1151::TaskManager.Task::(prepare) Task=`d43e5283-4983-4950-a1f7-79060764a1b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-186::DEBUG::2013-03-01 14:19:43,998::task::568::TaskManager.Task::(_updateState) Task=`d43e5283-4983-4950-a1f7-79060764a1b2`::moving from state preparing -> state finished >Thread-186::DEBUG::2013-03-01 14:19:43,998::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-186::DEBUG::2013-03-01 14:19:43,998::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-186::DEBUG::2013-03-01 14:19:43,999::task::957::TaskManager.Task::(_decref) Task=`d43e5283-4983-4950-a1f7-79060764a1b2`::ref 0 aborting False >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:44,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:44,071::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:44,072::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=d4232d91d2386ecf4c25e50e8fb27b8eb11b51da, MDT_POOL_SPM_LVER=0, MDT_POOL_SPM_ID=1 removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT__SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:44,073::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=6822d713cd3494fd89a6f51c2d3fb030fd782d06 --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=d4232d91d2386ecf4c25e50e8fb27b8eb11b51da --addtag MDT_POOL_SPM_LVER=0 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-187::DEBUG::2013-03-01 14:19:45,028::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-187::DEBUG::2013-03-01 14:19:46,252::task::568::TaskManager.Task::(_updateState) Task=`0d4d007f-4559-45d5-b8f9-20de40f0c1d3`::moving from state init -> state preparing >Thread-187::INFO::2013-03-01 14:19:46,253::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='8200bd6f-8b83-47ac-8d39-99944df2c60d', spUUID=None, options=None) >Thread-187::DEBUG::2013-03-01 14:19:46,291::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-187::DEBUG::2013-03-01 14:19:46,292::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'} >Thread-187::INFO::2013-03-01 14:19:46,292::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-187::DEBUG::2013-03-01 14:19:46,292::task::1151::TaskManager.Task::(prepare) Task=`0d4d007f-4559-45d5-b8f9-20de40f0c1d3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-187::DEBUG::2013-03-01 14:19:46,293::task::568::TaskManager.Task::(_updateState) Task=`0d4d007f-4559-45d5-b8f9-20de40f0c1d3`::moving from state preparing -> state finished >Thread-187::DEBUG::2013-03-01 14:19:46,293::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-187::DEBUG::2013-03-01 14:19:46,293::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-187::DEBUG::2013-03-01 14:19:46,293::task::957::TaskManager.Task::(_decref) Task=`0d4d007f-4559-45d5-b8f9-20de40f0c1d3`::ref 0 aborting False >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,325::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,326::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,326::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,327::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,327::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`ab42c975-05d1-417e-95b3-ec29bd13dc77`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,327::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,328::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,328::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`ab42c975-05d1-417e-95b3-ec29bd13dc77`::Granted request >8200bd6f-8b83-47ac-8d39-99944df2c60d::INFO::2013-03-01 14:19:46,329::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `5dd04e7f-8474-4d0a-ae61-24f8fd2556de` >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,329::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`db1d7d02-ede9-49c4-bb74-d101049f9b71`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,330::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' for lock type 'exclusive' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,330::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free. Now locking as 'exclusive' (1 active user) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,330::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`db1d7d02-ede9-49c4-bb74-d101049f9b71`::Granted request >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,331::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,332::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,578::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,580::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,580::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,580::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000250466 s, 8.2 MB/s\n'; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,587::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000250466 s, 8.2 MB/s'], size: 2048 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,587::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:46,587::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,588::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,588::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,588::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,588::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,589::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,589::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:46,590::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,209::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,211::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,211::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=d4232d91d2386ecf4c25e50e8fb27b8eb11b51da', 'POOL_SPM_LVER=0'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:47,212::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:47,212::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:47,213::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,213::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,213::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (0 active users) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,214::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free, finding out if anyone is waiting for it. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,214::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', Clearing records. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,214::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,214::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,214::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,215::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,215::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,215::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,215::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,216::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/fsck -p /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,308::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,309::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-189::DEBUG::2013-03-01 14:19:47,339::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,340::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >Thread-189::DEBUG::2013-03-01 14:19:47,342::task::568::TaskManager.Task::(_updateState) Task=`fe376daf-ffca-4198-910f-227ae106158b`::moving from state init -> state preparing >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,343::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-189::INFO::2013-03-01 14:19:47,350::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='8200bd6f-8b83-47ac-8d39-99944df2c60d', spUUID=None, options=None) >Thread-189::DEBUG::2013-03-01 14:19:47,352::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-189::DEBUG::2013-03-01 14:19:47,352::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'} >Thread-189::INFO::2013-03-01 14:19:47,353::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-189::DEBUG::2013-03-01 14:19:47,353::task::1151::TaskManager.Task::(prepare) Task=`fe376daf-ffca-4198-910f-227ae106158b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-189::DEBUG::2013-03-01 14:19:47,354::task::568::TaskManager.Task::(_updateState) Task=`fe376daf-ffca-4198-910f-227ae106158b`::moving from state preparing -> state finished >Thread-189::DEBUG::2013-03-01 14:19:47,354::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2013-03-01 14:19:47,355::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2013-03-01 14:19:47,355::task::957::TaskManager.Task::(_decref) Task=`fe376daf-ffca-4198-910f-227ae106158b`::ref 0 aborting False >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,420::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,441::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:47,442::sd::600::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master/vms) >8200bd6f-8b83-47ac-8d39-99944df2c60d::WARNING::2013-03-01 14:19:47,444::sd::605::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master/tasks) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,445::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,449::storage_mailbox::504::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,450::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd of=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,494::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358663 s, 28.6 MB/s\n'; <rc> = 0 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,495::storage_mailbox::511::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 8fd46635-c46a-47a7-b122-316b2df29251 >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,497::sp::302::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 8fd46635-c46a-47a7-b122-316b2df29251 on master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,498::sp::309::Storage.StoragePool::(startSpm) ended. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,498::task::568::TaskManager.Task::(_updateState) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::moving from state running -> state finished >Dummy-195::DEBUG::2013-03-01 14:19:47,498::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,499::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,507::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,507::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,508::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,510::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,511::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,514::task::880::TaskManager.Task::(_runJobs) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::Task.run: exit - success: result >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,516::task::957::TaskManager.Task::(_decref) Task=`8200bd6f-8b83-47ac-8d39-99944df2c60d`::ref 0 aborting False >8200bd6f-8b83-47ac-8d39-99944df2c60d::DEBUG::2013-03-01 14:19:47,517::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-195::DEBUG::2013-03-01 14:19:47,591::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417793 s, 24.5 MB/s\n'; <rc> = 0 >Thread-196::DEBUG::2013-03-01 14:19:48,385::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-196::DEBUG::2013-03-01 14:19:48,386::task::568::TaskManager.Task::(_updateState) Task=`d1958983-1ab1-47e3-a771-8dc96eb64db2`::moving from state init -> state preparing >Thread-196::INFO::2013-03-01 14:19:48,386::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='8200bd6f-8b83-47ac-8d39-99944df2c60d', spUUID=None, options=None) >Thread-196::DEBUG::2013-03-01 14:19:48,387::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-196::DEBUG::2013-03-01 14:19:48,387::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'} >Thread-196::INFO::2013-03-01 14:19:48,387::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-196::DEBUG::2013-03-01 14:19:48,387::task::1151::TaskManager.Task::(prepare) Task=`d1958983-1ab1-47e3-a771-8dc96eb64db2`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '8200bd6f-8b83-47ac-8d39-99944df2c60d'}} >Thread-196::DEBUG::2013-03-01 14:19:48,388::task::568::TaskManager.Task::(_updateState) Task=`d1958983-1ab1-47e3-a771-8dc96eb64db2`::moving from state preparing -> state finished >Thread-196::DEBUG::2013-03-01 14:19:48,388::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-196::DEBUG::2013-03-01 14:19:48,388::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-196::DEBUG::2013-03-01 14:19:48,388::task::957::TaskManager.Task::(_decref) Task=`d1958983-1ab1-47e3-a771-8dc96eb64db2`::ref 0 aborting False >Thread-197::DEBUG::2013-03-01 14:19:48,415::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-197::DEBUG::2013-03-01 14:19:48,415::task::568::TaskManager.Task::(_updateState) Task=`2381c6b8-7f54-47df-8b6e-024bb0f1d5c0`::moving from state init -> state preparing >Thread-197::INFO::2013-03-01 14:19:48,416::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-197::INFO::2013-03-01 14:19:48,416::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-197::DEBUG::2013-03-01 14:19:48,416::task::1151::TaskManager.Task::(prepare) Task=`2381c6b8-7f54-47df-8b6e-024bb0f1d5c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-197::DEBUG::2013-03-01 14:19:48,417::task::568::TaskManager.Task::(_updateState) Task=`2381c6b8-7f54-47df-8b6e-024bb0f1d5c0`::moving from state preparing -> state finished >Thread-197::DEBUG::2013-03-01 14:19:48,417::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-197::DEBUG::2013-03-01 14:19:48,417::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-197::DEBUG::2013-03-01 14:19:48,417::task::957::TaskManager.Task::(_decref) Task=`2381c6b8-7f54-47df-8b6e-024bb0f1d5c0`::ref 0 aborting False >Thread-198::DEBUG::2013-03-01 14:19:48,450::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-198::DEBUG::2013-03-01 14:19:48,450::task::568::TaskManager.Task::(_updateState) Task=`ec661664-b805-40a1-b4a8-0864ac2e0759`::moving from state init -> state preparing >Thread-198::INFO::2013-03-01 14:19:48,450::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='8200bd6f-8b83-47ac-8d39-99944df2c60d', spUUID=None, options=None) >Thread-198::DEBUG::2013-03-01 14:19:48,450::taskManager::161::TaskManager::(clearTask) Entry. taskID: 8200bd6f-8b83-47ac-8d39-99944df2c60d >Thread-198::DEBUG::2013-03-01 14:19:48,451::taskManager::166::TaskManager::(clearTask) Return. >Thread-198::INFO::2013-03-01 14:19:48,451::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-198::DEBUG::2013-03-01 14:19:48,451::task::1151::TaskManager.Task::(prepare) Task=`ec661664-b805-40a1-b4a8-0864ac2e0759`::finished: None >Thread-198::DEBUG::2013-03-01 14:19:48,451::task::568::TaskManager.Task::(_updateState) Task=`ec661664-b805-40a1-b4a8-0864ac2e0759`::moving from state preparing -> state finished >Thread-198::DEBUG::2013-03-01 14:19:48,452::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-198::DEBUG::2013-03-01 14:19:48,452::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-198::DEBUG::2013-03-01 14:19:48,452::task::957::TaskManager.Task::(_decref) Task=`ec661664-b805-40a1-b4a8-0864ac2e0759`::ref 0 aborting False >Thread-199::DEBUG::2013-03-01 14:19:48,507::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-199::DEBUG::2013-03-01 14:19:48,507::task::568::TaskManager.Task::(_updateState) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::moving from state init -> state preparing >Thread-199::INFO::2013-03-01 14:19:48,508::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-199::DEBUG::2013-03-01 14:19:48,508::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`e4685d83-895f-4ca2-837f-09c4824d25b5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-199::DEBUG::2013-03-01 14:19:48,509::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-199::DEBUG::2013-03-01 14:19:48,509::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-199::DEBUG::2013-03-01 14:19:48,509::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`e4685d83-895f-4ca2-837f-09c4824d25b5`::Granted request >Thread-199::DEBUG::2013-03-01 14:19:48,510::task::794::TaskManager.Task::(resourceAcquired) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-199::DEBUG::2013-03-01 14:19:48,510::task::957::TaskManager.Task::(_decref) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::ref 1 aborting False >Thread-199::DEBUG::2013-03-01 14:19:48,510::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`22096220-abb0-42c7-af3e-ad97a6044ae7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-199::DEBUG::2013-03-01 14:19:48,510::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' for lock type 'exclusive' >Thread-199::DEBUG::2013-03-01 14:19:48,511::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free. Now locking as 'exclusive' (1 active user) >Thread-199::DEBUG::2013-03-01 14:19:48,511::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`22096220-abb0-42c7-af3e-ad97a6044ae7`::Granted request >Thread-199::DEBUG::2013-03-01 14:19:48,511::task::794::TaskManager.Task::(resourceAcquired) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::_resourcesAcquired: Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de (exclusive) >Thread-199::DEBUG::2013-03-01 14:19:48,512::task::957::TaskManager.Task::(_decref) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::ref 1 aborting False >Thread-199::INFO::2013-03-01 14:19:48,512::sp::1045::Storage.StoragePool::(activateSD) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de spUUID=8fd46635-c46a-47a7-b122-316b2df29251 >Thread-199::INFO::2013-03-01 14:19:48,512::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-199::DEBUG::2013-03-01 14:19:48,513::task::1151::TaskManager.Task::(prepare) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::finished: None >Thread-199::DEBUG::2013-03-01 14:19:48,513::task::568::TaskManager.Task::(_updateState) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::moving from state preparing -> state finished >Thread-199::DEBUG::2013-03-01 14:19:48,513::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de': < ResourceRef 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', isValid: 'True' obj: 'None'>} >Thread-199::DEBUG::2013-03-01 14:19:48,513::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-199::DEBUG::2013-03-01 14:19:48,514::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-199::DEBUG::2013-03-01 14:19:48,514::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-199::DEBUG::2013-03-01 14:19:48,514::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-199::DEBUG::2013-03-01 14:19:48,514::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-199::DEBUG::2013-03-01 14:19:48,515::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' >Thread-199::DEBUG::2013-03-01 14:19:48,515::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (0 active users) >Thread-199::DEBUG::2013-03-01 14:19:48,515::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free, finding out if anyone is waiting for it. >Thread-199::DEBUG::2013-03-01 14:19:48,515::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', Clearing records. >Thread-199::DEBUG::2013-03-01 14:19:48,516::task::957::TaskManager.Task::(_decref) Task=`1512b54d-dc05-453a-b378-2f7e8cec08be`::ref 0 aborting False >Thread-200::DEBUG::2013-03-01 14:19:48,565::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-200::DEBUG::2013-03-01 14:19:48,566::task::568::TaskManager.Task::(_updateState) Task=`2555073e-9885-4ac4-aef7-8c61a91b8102`::moving from state init -> state preparing >Thread-200::INFO::2013-03-01 14:19:48,566::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', hostID=1, scsiKey='8fd46635-c46a-47a7-b122-316b2df29251', msdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', masterVersion=1, options=None) >Thread-200::DEBUG::2013-03-01 14:19:48,567::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`df947998-610d-4e07-abfd-0bbfb9543f09`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-200::DEBUG::2013-03-01 14:19:48,567::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-200::DEBUG::2013-03-01 14:19:48,567::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-200::DEBUG::2013-03-01 14:19:48,567::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`df947998-610d-4e07-abfd-0bbfb9543f09`::Granted request >Thread-200::DEBUG::2013-03-01 14:19:48,568::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de verified, version 1 >Thread-200::DEBUG::2013-03-01 14:19:48,568::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-200::DEBUG::2013-03-01 14:19:48,569::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-200::DEBUG::2013-03-01 14:19:48,569::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-200::DEBUG::2013-03-01 14:19:48,569::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-200::INFO::2013-03-01 14:19:48,569::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-200::DEBUG::2013-03-01 14:19:48,570::task::1151::TaskManager.Task::(prepare) Task=`2555073e-9885-4ac4-aef7-8c61a91b8102`::finished: None >Thread-200::DEBUG::2013-03-01 14:19:48,570::task::568::TaskManager.Task::(_updateState) Task=`2555073e-9885-4ac4-aef7-8c61a91b8102`::moving from state preparing -> state finished >Thread-200::DEBUG::2013-03-01 14:19:48,570::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-200::DEBUG::2013-03-01 14:19:48,570::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-200::DEBUG::2013-03-01 14:19:48,570::task::957::TaskManager.Task::(_decref) Task=`2555073e-9885-4ac4-aef7-8c61a91b8102`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:19:49,609::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:19:49,680::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254863 s, 40.2 MB/s\n'; <rc> = 0 >Thread-202::DEBUG::2013-03-01 14:19:49,685::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-202::DEBUG::2013-03-01 14:19:49,686::task::568::TaskManager.Task::(_updateState) Task=`b8efe71e-f569-4c84-9b95-a4d8d289a484`::moving from state init -> state preparing >Thread-202::INFO::2013-03-01 14:19:49,687::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7', 'port': '3260'}], options=None) >Thread-202::DEBUG::2013-03-01 14:19:49,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-202::DEBUG::2013-03-01 14:19:49,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-202::DEBUG::2013-03-01 14:19:49,710::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-202::DEBUG::2013-03-01 14:19:49,725::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-202::DEBUG::2013-03-01 14:19:49,726::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-202::DEBUG::2013-03-01 14:19:49,741::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-202::INFO::2013-03-01 14:19:49,741::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-202::DEBUG::2013-03-01 14:19:49,742::task::1151::TaskManager.Task::(prepare) Task=`b8efe71e-f569-4c84-9b95-a4d8d289a484`::finished: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-202::DEBUG::2013-03-01 14:19:49,742::task::568::TaskManager.Task::(_updateState) Task=`b8efe71e-f569-4c84-9b95-a4d8d289a484`::moving from state preparing -> state finished >Thread-202::DEBUG::2013-03-01 14:19:49,742::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-202::DEBUG::2013-03-01 14:19:49,742::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-202::DEBUG::2013-03-01 14:19:49,743::task::957::TaskManager.Task::(_decref) Task=`b8efe71e-f569-4c84-9b95-a4d8d289a484`::ref 0 aborting False >Thread-203::DEBUG::2013-03-01 14:19:49,774::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-203::DEBUG::2013-03-01 14:19:49,775::task::568::TaskManager.Task::(_updateState) Task=`28ac778a-0005-4eb9-995e-aee241960135`::moving from state init -> state preparing >Thread-203::INFO::2013-03-01 14:19:49,775::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='04bf19fa-db6c-4c8f-845f-b87411d8e898', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-203::DEBUG::2013-03-01 14:19:49,776::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`0ce55097-9598-4a16-ae79-6716807f8ab0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-203::DEBUG::2013-03-01 14:19:49,776::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-203::DEBUG::2013-03-01 14:19:49,776::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-203::DEBUG::2013-03-01 14:19:49,777::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`0ce55097-9598-4a16-ae79-6716807f8ab0`::Granted request >Thread-203::DEBUG::2013-03-01 14:19:49,777::task::794::TaskManager.Task::(resourceAcquired) Task=`28ac778a-0005-4eb9-995e-aee241960135`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-203::DEBUG::2013-03-01 14:19:49,778::task::957::TaskManager.Task::(_decref) Task=`28ac778a-0005-4eb9-995e-aee241960135`::ref 1 aborting False >Thread-203::DEBUG::2013-03-01 14:19:49,778::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`93fd414e-575d-4b4a-84ba-f8688659d69d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-203::DEBUG::2013-03-01 14:19:49,778::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' for lock type 'exclusive' >Thread-203::DEBUG::2013-03-01 14:19:49,779::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free. Now locking as 'exclusive' (1 active user) >Thread-203::DEBUG::2013-03-01 14:19:49,779::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`93fd414e-575d-4b4a-84ba-f8688659d69d`::Granted request >Thread-203::DEBUG::2013-03-01 14:19:49,780::task::794::TaskManager.Task::(resourceAcquired) Task=`28ac778a-0005-4eb9-995e-aee241960135`::_resourcesAcquired: Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898 (exclusive) >Thread-203::DEBUG::2013-03-01 14:19:49,780::task::957::TaskManager.Task::(_decref) Task=`28ac778a-0005-4eb9-995e-aee241960135`::ref 1 aborting False >Thread-203::INFO::2013-03-01 14:19:49,780::sp::918::Storage.StoragePool::(attachSD) sdUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898 spUUID=8fd46635-c46a-47a7-b122-316b2df29251 >Thread-203::DEBUG::2013-03-01 14:19:49,781::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-203::DEBUG::2013-03-01 14:19:49,781::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-203::DEBUG::2013-03-01 14:19:49,782::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-203::DEBUG::2013-03-01 14:19:49,782::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-203::DEBUG::2013-03-01 14:19:49,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-203::DEBUG::2013-03-01 14:19:49,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:19:49,810::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,814::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,816::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,821::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:49,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-203::DEBUG::2013-03-01 14:19:50,825::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-195::DEBUG::2013-03-01 14:19:51,707::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-204::DEBUG::2013-03-01 14:19:52,332::task::568::TaskManager.Task::(_updateState) Task=`ace950d0-b1d7-4fb8-bf1a-593cb77da17b`::moving from state init -> state preparing >Thread-203::DEBUG::2013-03-01 14:19:52,829::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-151::DEBUG::2013-03-01 14:19:53,630::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-204::INFO::2013-03-01 14:20:15,811::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-204::INFO::2013-03-01 14:20:15,818::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0151610374451', 'lastCheck': '32.2', 'code': 0, 'valid': True}} >Thread-204::DEBUG::2013-03-01 14:20:15,819::task::1151::TaskManager.Task::(prepare) Task=`ace950d0-b1d7-4fb8-bf1a-593cb77da17b`::finished: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0151610374451', 'lastCheck': '32.2', 'code': 0, 'valid': True}} >Thread-204::DEBUG::2013-03-01 14:20:15,828::task::568::TaskManager.Task::(_updateState) Task=`ace950d0-b1d7-4fb8-bf1a-593cb77da17b`::moving from state preparing -> state finished >Thread-204::DEBUG::2013-03-01 14:20:15,829::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-204::DEBUG::2013-03-01 14:20:15,829::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2013-03-01 14:20:15,830::task::957::TaskManager.Task::(_decref) Task=`ace950d0-b1d7-4fb8-bf1a-593cb77da17b`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:20:15,915::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420472 s, 24.4 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:20:16,052::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:20:16,053::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:20:16,060::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000264534 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:17,928::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:18,003::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314616 s, 32.5 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:18,588::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:18,588::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,593::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,593::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,593::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,594::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,594::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,594::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-203::DEBUG::2013-03-01 14:20:18,594::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,598::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:18,870::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:18,872::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,872::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-203::DEBUG::2013-03-01 14:20:18,873::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:18,880::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000252982 s, 8.1 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:18,880::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000252982 s, 8.1 MB/s'], size: 2048 >Thread-203::DEBUG::2013-03-01 14:20:18,880::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-203::WARNING::2013-03-01 14:20:18,880::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-203::DEBUG::2013-03-01 14:20:18,881::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-203::DEBUG::2013-03-01 14:20:18,881::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,881::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,882::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,882::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,882::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:18,883::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:19,125::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:19,126::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:19,127::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', '_SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1'] >Thread-203::DEBUG::2013-03-01 14:20:19,127::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:19,128::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:19,341::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:19,341::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-203::WARNING::2013-03-01 14:20:19,342::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_imageNS already registered >Thread-203::WARNING::2013-03-01 14:20:19,342::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_volumeNS already registered >Thread-203::WARNING::2013-03-01 14:20:19,342::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_lvmActivationNS already registered >Thread-203::INFO::2013-03-01 14:20:19,343::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 (id: 1) >Dummy-195::DEBUG::2013-03-01 14:20:20,017::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:20,092::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319939 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:22,106::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:22,317::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297889 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:24,331::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:24,408::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311371 s, 32.9 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:20:26,133::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:20:26,135::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-151::DEBUG::2013-03-01 14:20:26,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:20:26,387::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:20:26,388::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:20:26,395::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000256942 s, 15.9 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:26,422::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:26,502::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368578 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:28,516::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:28,591::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304342 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:30,605::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:30,703::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437642 s, 23.4 MB/s\n'; <rc> = 0 >Thread-210::DEBUG::2013-03-01 14:20:31,131::task::568::TaskManager.Task::(_updateState) Task=`1ba0667c-2afd-4b37-ad0f-8d972245cc51`::moving from state init -> state preparing >Thread-210::INFO::2013-03-01 14:20:31,131::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-210::INFO::2013-03-01 14:20:31,131::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00824308395386', 'lastCheck': '4.7', 'code': 0, 'valid': True}} >Thread-210::DEBUG::2013-03-01 14:20:31,132::task::1151::TaskManager.Task::(prepare) Task=`1ba0667c-2afd-4b37-ad0f-8d972245cc51`::finished: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00824308395386', 'lastCheck': '4.7', 'code': 0, 'valid': True}} >Thread-210::DEBUG::2013-03-01 14:20:31,132::task::568::TaskManager.Task::(_updateState) Task=`1ba0667c-2afd-4b37-ad0f-8d972245cc51`::moving from state preparing -> state finished >Thread-210::DEBUG::2013-03-01 14:20:31,132::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-210::DEBUG::2013-03-01 14:20:31,132::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-210::DEBUG::2013-03-01 14:20:31,132::task::957::TaskManager.Task::(_decref) Task=`1ba0667c-2afd-4b37-ad0f-8d972245cc51`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:20:32,717::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:32,922::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329639 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:34,936::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:35,007::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027455 s, 37.3 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:20:36,401::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:20:36,423::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735563 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:37,021::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:37,107::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034645 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:20:39,121::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:39,200::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323476 s, 31.7 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:40,346::clusterlock::191::SANLock::(acquireHostId) Host id for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 successfully acquired (id: 1) >Thread-203::WARNING::2013-03-01 14:20:40,763::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/images already exists >Thread-203::WARNING::2013-03-01 14:20:40,768::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/dom_md already exists >Thread-203::DEBUG::2013-03-01 14:20:40,769::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,769::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,770::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,770::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,770::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-203::DEBUG::2013-03-01 14:20:40,771::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:40,779::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000377585 s, 5.4 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:40,779::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000377585 s, 5.4 MB/s'], size: 2048 >Thread-203::DEBUG::2013-03-01 14:20:40,780::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-203::WARNING::2013-03-01 14:20:40,780::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-203::DEBUG::2013-03-01 14:20:40,780::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-203::DEBUG::2013-03-01 14:20:40,781::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,781::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,782::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,782::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,782::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:40,783::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:41,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:41,027::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,027::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', '_SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1'] >Thread-203::INFO::2013-03-01 14:20:41,028::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 (id: 1) >Thread-203::DEBUG::2013-03-01 14:20:41,037::clusterlock::248::SANLock::(acquire) Cluster lock for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 successfully acquired (id: 1) >Thread-203::DEBUG::2013-03-01 14:20:41,037::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,037::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,038::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,038::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,038::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,039::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:41,213::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:41,317::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421291 s, 24.3 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:41,566::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:41,568::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,568::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', '_SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'POOL_UUID=', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1'] >Thread-203::DEBUG::2013-03-01 14:20:41,569::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-203::DEBUG::2013-03-01 14:20:41,569::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-203::DEBUG::2013-03-01 14:20:41,569::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', '_SHA_CKSUM=1c51331621228c46ed576462471b25957023e8ac'] >Thread-203::DEBUG::2013-03-01 14:20:41,569::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,570::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,570::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,570::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,570::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,571::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-203::DEBUG::2013-03-01 14:20:41,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:20:41,811::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:20:41,811::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251, MDT__SHA_CKSUM=1c51331621228c46ed576462471b25957023e8ac removing=MDT__SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0, MDT_POOL_UUID= >Thread-203::DEBUG::2013-03-01 14:20:41,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_UUID= --deltag MDT__SHA_CKSUM=60cb09672f2462bdb6029e47a8a883cf3eec5bd0 --addtag MDT_POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251 --addtag MDT__SHA_CKSUM=1c51331621228c46ed576462471b25957023e8ac 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:20:43,331::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-151::DEBUG::2013-03-01 14:20:46,435::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:21:05,006::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000321433 s, 12.7 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:21:05,096::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0550254 s, 18.6 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:05,307::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:05,307::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,308::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,308::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-203::DEBUG::2013-03-01 14:21:05,308::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-203::DEBUG::2013-03-01 14:21:05,309::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-203::DEBUG::2013-03-01 14:21:05,309::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=63ec88ef37d5bb984e271ca9eb36cb136860556f'] >Thread-203::DEBUG::2013-03-01 14:21:05,310::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,310::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,310::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,311::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,311::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-203::DEBUG::2013-03-01 14:21:05,565::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:05,566::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:05,567::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=63ec88ef37d5bb984e271ca9eb36cb136860556f, MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active removing=MDT_POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=d4232d91d2386ecf4c25e50e8fb27b8eb11b51da >Thread-203::DEBUG::2013-03-01 14:21:05,568::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_DOMAINS=5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --deltag MDT__SHA_CKSUM=d4232d91d2386ecf4c25e50e8fb27b8eb11b51da --addtag MDT__SHA_CKSUM=63ec88ef37d5bb984e271ca9eb36cb136860556f --addtag MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:07,182::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-216::DEBUG::2013-03-01 14:21:08,040::task::568::TaskManager.Task::(_updateState) Task=`fc902625-8c88-443d-b084-374548368b67`::moving from state init -> state preparing >Thread-151::DEBUG::2013-03-01 14:21:15,024::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-216::INFO::2013-03-01 14:21:30,280::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-216::INFO::2013-03-01 14:21:30,281::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '18.5726900101', 'lastCheck': '25.3', 'code': 0, 'valid': True}} >Thread-216::DEBUG::2013-03-01 14:21:30,288::task::1151::TaskManager.Task::(prepare) Task=`fc902625-8c88-443d-b084-374548368b67`::finished: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '18.5726900101', 'lastCheck': '25.3', 'code': 0, 'valid': True}} >Thread-216::DEBUG::2013-03-01 14:21:30,291::task::568::TaskManager.Task::(_updateState) Task=`fc902625-8c88-443d-b084-374548368b67`::moving from state preparing -> state finished >Thread-216::DEBUG::2013-03-01 14:21:30,294::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-216::DEBUG::2013-03-01 14:21:30,297::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2013-03-01 14:21:30,300::task::957::TaskManager.Task::(_decref) Task=`fc902625-8c88-443d-b084-374548368b67`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 14:21:30,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268332 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:21:30,396::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0675196 s, 15.2 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:21:32,409::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-203::DEBUG::2013-03-01 14:21:33,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:33,716::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,718::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,719::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-203::WARNING::2013-03-01 14:21:33,721::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/images already exists >Thread-203::WARNING::2013-03-01 14:21:33,724::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/dom_md already exists >Thread-203::INFO::2013-03-01 14:21:33,729::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-203::DEBUG::2013-03-01 14:21:33,732::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-203::DEBUG::2013-03-01 14:21:33,736::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-203::DEBUG::2013-03-01 14:21:33,737::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-203::DEBUG::2013-03-01 14:21:33,739::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-203::DEBUG::2013-03-01 14:21:33,741::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=0', 'PHYBLKSIZE=4096', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', '_SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790'] >Thread-203::DEBUG::2013-03-01 14:21:33,743::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,745::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,748::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,752::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,754::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:33,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:33,813::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049209 s, 20.8 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:34,354::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:34,356::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:34,356::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_MASTER_VERSION=0, MDT__SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790 removing=MDT__SHA_CKSUM=1c51331621228c46ed576462471b25957023e8ac >Thread-203::DEBUG::2013-03-01 14:21:34,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=1c51331621228c46ed576462471b25957023e8ac --addtag MDT__SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790 --addtag MDT_MASTER_VERSION=0 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-203::DEBUG::2013-03-01 14:21:35,233::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:35,233::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:35,234::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-203::DEBUG::2013-03-01 14:21:35,234::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-203::INFO::2013-03-01 14:21:35,235::clusterlock::252::SANLock::(release) Releasing cluster lock for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-203::DEBUG::2013-03-01 14:21:35,236::clusterlock::263::SANLock::(release) Cluster lock for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 successfully released >Thread-203::INFO::2013-03-01 14:21:35,237::clusterlock::196::SANLock::(releaseHostId) Releasing host id for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 (id: 1) >Dummy-195::DEBUG::2013-03-01 14:21:36,320::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:36,428::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455855 s, 22.5 MB/s\n'; <rc> = 0 >Thread-203::DEBUG::2013-03-01 14:21:37,238::clusterlock::206::SANLock::(releaseHostId) Host id for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 released successfully (id: 1) >Thread-203::DEBUG::2013-03-01 14:21:37,238::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-203::DEBUG::2013-03-01 14:21:37,238::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-203::DEBUG::2013-03-01 14:21:37,239::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-203::INFO::2013-03-01 14:21:37,239::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-203::DEBUG::2013-03-01 14:21:37,239::task::1151::TaskManager.Task::(prepare) Task=`28ac778a-0005-4eb9-995e-aee241960135`::finished: None >Thread-203::DEBUG::2013-03-01 14:21:37,239::task::568::TaskManager.Task::(_updateState) Task=`28ac778a-0005-4eb9-995e-aee241960135`::moving from state preparing -> state finished >Thread-203::DEBUG::2013-03-01 14:21:37,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898': < ResourceRef 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', isValid: 'True' obj: 'None'>} >Thread-203::DEBUG::2013-03-01 14:21:37,240::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2013-03-01 14:21:37,240::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-203::DEBUG::2013-03-01 14:21:37,241::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-203::DEBUG::2013-03-01 14:21:37,241::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-203::DEBUG::2013-03-01 14:21:37,241::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-203::DEBUG::2013-03-01 14:21:37,242::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' >Thread-203::DEBUG::2013-03-01 14:21:37,242::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' (0 active users) >Thread-203::DEBUG::2013-03-01 14:21:37,242::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free, finding out if anyone is waiting for it. >Thread-203::DEBUG::2013-03-01 14:21:37,242::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', Clearing records. >Thread-203::DEBUG::2013-03-01 14:21:37,243::task::957::TaskManager.Task::(_decref) Task=`28ac778a-0005-4eb9-995e-aee241960135`::ref 0 aborting False >Thread-220::DEBUG::2013-03-01 14:21:37,272::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-220::DEBUG::2013-03-01 14:21:37,272::task::568::TaskManager.Task::(_updateState) Task=`98a402a2-60e5-450c-a941-b85f3708b0b5`::moving from state init -> state preparing >Thread-220::INFO::2013-03-01 14:21:37,273::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-220::INFO::2013-03-01 14:21:37,273::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-220::DEBUG::2013-03-01 14:21:37,273::task::1151::TaskManager.Task::(prepare) Task=`98a402a2-60e5-450c-a941-b85f3708b0b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-220::DEBUG::2013-03-01 14:21:37,273::task::568::TaskManager.Task::(_updateState) Task=`98a402a2-60e5-450c-a941-b85f3708b0b5`::moving from state preparing -> state finished >Thread-220::DEBUG::2013-03-01 14:21:37,274::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-220::DEBUG::2013-03-01 14:21:37,274::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-220::DEBUG::2013-03-01 14:21:37,274::task::957::TaskManager.Task::(_decref) Task=`98a402a2-60e5-450c-a941-b85f3708b0b5`::ref 0 aborting False >Thread-221::DEBUG::2013-03-01 14:21:37,346::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-221::DEBUG::2013-03-01 14:21:37,347::task::568::TaskManager.Task::(_updateState) Task=`1e83ed33-991d-40da-b974-8a974720b47d`::moving from state init -> state preparing >Thread-221::INFO::2013-03-01 14:21:37,347::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-221::DEBUG::2013-03-01 14:21:37,348::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`3157a8eb-98da-41c5-ab54-eaee7c878608`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-221::DEBUG::2013-03-01 14:21:37,348::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-221::DEBUG::2013-03-01 14:21:37,348::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-221::DEBUG::2013-03-01 14:21:37,348::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`3157a8eb-98da-41c5-ab54-eaee7c878608`::Granted request >Thread-221::DEBUG::2013-03-01 14:21:37,349::task::794::TaskManager.Task::(resourceAcquired) Task=`1e83ed33-991d-40da-b974-8a974720b47d`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-221::DEBUG::2013-03-01 14:21:37,349::task::957::TaskManager.Task::(_decref) Task=`1e83ed33-991d-40da-b974-8a974720b47d`::ref 1 aborting False >Thread-221::DEBUG::2013-03-01 14:21:37,350::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-221::DEBUG::2013-03-01 14:21:37,351::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-221::DEBUG::2013-03-01 14:21:37,610::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-221::DEBUG::2013-03-01 14:21:37,612::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-221::INFO::2013-03-01 14:21:37,613::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': '04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': 'Attached'}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-221::DEBUG::2013-03-01 14:21:37,614::task::1151::TaskManager.Task::(prepare) Task=`1e83ed33-991d-40da-b974-8a974720b47d`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': '04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': 'Attached'}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': 'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-221::DEBUG::2013-03-01 14:21:37,614::task::568::TaskManager.Task::(_updateState) Task=`1e83ed33-991d-40da-b974-8a974720b47d`::moving from state preparing -> state finished >Thread-221::DEBUG::2013-03-01 14:21:37,614::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-221::DEBUG::2013-03-01 14:21:37,615::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221::DEBUG::2013-03-01 14:21:37,615::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-221::DEBUG::2013-03-01 14:21:37,615::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-221::DEBUG::2013-03-01 14:21:37,616::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-221::DEBUG::2013-03-01 14:21:37,616::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-221::DEBUG::2013-03-01 14:21:37,616::task::957::TaskManager.Task::(_decref) Task=`1e83ed33-991d-40da-b974-8a974720b47d`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:21:38,440::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:38,547::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394482 s, 26.0 MB/s\n'; <rc> = 0 >Thread-222::DEBUG::2013-03-01 14:21:38,734::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-222::DEBUG::2013-03-01 14:21:38,735::task::568::TaskManager.Task::(_updateState) Task=`5953c1fe-1745-48b0-92c6-d4da589698bf`::moving from state init -> state preparing >Thread-222::INFO::2013-03-01 14:21:38,736::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8fd46635-c46a-47a7-b122-316b2df29251', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7', 'port': '3260'}], options=None) >Thread-222::DEBUG::2013-03-01 14:21:38,737::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-222::DEBUG::2013-03-01 14:21:38,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-222::DEBUG::2013-03-01 14:21:38,759::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-222::DEBUG::2013-03-01 14:21:38,777::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-222::DEBUG::2013-03-01 14:21:38,778::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-222::DEBUG::2013-03-01 14:21:38,795::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-222::INFO::2013-03-01 14:21:38,796::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-222::DEBUG::2013-03-01 14:21:38,796::task::1151::TaskManager.Task::(prepare) Task=`5953c1fe-1745-48b0-92c6-d4da589698bf`::finished: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-222::DEBUG::2013-03-01 14:21:38,797::task::568::TaskManager.Task::(_updateState) Task=`5953c1fe-1745-48b0-92c6-d4da589698bf`::moving from state preparing -> state finished >Thread-222::DEBUG::2013-03-01 14:21:38,797::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-222::DEBUG::2013-03-01 14:21:38,797::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-222::DEBUG::2013-03-01 14:21:38,798::task::957::TaskManager.Task::(_decref) Task=`5953c1fe-1745-48b0-92c6-d4da589698bf`::ref 0 aborting False >Thread-223::DEBUG::2013-03-01 14:21:38,831::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-223::DEBUG::2013-03-01 14:21:38,832::task::568::TaskManager.Task::(_updateState) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::moving from state init -> state preparing >Thread-223::INFO::2013-03-01 14:21:38,832::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='04bf19fa-db6c-4c8f-845f-b87411d8e898', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-223::DEBUG::2013-03-01 14:21:38,833::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`866e2874-1886-4489-bc99-fccafd43e6ea`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-223::DEBUG::2013-03-01 14:21:38,833::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-223::DEBUG::2013-03-01 14:21:38,834::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-223::DEBUG::2013-03-01 14:21:38,834::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`866e2874-1886-4489-bc99-fccafd43e6ea`::Granted request >Thread-223::DEBUG::2013-03-01 14:21:38,835::task::794::TaskManager.Task::(resourceAcquired) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-223::DEBUG::2013-03-01 14:21:38,835::task::957::TaskManager.Task::(_decref) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::ref 1 aborting False >Thread-223::DEBUG::2013-03-01 14:21:38,835::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`6771c084-6acc-4c00-846e-b8d36ef665fa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-223::DEBUG::2013-03-01 14:21:38,836::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' for lock type 'exclusive' >Thread-223::DEBUG::2013-03-01 14:21:38,836::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free. Now locking as 'exclusive' (1 active user) >Thread-223::DEBUG::2013-03-01 14:21:38,836::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`6771c084-6acc-4c00-846e-b8d36ef665fa`::Granted request >Thread-223::DEBUG::2013-03-01 14:21:38,837::task::794::TaskManager.Task::(resourceAcquired) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::_resourcesAcquired: Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898 (exclusive) >Thread-223::DEBUG::2013-03-01 14:21:38,837::task::957::TaskManager.Task::(_decref) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::ref 1 aborting False >Thread-223::INFO::2013-03-01 14:21:38,838::sp::1045::Storage.StoragePool::(activateSD) sdUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898 spUUID=8fd46635-c46a-47a7-b122-316b2df29251 >Thread-223::DEBUG::2013-03-01 14:21:38,838::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-223::DEBUG::2013-03-01 14:21:38,839::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-223::DEBUG::2013-03-01 14:21:38,839::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-223::DEBUG::2013-03-01 14:21:38,839::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-223::DEBUG::2013-03-01 14:21:38,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:38,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:38,870::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:38,874::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:39,877::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:40,565::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:40,662::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386099 s, 26.5 MB/s\n'; <rc> = 0 >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:40,882::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:41,886::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:42,681::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:42,786::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411228 s, 24.9 MB/s\n'; <rc> = 0 >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:42,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:42,893::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-151::DEBUG::2013-03-01 14:21:43,754::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:21:43,762::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000452719 s, 9.0 MB/s\n'; <rc> = 0 >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:43,897::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-223::DEBUG::2013-03-01 14:21:43,900::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-195::DEBUG::2013-03-01 14:21:44,806::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:44,918::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493841 s, 20.7 MB/s\n'; <rc> = 0 >Thread-226::DEBUG::2013-03-01 14:21:45,584::task::568::TaskManager.Task::(_updateState) Task=`8789b2b0-0e82-4a45-a38f-2758b8aea004`::moving from state init -> state preparing >Thread-226::INFO::2013-03-01 14:21:45,584::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-226::INFO::2013-03-01 14:21:45,585::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0094940662384', 'lastCheck': '1.8', 'code': 0, 'valid': True}} >Thread-226::DEBUG::2013-03-01 14:21:45,585::task::1151::TaskManager.Task::(prepare) Task=`8789b2b0-0e82-4a45-a38f-2758b8aea004`::finished: {'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0094940662384', 'lastCheck': '1.8', 'code': 0, 'valid': True}} >Thread-226::DEBUG::2013-03-01 14:21:45,585::task::568::TaskManager.Task::(_updateState) Task=`8789b2b0-0e82-4a45-a38f-2758b8aea004`::moving from state preparing -> state finished >Thread-226::DEBUG::2013-03-01 14:21:45,585::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-226::DEBUG::2013-03-01 14:21:45,586::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2013-03-01 14:21:45,586::task::957::TaskManager.Task::(_decref) Task=`8789b2b0-0e82-4a45-a38f-2758b8aea004`::ref 0 aborting False >Thread-223::DEBUG::2013-03-01 14:21:45,904::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:46,937::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:47,026::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436816 s, 23.4 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:21:49,040::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:49,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411762 s, 24.9 MB/s\n'; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:49,148::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:49,150::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,157::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,157::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,157::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,158::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,158::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,159::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-223::DEBUG::2013-03-01 14:21:49,159::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,162::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:49,389::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:49,392::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,392::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-223::DEBUG::2013-03-01 14:21:49,392::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:49,401::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000312548 s, 6.6 MB/s\n'; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:49,401::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000312548 s, 6.6 MB/s'], size: 2048 >Thread-223::DEBUG::2013-03-01 14:21:49,402::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-223::WARNING::2013-03-01 14:21:49,402::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-223::DEBUG::2013-03-01 14:21:49,402::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-223::DEBUG::2013-03-01 14:21:49,403::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,403::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,403::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,404::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,404::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,405::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:49,665::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:49,667::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,667::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', '_SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790', 'MASTER_VERSION=0'] >Thread-223::DEBUG::2013-03-01 14:21:49,668::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,669::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:49,950::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:49,950::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-223::WARNING::2013-03-01 14:21:49,951::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_imageNS already registered >Thread-223::WARNING::2013-03-01 14:21:49,952::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_volumeNS already registered >Thread-223::WARNING::2013-03-01 14:21:49,952::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_lvmActivationNS already registered >Thread-223::DEBUG::2013-03-01 14:21:49,953::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-223::DEBUG::2013-03-01 14:21:49,953::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-223::DEBUG::2013-03-01 14:21:49,954::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e'] >Thread-223::DEBUG::2013-03-01 14:21:49,954::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,954::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,955::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,955::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,956::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:49,957::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:50,222::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:50,224::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:50,224::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e removing=MDT__SHA_CKSUM=63ec88ef37d5bb984e271ca9eb36cb136860556f, MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active >Thread-223::DEBUG::2013-03-01 14:21:50,226::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=63ec88ef37d5bb984e271ca9eb36cb136860556f --deltag MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Attached&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --addtag MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --addtag MDT__SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-223::DEBUG::2013-03-01 14:21:50,575::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-223::DEBUG::2013-03-01 14:21:50,576::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:50,576::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-223::DEBUG::2013-03-01 14:21:50,577::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-223::WARNING::2013-03-01 14:21:50,577::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/images already exists >Thread-223::WARNING::2013-03-01 14:21:50,577::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/dom_md already exists >Thread-223::INFO::2013-03-01 14:21:50,578::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-223::DEBUG::2013-03-01 14:21:50,579::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-223::DEBUG::2013-03-01 14:21:50,579::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-223::DEBUG::2013-03-01 14:21:50,580::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-223::DEBUG::2013-03-01 14:21:50,580::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-223::DEBUG::2013-03-01 14:21:50,580::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-223::DEBUG::2013-03-01 14:21:50,580::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-229::DEBUG::2013-03-01 14:21:50,582::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-223::DEBUG::2013-03-01 14:21:50,582::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8fd46635-c46a-47a7-b122-316b2df29251` started monitoring domain `04bf19fa-db6c-4c8f-845f-b87411d8e898` >Thread-223::DEBUG::2013-03-01 14:21:50,584::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-229::DEBUG::2013-03-01 14:21:50,587::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-223::INFO::2013-03-01 14:21:50,587::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-223::DEBUG::2013-03-01 14:21:50,597::task::1151::TaskManager.Task::(prepare) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::finished: None >Thread-223::DEBUG::2013-03-01 14:21:50,597::task::568::TaskManager.Task::(_updateState) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::moving from state preparing -> state finished >Thread-223::DEBUG::2013-03-01 14:21:50,597::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898': < ResourceRef 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', isValid: 'True' obj: 'None'>} >Thread-223::DEBUG::2013-03-01 14:21:50,598::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-223::DEBUG::2013-03-01 14:21:50,598::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-223::DEBUG::2013-03-01 14:21:50,599::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-223::DEBUG::2013-03-01 14:21:50,599::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-223::DEBUG::2013-03-01 14:21:50,599::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-223::DEBUG::2013-03-01 14:21:50,600::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' >Thread-223::DEBUG::2013-03-01 14:21:50,600::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' (0 active users) >Thread-223::DEBUG::2013-03-01 14:21:50,600::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free, finding out if anyone is waiting for it. >Thread-223::DEBUG::2013-03-01 14:21:50,601::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', Clearing records. >Thread-223::DEBUG::2013-03-01 14:21:50,601::task::957::TaskManager.Task::(_decref) Task=`522c8278-7c31-4ea3-898b-596a5acddc12`::ref 0 aborting False >Thread-230::DEBUG::2013-03-01 14:21:50,653::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-230::DEBUG::2013-03-01 14:21:50,654::task::568::TaskManager.Task::(_updateState) Task=`65ec0894-f33e-436a-8f24-6b1a925b6367`::moving from state init -> state preparing >Thread-230::INFO::2013-03-01 14:21:50,654::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-230::INFO::2013-03-01 14:21:50,654::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-230::DEBUG::2013-03-01 14:21:50,654::task::1151::TaskManager.Task::(prepare) Task=`65ec0894-f33e-436a-8f24-6b1a925b6367`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-230::DEBUG::2013-03-01 14:21:50,655::task::568::TaskManager.Task::(_updateState) Task=`65ec0894-f33e-436a-8f24-6b1a925b6367`::moving from state preparing -> state finished >Thread-230::DEBUG::2013-03-01 14:21:50,655::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-230::DEBUG::2013-03-01 14:21:50,655::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-230::DEBUG::2013-03-01 14:21:50,655::task::957::TaskManager.Task::(_decref) Task=`65ec0894-f33e-436a-8f24-6b1a925b6367`::ref 0 aborting False >Thread-231::DEBUG::2013-03-01 14:21:50,664::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-231::DEBUG::2013-03-01 14:21:50,665::task::568::TaskManager.Task::(_updateState) Task=`8b298437-d865-4ed4-87b8-a00d1040019d`::moving from state init -> state preparing >Thread-231::INFO::2013-03-01 14:21:50,665::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', msdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', masterVersion=1, options=None) >Thread-231::DEBUG::2013-03-01 14:21:50,665::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`dfdbc75a-b5bd-4f1e-9a6d-7aab9245446d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-231::DEBUG::2013-03-01 14:21:50,665::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-231::DEBUG::2013-03-01 14:21:50,666::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-231::DEBUG::2013-03-01 14:21:50,666::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`dfdbc75a-b5bd-4f1e-9a6d-7aab9245446d`::Granted request >Thread-231::DEBUG::2013-03-01 14:21:50,666::task::794::TaskManager.Task::(resourceAcquired) Task=`8b298437-d865-4ed4-87b8-a00d1040019d`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-231::DEBUG::2013-03-01 14:21:50,667::task::957::TaskManager.Task::(_decref) Task=`8b298437-d865-4ed4-87b8-a00d1040019d`::ref 1 aborting False >Thread-231::INFO::2013-03-01 14:21:50,667::blockSD::818::Storage.StorageDomain::(validate) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-231::DEBUG::2013-03-01 14:21:50,667::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-232::DEBUG::2013-03-01 14:21:50,685::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-232::DEBUG::2013-03-01 14:21:50,685::task::568::TaskManager.Task::(_updateState) Task=`4c030378-f609-4a9c-9153-beba32006d86`::moving from state init -> state preparing >Thread-232::INFO::2013-03-01 14:21:50,686::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-232::DEBUG::2013-03-01 14:21:50,687::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`5877da79-ab8d-4053-8b02-a153f4d3134f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-232::DEBUG::2013-03-01 14:21:50,687::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-232::DEBUG::2013-03-01 14:21:50,687::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-232::DEBUG::2013-03-01 14:21:50,688::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`5877da79-ab8d-4053-8b02-a153f4d3134f`::Granted request >Thread-232::DEBUG::2013-03-01 14:21:50,689::task::794::TaskManager.Task::(resourceAcquired) Task=`4c030378-f609-4a9c-9153-beba32006d86`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-232::DEBUG::2013-03-01 14:21:50,690::task::957::TaskManager.Task::(_decref) Task=`4c030378-f609-4a9c-9153-beba32006d86`::ref 1 aborting False >Thread-232::DEBUG::2013-03-01 14:21:50,691::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:21:50,692::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-229::DEBUG::2013-03-01 14:21:50,804::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:21:50,805::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:21:50,813::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000286124 s, 14.3 MB/s\n'; <rc> = 0 >Thread-229::INFO::2013-03-01 14:21:50,814::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 (id: 1) >Thread-229::DEBUG::2013-03-01 14:21:50,815::clusterlock::191::SANLock::(acquireHostId) Host id for domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 successfully acquired (id: 1) >Thread-231::DEBUG::2013-03-01 14:21:50,885::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-231::DEBUG::2013-03-01 14:21:50,886::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-232::DEBUG::2013-03-01 14:21:50,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:21:50,892::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:50,893::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:50,893::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:50,893::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:50,894::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:50,894::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:50,894::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-231::DEBUG::2013-03-01 14:21:51,097::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-231::DEBUG::2013-03-01 14:21:51,099::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:51,099::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e'] >Thread-231::DEBUG::2013-03-01 14:21:51,103::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:51,103::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:51,103::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:51,104::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:51,104::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:21:51,104::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:21:51,105::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-232::DEBUG::2013-03-01 14:21:51,105::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-232::DEBUG::2013-03-01 14:21:51,105::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-232::DEBUG::2013-03-01 14:21:51,105::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-232::DEBUG::2013-03-01 14:21:51,106::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-232::DEBUG::2013-03-01 14:21:51,134::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:21:51,134::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:51,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:51,154::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:51,254::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433474 s, 23.6 MB/s\n'; <rc> = 0 >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:52,141::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:53,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:53,269::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:53,362::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385027 s, 26.6 MB/s\n'; <rc> = 0 >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:54,149::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:55,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:55,376::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:55,468::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384295 s, 26.6 MB/s\n'; <rc> = 0 >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:56,158::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:56,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-232::DEBUG::2013-03-01 14:21:57,165::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-195::DEBUG::2013-03-01 14:21:57,487::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:57,563::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031922 s, 32.1 MB/s\n'; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:21:59,168::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:59,576::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:21:59,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428239 s, 23.9 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:00,816::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-236::DEBUG::2013-03-01 14:22:00,848::task::568::TaskManager.Task::(_updateState) Task=`5a3dabde-ef40-42e5-af47-07fdcc6641cb`::moving from state init -> state preparing >Thread-236::INFO::2013-03-01 14:22:00,848::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-236::INFO::2013-03-01 14:22:00,848::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00888013839722', 'lastCheck': '10.0', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0094940662384', 'lastCheck': '17.1', 'code': 0, 'valid': True}} >Thread-236::DEBUG::2013-03-01 14:22:00,849::task::1151::TaskManager.Task::(prepare) Task=`5a3dabde-ef40-42e5-af47-07fdcc6641cb`::finished: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00888013839722', 'lastCheck': '10.0', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0094940662384', 'lastCheck': '17.1', 'code': 0, 'valid': True}} >Thread-236::DEBUG::2013-03-01 14:22:00,849::task::568::TaskManager.Task::(_updateState) Task=`5a3dabde-ef40-42e5-af47-07fdcc6641cb`::moving from state preparing -> state finished >Thread-236::DEBUG::2013-03-01 14:22:00,849::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-236::DEBUG::2013-03-01 14:22:00,849::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2013-03-01 14:22:00,850::task::957::TaskManager.Task::(_decref) Task=`5a3dabde-ef40-42e5-af47-07fdcc6641cb`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:22:01,687::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:01,792::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04047 s, 25.3 MB/s\n'; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:22:02,389::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:22:02,390::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,390::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,391::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,391::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,391::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,392::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,392::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-229::DEBUG::2013-03-01 14:22:02,392::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-232::DEBUG::2013-03-01 14:22:02,394::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:02,394::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-229::DEBUG::2013-03-01 14:22:02,396::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-229::DEBUG::2013-03-01 14:22:02,398::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-232::DEBUG::2013-03-01 14:22:02,410::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:02,437::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:02,438::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:02,441::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-232::DEBUG::2013-03-01 14:22:02,632::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:22:02,634::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,634::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-232::DEBUG::2013-03-01 14:22:02,634::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-232::DEBUG::2013-03-01 14:22:02,642::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000271846 s, 7.5 MB/s\n'; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:22:02,643::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000271846 s, 7.5 MB/s'], size: 2048 >Thread-232::DEBUG::2013-03-01 14:22:02,643::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-232::WARNING::2013-03-01 14:22:02,643::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-232::DEBUG::2013-03-01 14:22:02,644::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-232::DEBUG::2013-03-01 14:22:02,644::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,645::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,645::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,646::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,646::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,647::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-232::DEBUG::2013-03-01 14:22:02,901::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:22:02,902::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,902::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e'] >Thread-232::DEBUG::2013-03-01 14:22:02,903::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-232::DEBUG::2013-03-01 14:22:02,904::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-232::DEBUG::2013-03-01 14:22:03,115::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-232::DEBUG::2013-03-01 14:22:03,115::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-232::WARNING::2013-03-01 14:22:03,116::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >Thread-232::WARNING::2013-03-01 14:22:03,116::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >Thread-232::WARNING::2013-03-01 14:22:03,116::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >Thread-231::DEBUG::2013-03-01 14:22:03,120::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de verified, version 1 >Thread-231::DEBUG::2013-03-01 14:22:03,121::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-231::DEBUG::2013-03-01 14:22:03,121::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-231::DEBUG::2013-03-01 14:22:03,122::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-231::WARNING::2013-03-01 14:22:03,123::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251 already exists >Thread-151::DEBUG::2013-03-01 14:22:03,124::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-231::DEBUG::2013-03-01 14:22:03,125::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-231::DEBUG::2013-03-01 14:22:03,135::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:03,349::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-231::DEBUG::2013-03-01 14:22:03,351::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:22:03,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-231::DEBUG::2013-03-01 14:22:03,364::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-231::WARNING::2013-03-01 14:22:03,367::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/dom_md already exists >Thread-231::WARNING::2013-03-01 14:22:03,370::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/images already exists >Thread-151::DEBUG::2013-03-01 14:22:03,376::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000295305 s, 13.9 MB/s\n'; <rc> = 0 >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:03,445::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:03,448::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-231::INFO::2013-03-01 14:22:03,448::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-231::WARNING::2013-03-01 14:22:03,449::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >Thread-231::WARNING::2013-03-01 14:22:03,451::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >Thread-231::INFO::2013-03-01 14:22:03,452::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-231::INFO::2013-03-01 14:22:03,452::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd >Thread-231::INFO::2013-03-01 14:22:03,453::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-231::DEBUG::2013-03-01 14:22:03,453::task::1151::TaskManager.Task::(prepare) Task=`8b298437-d865-4ed4-87b8-a00d1040019d`::finished: None >Thread-231::DEBUG::2013-03-01 14:22:03,453::task::568::TaskManager.Task::(_updateState) Task=`8b298437-d865-4ed4-87b8-a00d1040019d`::moving from state preparing -> state finished >Thread-231::DEBUG::2013-03-01 14:22:03,454::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-231::DEBUG::2013-03-01 14:22:03,454::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-231::DEBUG::2013-03-01 14:22:03,454::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-231::DEBUG::2013-03-01 14:22:03,455::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (1 active users) >Thread-231::DEBUG::2013-03-01 14:22:03,455::task::957::TaskManager.Task::(_decref) Task=`8b298437-d865-4ed4-87b8-a00d1040019d`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:22:03,806::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:03,904::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361554 s, 28.3 MB/s\n'; <rc> = 0 >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:04,452::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:04,455::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:04,457::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-262::DEBUG::2013-03-01 14:22:04,885::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-262::DEBUG::2013-03-01 14:22:04,886::task::568::TaskManager.Task::(_updateState) Task=`0ddd500f-1a63-4abe-93c3-d8e37773a799`::moving from state init -> state preparing >Thread-262::INFO::2013-03-01 14:22:04,887::logUtils::37::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.7', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-262::DEBUG::2013-03-01 14:22:04,887::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-262::DEBUG::2013-03-01 14:22:04,913::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-262::DEBUG::2013-03-01 14:22:04,914::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-262::DEBUG::2013-03-01 14:22:04,931::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: Cannot modify node.startup. Invalid param name.\n'; <rc> = 7 >Thread-262::DEBUG::2013-03-01 14:22:04,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-262::DEBUG::2013-03-01 14:22:04,950::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-262::DEBUG::2013-03-01 14:22:04,951::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --discover' (cwd None) >Thread-262::DEBUG::2013-03-01 14:22:04,972::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-262::DEBUG::2013-03-01 14:22:04,973::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.7:3260 --op=delete' (cwd None) >Thread-262::DEBUG::2013-03-01 14:22:04,990::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-262::INFO::2013-03-01 14:22:04,991::logUtils::39::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-262::DEBUG::2013-03-01 14:22:04,991::task::1151::TaskManager.Task::(prepare) Task=`0ddd500f-1a63-4abe-93c3-d8e37773a799`::finished: {'fullTargets': ['10.35.160.7:3260,1 iqn.2008-05.com.xtremio:001e675b8ee0'], 'targets': ['iqn.2008-05.com.xtremio:001e675b8ee0']} >Thread-262::DEBUG::2013-03-01 14:22:04,991::task::568::TaskManager.Task::(_updateState) Task=`0ddd500f-1a63-4abe-93c3-d8e37773a799`::moving from state preparing -> state finished >Thread-262::DEBUG::2013-03-01 14:22:04,991::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-262::DEBUG::2013-03-01 14:22:04,992::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-262::DEBUG::2013-03-01 14:22:04,992::task::957::TaskManager.Task::(_decref) Task=`0ddd500f-1a63-4abe-93c3-d8e37773a799`::ref 0 aborting False >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:05,461::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:05,918::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-263::DEBUG::2013-03-01 14:22:05,952::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-263::DEBUG::2013-03-01 14:22:05,955::task::568::TaskManager.Task::(_updateState) Task=`43654a20-97bd-4f76-92c4-faaead5be8f0`::moving from state init -> state preparing >Thread-263::INFO::2013-03-01 14:22:05,957::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-263::INFO::2013-03-01 14:22:05,959::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-263::DEBUG::2013-03-01 14:22:05,960::task::1151::TaskManager.Task::(prepare) Task=`43654a20-97bd-4f76-92c4-faaead5be8f0`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-263::DEBUG::2013-03-01 14:22:05,961::task::568::TaskManager.Task::(_updateState) Task=`43654a20-97bd-4f76-92c4-faaead5be8f0`::moving from state preparing -> state finished >Thread-263::DEBUG::2013-03-01 14:22:05,963::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-263::DEBUG::2013-03-01 14:22:05,964::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-263::DEBUG::2013-03-01 14:22:05,966::task::957::TaskManager.Task::(_decref) Task=`43654a20-97bd-4f76-92c4-faaead5be8f0`::ref 0 aborting False >Thread-264::DEBUG::2013-03-01 14:22:06,019::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-264::DEBUG::2013-03-01 14:22:06,021::task::568::TaskManager.Task::(_updateState) Task=`6e77e792-bcf7-4728-a44e-48c5537ca144`::moving from state init -> state preparing >Thread-264::INFO::2013-03-01 14:22:06,023::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-264::DEBUG::2013-03-01 14:22:06,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-264::DEBUG::2013-03-01 14:22:06,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-264::DEBUG::2013-03-01 14:22:06,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-264::DEBUG::2013-03-01 14:22:06,072::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-264::DEBUG::2013-03-01 14:22:06,075::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:06,087::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0638129 s, 16.0 MB/s\n'; <rc> = 0 >Thread-264::DEBUG::2013-03-01 14:22:06,095::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-264::INFO::2013-03-01 14:22:06,096::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-264::DEBUG::2013-03-01 14:22:06,097::task::1151::TaskManager.Task::(prepare) Task=`6e77e792-bcf7-4728-a44e-48c5537ca144`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-264::DEBUG::2013-03-01 14:22:06,098::task::568::TaskManager.Task::(_updateState) Task=`6e77e792-bcf7-4728-a44e-48c5537ca144`::moving from state preparing -> state finished >Thread-264::DEBUG::2013-03-01 14:22:06,099::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-264::DEBUG::2013-03-01 14:22:06,101::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-264::DEBUG::2013-03-01 14:22:06,102::task::957::TaskManager.Task::(_decref) Task=`6e77e792-bcf7-4728-a44e-48c5537ca144`::ref 0 aborting False >MainProcess|Thread-229::DEBUG::2013-03-01 14:22:06,465::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-266::DEBUG::2013-03-01 14:22:07,163::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-266::DEBUG::2013-03-01 14:22:07,163::task::568::TaskManager.Task::(_updateState) Task=`a5eec928-dbd5-4612-be46-e289d4200601`::moving from state init -> state preparing >Thread-266::INFO::2013-03-01 14:22:07,164::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-266::INFO::2013-03-01 14:22:07,164::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-266::DEBUG::2013-03-01 14:22:07,164::task::1151::TaskManager.Task::(prepare) Task=`a5eec928-dbd5-4612-be46-e289d4200601`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-266::DEBUG::2013-03-01 14:22:07,164::task::568::TaskManager.Task::(_updateState) Task=`a5eec928-dbd5-4612-be46-e289d4200601`::moving from state preparing -> state finished >Thread-266::DEBUG::2013-03-01 14:22:07,165::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-266::DEBUG::2013-03-01 14:22:07,165::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-266::DEBUG::2013-03-01 14:22:07,165::task::957::TaskManager.Task::(_decref) Task=`a5eec928-dbd5-4612-be46-e289d4200601`::ref 0 aborting False >Thread-267::DEBUG::2013-03-01 14:22:07,208::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-267::DEBUG::2013-03-01 14:22:07,209::task::568::TaskManager.Task::(_updateState) Task=`95618a33-10c6-4db7-a61d-c40d49fd3305`::moving from state init -> state preparing >Thread-267::INFO::2013-03-01 14:22:07,209::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-267::DEBUG::2013-03-01 14:22:07,210::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-267::DEBUG::2013-03-01 14:22:07,228::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-267::DEBUG::2013-03-01 14:22:07,229::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-267::DEBUG::2013-03-01 14:22:07,247::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-267::DEBUG::2013-03-01 14:22:07,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-267::DEBUG::2013-03-01 14:22:07,266::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-267::INFO::2013-03-01 14:22:07,266::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-267::DEBUG::2013-03-01 14:22:07,267::task::1151::TaskManager.Task::(prepare) Task=`95618a33-10c6-4db7-a61d-c40d49fd3305`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-267::DEBUG::2013-03-01 14:22:07,267::task::568::TaskManager.Task::(_updateState) Task=`95618a33-10c6-4db7-a61d-c40d49fd3305`::moving from state preparing -> state finished >Thread-267::DEBUG::2013-03-01 14:22:07,267::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-267::DEBUG::2013-03-01 14:22:07,267::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-267::DEBUG::2013-03-01 14:22:07,268::task::957::TaskManager.Task::(_decref) Task=`95618a33-10c6-4db7-a61d-c40d49fd3305`::ref 0 aborting False >Thread-268::DEBUG::2013-03-01 14:22:07,308::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-268::DEBUG::2013-03-01 14:22:07,308::task::568::TaskManager.Task::(_updateState) Task=`69f4ab64-2696-4fa7-ae4e-d51610b2712e`::moving from state init -> state preparing >Thread-268::INFO::2013-03-01 14:22:07,309::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-268::DEBUG::2013-03-01 14:22:07,309::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Dummy-195::DEBUG::2013-03-01 14:22:08,119::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:08,230::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473812 s, 21.6 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:08,469::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:10,250::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:10,324::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293685 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:22:12,337::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:12,416::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340613 s, 30.1 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:12,916::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:12,916::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:12,923::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:12,923::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:12,924::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:12,924::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:12,924::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:12,925::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-268::DEBUG::2013-03-01 14:22:12,925::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-268::DEBUG::2013-03-01 14:22:12,927::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-229::DEBUG::2013-03-01 14:22:12,927::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:12,928::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-268::DEBUG::2013-03-01 14:22:12,929::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:12,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-268::DEBUG::2013-03-01 14:22:12,962::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:12,962::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:12,969::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:13,151::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:13,153::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,153::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-229::DEBUG::2013-03-01 14:22:13,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:13,161::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000242134 s, 8.5 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:13,161::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000242134 s, 8.5 MB/s'], size: 2048 >Thread-229::DEBUG::2013-03-01 14:22:13,161::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-229::WARNING::2013-03-01 14:22:13,161::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-229::DEBUG::2013-03-01 14:22:13,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-229::DEBUG::2013-03-01 14:22:13,163::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,163::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,164::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,164::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,164::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:13,403::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:13,404::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,404::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', '_SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790', 'MASTER_VERSION=0'] >Thread-229::DEBUG::2013-03-01 14:22:13,405::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:22:13,406::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:13,453::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-151::DEBUG::2013-03-01 14:22:13,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:13,641::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::WARNING::2013-03-01 14:22:13,642::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_imageNS already registered >Thread-229::WARNING::2013-03-01 14:22:13,643::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_volumeNS already registered >Thread-229::WARNING::2013-03-01 14:22:13,643::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_lvmActivationNS already registered >Thread-232::INFO::2013-03-01 14:22:13,645::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-232::DEBUG::2013-03-01 14:22:13,646::task::1151::TaskManager.Task::(prepare) Task=`4c030378-f609-4a9c-9153-beba32006d86`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-232::DEBUG::2013-03-01 14:22:13,648::task::568::TaskManager.Task::(_updateState) Task=`4c030378-f609-4a9c-9153-beba32006d86`::moving from state preparing -> state finished >Thread-232::DEBUG::2013-03-01 14:22:13,649::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-229::DEBUG::2013-03-01 14:22:13,649::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-232::DEBUG::2013-03-01 14:22:13,651::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-232::DEBUG::2013-03-01 14:22:13,661::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-232::DEBUG::2013-03-01 14:22:13,662::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-232::DEBUG::2013-03-01 14:22:13,663::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-232::DEBUG::2013-03-01 14:22:13,663::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-232::DEBUG::2013-03-01 14:22:13,664::task::957::TaskManager.Task::(_decref) Task=`4c030378-f609-4a9c-9153-beba32006d86`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 14:22:13,673::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:22:13,675::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:22:13,675::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:13,682::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241144 s, 17.0 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:13,851::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:13,851::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:13,859::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0002727 s, 15.0 MB/s\n'; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:13,972::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:13,976::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:14,429::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:14,512::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372216 s, 27.5 MB/s\n'; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:14,980::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:15,985::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:16,526::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:21,736::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-271::DEBUG::2013-03-01 14:22:16,696::task::568::TaskManager.Task::(_updateState) Task=`e667f325-ef38-4fe8-bb1c-bfdc3b3366e7`::moving from state init -> state preparing >Thread-271::INFO::2013-03-01 14:22:21,741::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-271::INFO::2013-03-01 14:22:21,741::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00846695899963', 'lastCheck': '7.9', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00754308700562', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-271::DEBUG::2013-03-01 14:22:21,741::task::1151::TaskManager.Task::(prepare) Task=`e667f325-ef38-4fe8-bb1c-bfdc3b3366e7`::finished: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00846695899963', 'lastCheck': '7.9', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00754308700562', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-271::DEBUG::2013-03-01 14:22:21,741::task::568::TaskManager.Task::(_updateState) Task=`e667f325-ef38-4fe8-bb1c-bfdc3b3366e7`::moving from state preparing -> state finished >Thread-271::DEBUG::2013-03-01 14:22:21,741::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-271::DEBUG::2013-03-01 14:22:21,742::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-271::DEBUG::2013-03-01 14:22:21,742::task::957::TaskManager.Task::(_decref) Task=`e667f325-ef38-4fe8-bb1c-bfdc3b3366e7`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:22:21,811::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271264 s, 37.7 MB/s\n'; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:22,741::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:22,745::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-151::DEBUG::2013-03-01 14:22:23,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:23,698::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000322637 s, 12.7 MB/s\n'; <rc> = 0 >Thread-273::DEBUG::2013-03-01 14:22:23,706::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-273::DEBUG::2013-03-01 14:22:23,707::task::568::TaskManager.Task::(_updateState) Task=`8c2bb1e8-2e04-4bb1-904b-8135e53c57d8`::moving from state init -> state preparing >Thread-273::INFO::2013-03-01 14:22:23,708::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-273::INFO::2013-03-01 14:22:23,708::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-273::DEBUG::2013-03-01 14:22:23,708::task::1151::TaskManager.Task::(prepare) Task=`8c2bb1e8-2e04-4bb1-904b-8135e53c57d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-273::DEBUG::2013-03-01 14:22:23,709::task::568::TaskManager.Task::(_updateState) Task=`8c2bb1e8-2e04-4bb1-904b-8135e53c57d8`::moving from state preparing -> state finished >Thread-273::DEBUG::2013-03-01 14:22:23,709::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-273::DEBUG::2013-03-01 14:22:23,709::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-273::DEBUG::2013-03-01 14:22:23,709::task::957::TaskManager.Task::(_decref) Task=`8c2bb1e8-2e04-4bb1-904b-8135e53c57d8`::ref 0 aborting False >Thread-274::DEBUG::2013-03-01 14:22:23,739::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-274::DEBUG::2013-03-01 14:22:23,739::task::568::TaskManager.Task::(_updateState) Task=`a5fed555-6bd4-4c78-80fc-06366783a361`::moving from state init -> state preparing >Thread-274::INFO::2013-03-01 14:22:23,740::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-274::DEBUG::2013-03-01 14:22:23,740::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`66583f8b-47e3-4dc7-a091-4291973877c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-274::DEBUG::2013-03-01 14:22:23,741::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-274::DEBUG::2013-03-01 14:22:23,741::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-274::DEBUG::2013-03-01 14:22:23,741::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`66583f8b-47e3-4dc7-a091-4291973877c2`::Granted request >Thread-274::DEBUG::2013-03-01 14:22:23,742::task::794::TaskManager.Task::(resourceAcquired) Task=`a5fed555-6bd4-4c78-80fc-06366783a361`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-274::DEBUG::2013-03-01 14:22:23,742::task::957::TaskManager.Task::(_decref) Task=`a5fed555-6bd4-4c78-80fc-06366783a361`::ref 1 aborting False >Thread-274::INFO::2013-03-01 14:22:23,744::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-274::DEBUG::2013-03-01 14:22:23,744::task::1151::TaskManager.Task::(prepare) Task=`a5fed555-6bd4-4c78-80fc-06366783a361`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-274::DEBUG::2013-03-01 14:22:23,745::task::568::TaskManager.Task::(_updateState) Task=`a5fed555-6bd4-4c78-80fc-06366783a361`::moving from state preparing -> state finished >Thread-274::DEBUG::2013-03-01 14:22:23,745::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-274::DEBUG::2013-03-01 14:22:23,745::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-274::DEBUG::2013-03-01 14:22:23,745::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-274::DEBUG::2013-03-01 14:22:23,746::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-274::DEBUG::2013-03-01 14:22:23,746::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-274::DEBUG::2013-03-01 14:22:23,746::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-274::DEBUG::2013-03-01 14:22:23,747::task::957::TaskManager.Task::(_decref) Task=`a5fed555-6bd4-4c78-80fc-06366783a361`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:22:23,861::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:23,869::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000369563 s, 11.1 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:22:23,871::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:23,974::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548263 s, 18.7 MB/s\n'; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:24,749::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:25,993::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:26,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392274 s, 26.1 MB/s\n'; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:27,980::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:27,981::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,981::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,982::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,982::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,983::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,983::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,983::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-268::DEBUG::2013-03-01 14:22:27,984::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-268::DEBUG::2013-03-01 14:22:27,987::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:28,113::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:28,205::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413961 s, 24.7 MB/s\n'; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:28,234::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:28,234::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,235::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,240::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-0' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,250::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,254::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-1' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,258::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-2' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,265::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,268::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,272::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-4' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,278::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,282::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-5' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,285::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,289::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-6' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,292::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,296::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-7' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,299::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-8' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,306::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,310::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-9' (cwd None) >MainProcess|Thread-268::DEBUG::2013-03-01 14:22:28,313::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-268::DEBUG::2013-03-01 14:22:28,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a00047d /dev/mapper/3514f0c542a00047c /dev/mapper/3514f0c542a00048d /dev/mapper/3514f0c542a00048e /dev/mapper/3514f0c542a0004af /dev/mapper/3514f0c542a0004b0 /dev/mapper/3514f0c542a0004b1 /dev/mapper/3514f0c542a0004c2 /dev/mapper/3514f0c542a0004c3 /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-268::DEBUG::2013-03-01 14:22:28,594::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a00048d" of volume group "bf265c3d-3861-497d-88b8-523fb1f33269" without -ff\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004c2" of volume group "5dd04e7f-8474-4d0a-ae61-24f8fd2556de" without -ff\n Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004c3" of volume group "04bf19fa-db6c-4c8f-845f-b87411d8e898" without -ff\n'; <rc> = 5 >Thread-268::DEBUG::2013-03-01 14:22:28,597::lvm::809::Storage.LVM::(testPVCreate) rc: 5, out: [' Physical volume "/dev/mapper/3514f0c542a00047d" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00047c" successfully created', ' Physical volume "/dev/mapper/3514f0c542a00048e" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004af" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b0" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004b1" successfully created', ' Physical volume "/dev/mapper/3514f0c542a0004c4" successfully created'], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a00048d" of volume group "bf265c3d-3861-497d-88b8-523fb1f33269" without -ff', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004c2" of volume group "5dd04e7f-8474-4d0a-ae61-24f8fd2556de" without -ff', ' Can\'t initialize physical volume "/dev/mapper/3514f0c542a0004c3" of volume group "04bf19fa-db6c-4c8f-845f-b87411d8e898" without -ff'], unusedDevs: set(['/dev/mapper/3514f0c542a0004b0', '/dev/mapper/3514f0c542a0004b1', '/dev/mapper/3514f0c542a00048e', '/dev/mapper/3514f0c542a00047d', '/dev/mapper/3514f0c542a00047c', '/dev/mapper/3514f0c542a0004af', '/dev/mapper/3514f0c542a0004c4']), usedDevs: set(['/dev/mapper/3514f0c542a0004c3', '/dev/mapper/3514f0c542a0004c2', '/dev/mapper/3514f0c542a00048d']) >Thread-268::INFO::2013-03-01 14:22:28,600::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '38'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_7723745efa38428dbd0ceb0a1e7fcce6', 'GUID': '3514f0c542a00047d', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '21474836480', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '37'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_dd63542a8f454e9280ade8ee509a55dd', 'GUID': '3514f0c542a00047c', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'fwrev': '1.05', 'vgUUID': 'oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '39'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j', 'serial': 'SXtremIO_XtremApp_0f7d11d5e5ad4a7b8f97f591308efa8d', 'GUID': '3514f0c542a00048d', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '40'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_dca9feab8cc24243b7f6e14187925513', 'GUID': '3514f0c542a00048e', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '41'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_730ce2ad17314accb85a04521f5c86ad', 'GUID': '3514f0c542a0004af', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '42'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_afe467793e564a2da74785debfa27ead', 'GUID': '3514f0c542a0004b0', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '43'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_4e91dcfebfcb41ceb96af14c09bfe78b', 'GUID': '3514f0c542a0004b1', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '44'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '45'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'productID': 'XtremApp'}, {'status': 'free', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdk', 'type': 'iSCSI', 'state': 'active', 'lun': '46'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'productID': 'XtremApp'}]} >Thread-268::DEBUG::2013-03-01 14:22:28,600::task::1151::TaskManager.Task::(prepare) Task=`69f4ab64-2696-4fa7-ae4e-d51610b2712e`::finished: {'devList': [{'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_7723745efa38428dbd0ceb0a1e7fcce6', 'GUID': '3514f0c542a00047d', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdc', 'state': 'active', 'type': 'iSCSI', 'lun': '38'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_dd63542a8f454e9280ade8ee509a55dd', 'GUID': '3514f0c542a00047c', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '21474836480', 'pathstatus': [{'physdev': 'sdb', 'state': 'active', 'type': 'iSCSI', 'lun': '37'}], 'pvUUID': ''}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_0f7d11d5e5ad4a7b8f97f591308efa8d', 'GUID': '3514f0c542a00048d', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'pathstatus': [{'physdev': 'sdd', 'state': 'active', 'type': 'iSCSI', 'lun': '39'}], 'pvUUID': 'fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j'}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_dca9feab8cc24243b7f6e14187925513', 'GUID': '3514f0c542a00048e', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '32212254720', 'pathstatus': [{'physdev': 'sde', 'state': 'active', 'type': 'iSCSI', 'lun': '40'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_730ce2ad17314accb85a04521f5c86ad', 'GUID': '3514f0c542a0004af', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdf', 'state': 'active', 'type': 'iSCSI', 'lun': '41'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_afe467793e564a2da74785debfa27ead', 'GUID': '3514f0c542a0004b0', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdg', 'state': 'active', 'type': 'iSCSI', 'lun': '42'}], 'pvUUID': ''}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_4e91dcfebfcb41ceb96af14c09bfe78b', 'GUID': '3514f0c542a0004b1', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdh', 'state': 'active', 'type': 'iSCSI', 'lun': '43'}], 'pvUUID': ''}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_e0ce086be26e43858174a84d2344a094', 'GUID': '3514f0c542a0004c2', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdi', 'state': 'active', 'type': 'iSCSI', 'lun': '44'}], 'pvUUID': 'S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn'}, {'status': 'used', 'fwrev': '1.05', 'vgUUID': 'GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_5c23c2e3ef39480282e9c378e7422094', 'GUID': '3514f0c542a0004c3', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdj', 'state': 'active', 'type': 'iSCSI', 'lun': '45'}], 'pvUUID': 'nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo'}, {'status': 'free', 'fwrev': '1.05', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'productID': 'XtremApp', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdk', 'state': 'active', 'type': 'iSCSI', 'lun': '46'}], 'pvUUID': ''}]} >Thread-268::DEBUG::2013-03-01 14:22:28,601::task::568::TaskManager.Task::(_updateState) Task=`69f4ab64-2696-4fa7-ae4e-d51610b2712e`::moving from state preparing -> state finished >Thread-268::DEBUG::2013-03-01 14:22:28,601::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-268::DEBUG::2013-03-01 14:22:28,601::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-268::DEBUG::2013-03-01 14:22:28,602::task::957::TaskManager.Task::(_decref) Task=`69f4ab64-2696-4fa7-ae4e-d51610b2712e`::ref 0 aborting False >Thread-277::DEBUG::2013-03-01 14:22:28,725::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-277::DEBUG::2013-03-01 14:22:28,726::task::568::TaskManager.Task::(_updateState) Task=`8693eae8-ed04-4e90-bb5a-764d86ffce04`::moving from state init -> state preparing >Thread-277::INFO::2013-03-01 14:22:28,726::logUtils::37::dispatcher::(wrapper) Run and protect: createVG(vgname='46a88efb-817e-49ba-b498-4fae08c6e657', devlist=['3514f0c542a0004c4'], force=False, options=None) >Thread-277::DEBUG::2013-03-01 14:22:28,730::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-277::DEBUG::2013-03-01 14:22:28,904::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-277::DEBUG::2013-03-01 14:22:28,905::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:28,905::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:28,906::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-277::DEBUG::2013-03-01 14:22:29,156::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-277::DEBUG::2013-03-01 14:22:29,157::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 46a88efb-817e-49ba-b498-4fae08c6e657 /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-277::DEBUG::2013-03-01 14:22:29,583::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-277::DEBUG::2013-03-01 14:22:29,584::lvm::476::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:29,585::lvm::479::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:29,585::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:29,585::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:29,586::lvm::880::Storage.LVM::(createVG) Cache after createvg {'46a88efb-817e-49ba-b498-4fae08c6e657': Stub(name='46a88efb-817e-49ba-b498-4fae08c6e657', stale=True)} >Thread-277::DEBUG::2013-03-01 14:22:29,586::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-277::DEBUG::2013-03-01 14:22:29,587::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-277::DEBUG::2013-03-01 14:22:29,848::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-277::DEBUG::2013-03-01 14:22:29,850::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-277::INFO::2013-03-01 14:22:29,850::logUtils::39::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI'} >Thread-277::DEBUG::2013-03-01 14:22:29,850::task::1151::TaskManager.Task::(prepare) Task=`8693eae8-ed04-4e90-bb5a-764d86ffce04`::finished: {'uuid': 'gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI'} >Thread-277::DEBUG::2013-03-01 14:22:29,850::task::568::TaskManager.Task::(_updateState) Task=`8693eae8-ed04-4e90-bb5a-764d86ffce04`::moving from state preparing -> state finished >Thread-277::DEBUG::2013-03-01 14:22:29,851::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-277::DEBUG::2013-03-01 14:22:29,851::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-277::DEBUG::2013-03-01 14:22:29,851::task::957::TaskManager.Task::(_decref) Task=`8693eae8-ed04-4e90-bb5a-764d86ffce04`::ref 0 aborting False >Thread-278::DEBUG::2013-03-01 14:22:29,888::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-278::DEBUG::2013-03-01 14:22:29,888::task::568::TaskManager.Task::(_updateState) Task=`c3a16eea-836b-4f6a-90be-e4474b89749d`::moving from state init -> state preparing >Thread-278::INFO::2013-03-01 14:22:29,889::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='46a88efb-817e-49ba-b498-4fae08c6e657', domainName='ImpExp_iscsi', typeSpecificArg='gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', domClass=3, domVersion='0', options=None) >Thread-278::INFO::2013-03-01 14:22:29,949::blockSD::459::Storage.StorageDomain::(create) sdUUID=46a88efb-817e-49ba-b498-4fae08c6e657 domainName=ImpExp_iscsi domClass=3 vgUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI storageType=3 version=0 >Thread-278::DEBUG::2013-03-01 14:22:29,949::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:29,950::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:30,223::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:30,231::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:30,239::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:30,241::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:30,249::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:30,333::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0621497 s, 16.5 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:30,451::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:30,451::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:30,452::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:30,452::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3514f0c542a0004c4' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:30,665::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:30,666::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-278::INFO::2013-03-01 14:22:30,667::blockSD::444::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-278::DEBUG::2013-03-01 14:22:30,667::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:32,346::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:32,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470713 s, 21.8 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:32,606::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:32,607::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:32,607::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:32,608::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:32,608::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:32,609::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:32,610::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:32,873::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:32,876::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-278::INFO::2013-03-01 14:22:32,876::blockSD::630::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/3514f0c542a0004c4'] >Thread-278::DEBUG::2013-03-01 14:22:32,877::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:33,704::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:33,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000334284 s, 12.3 MB/s\n'; <rc> = 0 >Thread-303::DEBUG::2013-03-01 14:22:33,788::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-303::DEBUG::2013-03-01 14:22:33,789::task::568::TaskManager.Task::(_updateState) Task=`6f20ec9f-f9cf-4b7f-afbf-ee4b3d955782`::moving from state init -> state preparing >Thread-303::INFO::2013-03-01 14:22:33,789::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-303::INFO::2013-03-01 14:22:33,789::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-303::DEBUG::2013-03-01 14:22:33,790::task::1151::TaskManager.Task::(prepare) Task=`6f20ec9f-f9cf-4b7f-afbf-ee4b3d955782`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-303::DEBUG::2013-03-01 14:22:33,790::task::568::TaskManager.Task::(_updateState) Task=`6f20ec9f-f9cf-4b7f-afbf-ee4b3d955782`::moving from state preparing -> state finished >Thread-303::DEBUG::2013-03-01 14:22:33,790::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-303::DEBUG::2013-03-01 14:22:33,790::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-303::DEBUG::2013-03-01 14:22:33,791::task::957::TaskManager.Task::(_decref) Task=`6f20ec9f-f9cf-4b7f-afbf-ee4b3d955782`::ref 0 aborting False >Thread-304::DEBUG::2013-03-01 14:22:33,817::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-304::DEBUG::2013-03-01 14:22:33,817::task::568::TaskManager.Task::(_updateState) Task=`e0724cc9-59a3-4897-9738-4d678ed9c78a`::moving from state init -> state preparing >Thread-304::INFO::2013-03-01 14:22:33,817::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-304::DEBUG::2013-03-01 14:22:33,818::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b7c4593d-ec74-4f1d-93c8-a021dd94b00a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-304::DEBUG::2013-03-01 14:22:33,818::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-304::DEBUG::2013-03-01 14:22:33,819::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-304::DEBUG::2013-03-01 14:22:33,819::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b7c4593d-ec74-4f1d-93c8-a021dd94b00a`::Granted request >Thread-304::DEBUG::2013-03-01 14:22:33,820::task::794::TaskManager.Task::(resourceAcquired) Task=`e0724cc9-59a3-4897-9738-4d678ed9c78a`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-304::DEBUG::2013-03-01 14:22:33,820::task::957::TaskManager.Task::(_decref) Task=`e0724cc9-59a3-4897-9738-4d678ed9c78a`::ref 1 aborting False >Thread-304::INFO::2013-03-01 14:22:33,821::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-304::DEBUG::2013-03-01 14:22:33,822::task::1151::TaskManager.Task::(prepare) Task=`e0724cc9-59a3-4897-9738-4d678ed9c78a`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-304::DEBUG::2013-03-01 14:22:33,822::task::568::TaskManager.Task::(_updateState) Task=`e0724cc9-59a3-4897-9738-4d678ed9c78a`::moving from state preparing -> state finished >Thread-304::DEBUG::2013-03-01 14:22:33,822::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-304::DEBUG::2013-03-01 14:22:33,823::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-304::DEBUG::2013-03-01 14:22:33,823::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-304::DEBUG::2013-03-01 14:22:33,824::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-304::DEBUG::2013-03-01 14:22:33,824::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-304::DEBUG::2013-03-01 14:22:33,824::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-304::DEBUG::2013-03-01 14:22:33,825::task::957::TaskManager.Task::(_decref) Task=`e0724cc9-59a3-4897-9738-4d678ed9c78a`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:22:33,871::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:33,880::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000335012 s, 12.2 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:22:34,474::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:34,563::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0446496 s, 22.9 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:34,806::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:34,819::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:34,819::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:34,820::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:34,820::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:34,820::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/46a88efb-817e-49ba-b498-4fae08c6e657/leases' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:34,836::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:34,837::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:36,576::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:36,656::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278725 s, 36.7 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:36,720::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:36,721::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:36,721::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:36,721::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:36,722::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:36,722::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/46a88efb-817e-49ba-b498-4fae08c6e657/ids' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:36,739::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:36,740::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-306::DEBUG::2013-03-01 14:22:37,043::task::568::TaskManager.Task::(_updateState) Task=`4b689d23-94d7-40f2-b3cf-58db8950eb1f`::moving from state init -> state preparing >Thread-306::INFO::2013-03-01 14:22:37,043::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-306::INFO::2013-03-01 14:22:37,044::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00944113731384', 'lastCheck': '3.2', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00981712341309', 'lastCheck': '3.3', 'code': 0, 'valid': True}} >Thread-306::DEBUG::2013-03-01 14:22:37,044::task::1151::TaskManager.Task::(prepare) Task=`4b689d23-94d7-40f2-b3cf-58db8950eb1f`::finished: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00944113731384', 'lastCheck': '3.2', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00981712341309', 'lastCheck': '3.3', 'code': 0, 'valid': True}} >Thread-306::DEBUG::2013-03-01 14:22:37,044::task::568::TaskManager.Task::(_updateState) Task=`4b689d23-94d7-40f2-b3cf-58db8950eb1f`::moving from state preparing -> state finished >Thread-306::DEBUG::2013-03-01 14:22:37,044::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2013-03-01 14:22:37,045::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2013-03-01 14:22:37,045::task::957::TaskManager.Task::(_decref) Task=`4b689d23-94d7-40f2-b3cf-58db8950eb1f`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:22:38,675::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:38,772::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:38,774::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:38,776::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:38,777::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:38,779::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:38,785::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:38,800::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434357 s, 23.6 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:40,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:40,771::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:40,771::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:40,771::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:40,772::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:40,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:40,819::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:40,895::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339389 s, 30.2 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:42,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:42,821::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:42,821::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:42,822::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:42,822::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:42,823::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:42,839::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:42,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:42,909::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:43,005::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:43,045::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0756 s, 13.5 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,224::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,225::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:43,225::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:43,225::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:43,361::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.127269 s, 330 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,362::misc::344::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.127269 s, 330 MB/s'], size: 41943040 >Thread-278::DEBUG::2013-03-01 14:22:43,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:43,375::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00416653 s, 246 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,375::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00416653 s, 246 MB/s'], size: 1024000 >Thread-278::DEBUG::2013-03-01 14:22:43,376::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:43,389::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00439376 s, 233 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,390::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00439376 s, 233 MB/s'], size: 1024000 >Thread-278::DEBUG::2013-03-01 14:22:43,390::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-278::DEBUG::2013-03-01 14:22:43,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:43,399::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000320635 s, 6.4 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,400::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000320635 s, 6.4 MB/s'], size: 2048 >Thread-278::DEBUG::2013-03-01 14:22:43,400::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-278::WARNING::2013-03-01 14:22:43,400::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-278::DEBUG::2013-03-01 14:22:43,401::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-278::DEBUG::2013-03-01 14:22:43,401::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-278::DEBUG::2013-03-01 14:22:43,401::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=bdea9676f545c2ae7ff38e0589292e1ba6442821'] >Thread-278::DEBUG::2013-03-01 14:22:43,403::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-278::DEBUG::2013-03-01 14:22:43,404::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:43,719::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:43,728::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304027 s, 13.5 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,789::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,790::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:43,790::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:43,790::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-278::DEBUG::2013-03-01 14:22:43,791::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-278::DEBUG::2013-03-01 14:22:43,800::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000334278 s, 6.1 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:43,801::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000334278 s, 6.1 MB/s'], size: 2048 >Thread-278::DEBUG::2013-03-01 14:22:43,801::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=bdea9676f545c2ae7ff38e0589292e1ba6442821'] >Thread-278::DEBUG::2013-03-01 14:22:43,803::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-310::DEBUG::2013-03-01 14:22:43,867::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-310::DEBUG::2013-03-01 14:22:43,868::task::568::TaskManager.Task::(_updateState) Task=`a3b99d71-619a-4004-99c5-77e2984350e8`::moving from state init -> state preparing >Thread-310::INFO::2013-03-01 14:22:43,868::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-310::INFO::2013-03-01 14:22:43,869::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-310::DEBUG::2013-03-01 14:22:43,869::task::1151::TaskManager.Task::(prepare) Task=`a3b99d71-619a-4004-99c5-77e2984350e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-310::DEBUG::2013-03-01 14:22:43,869::task::568::TaskManager.Task::(_updateState) Task=`a3b99d71-619a-4004-99c5-77e2984350e8`::moving from state preparing -> state finished >Thread-310::DEBUG::2013-03-01 14:22:43,870::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-310::DEBUG::2013-03-01 14:22:43,870::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2013-03-01 14:22:43,870::task::957::TaskManager.Task::(_decref) Task=`a3b99d71-619a-4004-99c5-77e2984350e8`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:22:43,882::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:43,891::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000458997 s, 8.9 MB/s\n'; <rc> = 0 >Thread-311::DEBUG::2013-03-01 14:22:44,018::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-311::DEBUG::2013-03-01 14:22:44,019::task::568::TaskManager.Task::(_updateState) Task=`235998ab-4763-48a7-a67e-ac4cfe3d4b94`::moving from state init -> state preparing >Thread-311::INFO::2013-03-01 14:22:44,020::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-311::DEBUG::2013-03-01 14:22:44,020::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`5db40882-bd03-458d-b0f1-76286f8bc224`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-311::DEBUG::2013-03-01 14:22:44,020::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-311::DEBUG::2013-03-01 14:22:44,021::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-311::DEBUG::2013-03-01 14:22:44,021::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`5db40882-bd03-458d-b0f1-76286f8bc224`::Granted request >Thread-311::DEBUG::2013-03-01 14:22:44,022::task::794::TaskManager.Task::(resourceAcquired) Task=`235998ab-4763-48a7-a67e-ac4cfe3d4b94`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-311::DEBUG::2013-03-01 14:22:44,022::task::957::TaskManager.Task::(_decref) Task=`235998ab-4763-48a7-a67e-ac4cfe3d4b94`::ref 1 aborting False >Thread-311::INFO::2013-03-01 14:22:44,024::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-311::DEBUG::2013-03-01 14:22:44,024::task::1151::TaskManager.Task::(prepare) Task=`235998ab-4763-48a7-a67e-ac4cfe3d4b94`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-311::DEBUG::2013-03-01 14:22:44,024::task::568::TaskManager.Task::(_updateState) Task=`235998ab-4763-48a7-a67e-ac4cfe3d4b94`::moving from state preparing -> state finished >Thread-311::DEBUG::2013-03-01 14:22:44,024::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-311::DEBUG::2013-03-01 14:22:44,024::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-311::DEBUG::2013-03-01 14:22:44,025::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-311::DEBUG::2013-03-01 14:22:44,025::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-311::DEBUG::2013-03-01 14:22:44,025::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-311::DEBUG::2013-03-01 14:22:44,025::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-311::DEBUG::2013-03-01 14:22:44,026::task::957::TaskManager.Task::(_decref) Task=`235998ab-4763-48a7-a67e-ac4cfe3d4b94`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:22:45,059::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:45,150::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472258 s, 21.7 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:45,808::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:45,809::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:45,809::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2013-03-01 14:22:45,810::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '46a88efb-817e-49ba-b498-4fae08c6e657_imageNS' >Thread-278::DEBUG::2013-03-01 14:22:45,810::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '46a88efb-817e-49ba-b498-4fae08c6e657_volumeNS' >Thread-278::DEBUG::2013-03-01 14:22:45,811::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '46a88efb-817e-49ba-b498-4fae08c6e657_lvmActivationNS' >Thread-278::DEBUG::2013-03-01 14:22:45,811::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /dev/46a88efb-817e-49ba-b498-4fae08c6e657/leases 0' (cwd /usr/libexec/vdsm) >Thread-278::DEBUG::2013-03-01 14:22:45,864::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2013-03-01 14:22:45,865::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-278::INFO::2013-03-01 14:22:45,865::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-278::DEBUG::2013-03-01 14:22:45,865::task::1151::TaskManager.Task::(prepare) Task=`c3a16eea-836b-4f6a-90be-e4474b89749d`::finished: None >Thread-278::DEBUG::2013-03-01 14:22:45,866::task::568::TaskManager.Task::(_updateState) Task=`c3a16eea-836b-4f6a-90be-e4474b89749d`::moving from state preparing -> state finished >Thread-278::DEBUG::2013-03-01 14:22:45,866::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-278::DEBUG::2013-03-01 14:22:45,866::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-278::DEBUG::2013-03-01 14:22:45,867::task::957::TaskManager.Task::(_decref) Task=`c3a16eea-836b-4f6a-90be-e4474b89749d`::ref 0 aborting False >Thread-312::DEBUG::2013-03-01 14:22:45,898::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-312::DEBUG::2013-03-01 14:22:45,899::task::568::TaskManager.Task::(_updateState) Task=`20b67454-64ac-4724-b540-790caa33eb87`::moving from state init -> state preparing >Thread-312::INFO::2013-03-01 14:22:45,899::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='46a88efb-817e-49ba-b498-4fae08c6e657', options=None) >Thread-312::DEBUG::2013-03-01 14:22:45,900::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`914f0d45-6937-4364-958f-46b5a21f29a0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-312::DEBUG::2013-03-01 14:22:45,900::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' for lock type 'shared' >Thread-312::DEBUG::2013-03-01 14:22:45,900::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free. Now locking as 'shared' (1 active user) >Thread-312::DEBUG::2013-03-01 14:22:45,901::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`914f0d45-6937-4364-958f-46b5a21f29a0`::Granted request >Thread-312::DEBUG::2013-03-01 14:22:45,901::task::794::TaskManager.Task::(resourceAcquired) Task=`20b67454-64ac-4724-b540-790caa33eb87`::_resourcesAcquired: Storage.46a88efb-817e-49ba-b498-4fae08c6e657 (shared) >Thread-312::DEBUG::2013-03-01 14:22:45,902::task::957::TaskManager.Task::(_decref) Task=`20b67454-64ac-4724-b540-790caa33eb87`::ref 1 aborting False >Thread-312::DEBUG::2013-03-01 14:22:45,903::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-312::DEBUG::2013-03-01 14:22:45,904::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-312::DEBUG::2013-03-01 14:22:45,904::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-312::DEBUG::2013-03-01 14:22:45,904::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-312::DEBUG::2013-03-01 14:22:45,905::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-312::DEBUG::2013-03-01 14:22:45,905::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-312::DEBUG::2013-03-01 14:22:45,913::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000340905 s, 6.0 MB/s\n'; <rc> = 0 >Thread-312::DEBUG::2013-03-01 14:22:45,913::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000340905 s, 6.0 MB/s'], size: 2048 >Thread-312::DEBUG::2013-03-01 14:22:45,914::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=bdea9676f545c2ae7ff38e0589292e1ba6442821'] >Thread-312::DEBUG::2013-03-01 14:22:45,914::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-312::DEBUG::2013-03-01 14:22:45,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-312::DEBUG::2013-03-01 14:22:46,174::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-312::DEBUG::2013-03-01 14:22:46,176::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-312::INFO::2013-03-01 14:22:46,177::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67105280'}} >Thread-312::DEBUG::2013-03-01 14:22:46,177::task::1151::TaskManager.Task::(prepare) Task=`20b67454-64ac-4724-b540-790caa33eb87`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '49123688448', 'disktotal': '53284438016', 'mdafree': '67105280'}} >Thread-312::DEBUG::2013-03-01 14:22:46,177::task::568::TaskManager.Task::(_updateState) Task=`20b67454-64ac-4724-b540-790caa33eb87`::moving from state preparing -> state finished >Thread-312::DEBUG::2013-03-01 14:22:46,178::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.46a88efb-817e-49ba-b498-4fae08c6e657': < ResourceRef 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', isValid: 'True' obj: 'None'>} >Thread-312::DEBUG::2013-03-01 14:22:46,178::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-312::DEBUG::2013-03-01 14:22:46,178::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' >Thread-312::DEBUG::2013-03-01 14:22:46,179::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' (0 active users) >Thread-312::DEBUG::2013-03-01 14:22:46,179::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free, finding out if anyone is waiting for it. >Thread-312::DEBUG::2013-03-01 14:22:46,179::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', Clearing records. >Thread-312::DEBUG::2013-03-01 14:22:46,180::task::957::TaskManager.Task::(_decref) Task=`20b67454-64ac-4724-b540-790caa33eb87`::ref 0 aborting False >Thread-313::DEBUG::2013-03-01 14:22:46,230::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-313::DEBUG::2013-03-01 14:22:46,231::task::568::TaskManager.Task::(_updateState) Task=`eb59982c-29cb-426c-aa70-d6cde8483de7`::moving from state init -> state preparing >Thread-313::INFO::2013-03-01 14:22:46,231::logUtils::37::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', options=None) >MainProcess|Thread-313::DEBUG::2013-03-01 14:22:46,233::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-313::DEBUG::2013-03-01 14:22:46,238::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-313::DEBUG::2013-03-01 14:22:46,245::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-9' (cwd None) >MainProcess|Thread-313::DEBUG::2013-03-01 14:22:46,249::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-313::INFO::2013-03-01 14:22:46,253::logUtils::39::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '46a88efb-817e-49ba-b498-4fae08c6e657', 'vgfree': '49123688448', 'vgUUID': 'gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdk', 'state': 'active', 'type': 'iSCSI', 'lun': '46'}], 'devtype': 'iSCSI', 'pvUUID': '73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-313::DEBUG::2013-03-01 14:22:46,253::task::1151::TaskManager.Task::(prepare) Task=`eb59982c-29cb-426c-aa70-d6cde8483de7`::finished: {'info': {'state': 'OK', 'vgsize': '53284438016', 'name': '46a88efb-817e-49ba-b498-4fae08c6e657', 'vgfree': '49123688448', 'vgUUID': 'gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', 'pvlist': [{'vendorID': 'XtremIO', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', 'pathlist': [{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdk', 'state': 'active', 'type': 'iSCSI', 'lun': '46'}], 'devtype': 'iSCSI', 'pvUUID': '73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib', 'serial': 'SXtremIO_XtremApp_995a61da76074b6d94df0ff857b88b18', 'GUID': '3514f0c542a0004c4', 'devcapacity': '53687091200', 'productID': 'XtremApp'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-313::DEBUG::2013-03-01 14:22:46,254::task::568::TaskManager.Task::(_updateState) Task=`eb59982c-29cb-426c-aa70-d6cde8483de7`::moving from state preparing -> state finished >Thread-313::DEBUG::2013-03-01 14:22:46,254::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-313::DEBUG::2013-03-01 14:22:46,254::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-313::DEBUG::2013-03-01 14:22:46,255::task::957::TaskManager.Task::(_decref) Task=`eb59982c-29cb-426c-aa70-d6cde8483de7`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:22:47,164::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:47,274::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472882 s, 21.7 MB/s\n'; <rc> = 0 >Thread-315::DEBUG::2013-03-01 14:22:47,686::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-315::DEBUG::2013-03-01 14:22:47,687::task::568::TaskManager.Task::(_updateState) Task=`3fbb4409-857e-46a8-91e3-e6fd43a4bb36`::moving from state init -> state preparing >Thread-315::INFO::2013-03-01 14:22:47,687::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7', 'port': '3260'}], options=None) >Thread-315::DEBUG::2013-03-01 14:22:47,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-315::DEBUG::2013-03-01 14:22:47,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-315::DEBUG::2013-03-01 14:22:47,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-315::DEBUG::2013-03-01 14:22:47,730::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-315::DEBUG::2013-03-01 14:22:47,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-315::DEBUG::2013-03-01 14:22:47,747::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-315::INFO::2013-03-01 14:22:47,748::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-315::DEBUG::2013-03-01 14:22:47,749::task::1151::TaskManager.Task::(prepare) Task=`3fbb4409-857e-46a8-91e3-e6fd43a4bb36`::finished: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-315::DEBUG::2013-03-01 14:22:47,749::task::568::TaskManager.Task::(_updateState) Task=`3fbb4409-857e-46a8-91e3-e6fd43a4bb36`::moving from state preparing -> state finished >Thread-315::DEBUG::2013-03-01 14:22:47,749::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-315::DEBUG::2013-03-01 14:22:47,749::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-315::DEBUG::2013-03-01 14:22:47,750::task::957::TaskManager.Task::(_decref) Task=`3fbb4409-857e-46a8-91e3-e6fd43a4bb36`::ref 0 aborting False >Thread-316::DEBUG::2013-03-01 14:22:47,782::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-316::DEBUG::2013-03-01 14:22:47,783::task::568::TaskManager.Task::(_updateState) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::moving from state init -> state preparing >Thread-316::INFO::2013-03-01 14:22:47,783::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='46a88efb-817e-49ba-b498-4fae08c6e657', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-316::DEBUG::2013-03-01 14:22:47,784::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`f9e7c3c1-b14c-485e-aa3f-1c90e1e54706`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-316::DEBUG::2013-03-01 14:22:47,784::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-316::DEBUG::2013-03-01 14:22:47,785::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-316::DEBUG::2013-03-01 14:22:47,785::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`f9e7c3c1-b14c-485e-aa3f-1c90e1e54706`::Granted request >Thread-316::DEBUG::2013-03-01 14:22:47,785::task::794::TaskManager.Task::(resourceAcquired) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-316::DEBUG::2013-03-01 14:22:47,786::task::957::TaskManager.Task::(_decref) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::ref 1 aborting False >Thread-316::DEBUG::2013-03-01 14:22:47,786::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`38692a8d-4ef0-4492-9f02-803cd0c7de5d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-316::DEBUG::2013-03-01 14:22:47,786::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' for lock type 'exclusive' >Thread-316::DEBUG::2013-03-01 14:22:47,787::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free. Now locking as 'exclusive' (1 active user) >Thread-316::DEBUG::2013-03-01 14:22:47,787::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`38692a8d-4ef0-4492-9f02-803cd0c7de5d`::Granted request >Thread-316::DEBUG::2013-03-01 14:22:47,788::task::794::TaskManager.Task::(resourceAcquired) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::_resourcesAcquired: Storage.46a88efb-817e-49ba-b498-4fae08c6e657 (exclusive) >Thread-316::DEBUG::2013-03-01 14:22:47,788::task::957::TaskManager.Task::(_decref) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::ref 1 aborting False >Thread-316::INFO::2013-03-01 14:22:47,788::sp::918::Storage.StoragePool::(attachSD) sdUUID=46a88efb-817e-49ba-b498-4fae08c6e657 spUUID=8fd46635-c46a-47a7-b122-316b2df29251 >Thread-316::DEBUG::2013-03-01 14:22:47,789::clusterlock::81::SafeLease::(acquireHostId) Host id for domain 46a88efb-817e-49ba-b498-4fae08c6e657 successfully acquired (id: 1) >Thread-316::WARNING::2013-03-01 14:22:47,789::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/images already exists >Thread-316::WARNING::2013-03-01 14:22:47,790::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/dom_md already exists >Thread-316::DEBUG::2013-03-01 14:22:47,791::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:47,791::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:47,791::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:47,792::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:47,792::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-316::DEBUG::2013-03-01 14:22:47,792::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-316::DEBUG::2013-03-01 14:22:47,801::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000322905 s, 6.3 MB/s\n'; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:47,802::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000322905 s, 6.3 MB/s'], size: 2048 >Thread-316::DEBUG::2013-03-01 14:22:47,802::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=bdea9676f545c2ae7ff38e0589292e1ba6442821'] >Thread-316::DEBUG::2013-03-01 14:22:47,803::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain 46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-316::DEBUG::2013-03-01 14:22:47,804::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 46a88efb-817e-49ba-b498-4fae08c6e657 1 5 /dev/46a88efb-817e-49ba-b498-4fae08c6e657/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Dummy-195::DEBUG::2013-03-01 14:22:49,288::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:49,397::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383517 s, 26.7 MB/s\n'; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:49,884::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:49,884::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-316::DEBUG::2013-03-01 14:22:49,885::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-316::DEBUG::2013-03-01 14:22:49,894::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000407423 s, 5.0 MB/s\n'; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:49,895::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000407423 s, 5.0 MB/s'], size: 2048 >Thread-316::DEBUG::2013-03-01 14:22:49,895::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=bdea9676f545c2ae7ff38e0589292e1ba6442821'] >Thread-316::DEBUG::2013-03-01 14:22:49,896::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-316::DEBUG::2013-03-01 14:22:49,896::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-316::DEBUG::2013-03-01 14:22:49,897::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=b4170ea872cef8ab4cb88d73f0f5b35aeb9e117f'] >Thread-316::DEBUG::2013-03-01 14:22:49,898::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-316::DEBUG::2013-03-01 14:22:49,898::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-316::DEBUG::2013-03-01 14:22:49,899::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-316::DEBUG::2013-03-01 14:22:49,899::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=275e73d2ff907b9237981b6cfb1ce5ca0a45eec8'] >Thread-316::DEBUG::2013-03-01 14:22:49,900::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:49,900::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:49,900::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:49,901::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:49,901::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:49,902::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-316::DEBUG::2013-03-01 14:22:50,108::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:50,110::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:50,110::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Attached&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=275e73d2ff907b9237981b6cfb1ce5ca0a45eec8 removing=MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e >Thread-316::DEBUG::2013-03-01 14:22:50,112::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_DOMAINS=04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --deltag MDT__SHA_CKSUM=275609a4e6deacbe01f7408199a75872b98f559e --addtag MDT__SHA_CKSUM=275e73d2ff907b9237981b6cfb1ce5ca0a45eec8 --addtag MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Attached&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-316::DEBUG::2013-03-01 14:22:50,424::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:50,424::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:50,425::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2013-03-01 14:22:50,425::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-316::WARNING::2013-03-01 14:22:50,426::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/images already exists >Thread-316::WARNING::2013-03-01 14:22:50,426::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/dom_md already exists >Thread-316::INFO::2013-03-01 14:22:50,427::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-316::DEBUG::2013-03-01 14:22:50,427::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-316::DEBUG::2013-03-01 14:22:50,428::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-316::DEBUG::2013-03-01 14:22:50,428::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-316::DEBUG::2013-03-01 14:22:50,428::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-316::DEBUG::2013-03-01 14:22:50,429::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=0', 'PHYBLKSIZE=4096', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=9150cd0205e3d12ae60fcb652778b25da8168a37'] >Thread-316::DEBUG::2013-03-01 14:22:50,430::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-316::INFO::2013-03-01 14:22:50,430::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain 46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-316::DEBUG::2013-03-01 14:22:50,431::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd /usr/libexec/vdsm) >Dummy-195::DEBUG::2013-03-01 14:22:51,416::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:51,517::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414011 s, 24.7 MB/s\n'; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:51,554::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-316::DEBUG::2013-03-01 14:22:51,554::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-316::DEBUG::2013-03-01 14:22:51,555::clusterlock::85::SafeLease::(releaseHostId) Host id for domain 46a88efb-817e-49ba-b498-4fae08c6e657 released successfully (id: 1) >Thread-316::DEBUG::2013-03-01 14:22:51,555::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-316::DEBUG::2013-03-01 14:22:51,555::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-316::DEBUG::2013-03-01 14:22:51,556::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-316::INFO::2013-03-01 14:22:51,556::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-316::DEBUG::2013-03-01 14:22:51,557::task::1151::TaskManager.Task::(prepare) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::finished: None >Thread-316::DEBUG::2013-03-01 14:22:51,557::task::568::TaskManager.Task::(_updateState) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::moving from state preparing -> state finished >Thread-316::DEBUG::2013-03-01 14:22:51,557::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657': < ResourceRef 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', isValid: 'True' obj: 'None'>} >Thread-316::DEBUG::2013-03-01 14:22:51,558::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2013-03-01 14:22:51,558::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-316::DEBUG::2013-03-01 14:22:51,558::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-316::DEBUG::2013-03-01 14:22:51,559::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-316::DEBUG::2013-03-01 14:22:51,559::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-316::DEBUG::2013-03-01 14:22:51,559::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' >Thread-316::DEBUG::2013-03-01 14:22:51,560::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' (0 active users) >Thread-316::DEBUG::2013-03-01 14:22:51,560::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free, finding out if anyone is waiting for it. >Thread-316::DEBUG::2013-03-01 14:22:51,560::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', Clearing records. >Thread-316::DEBUG::2013-03-01 14:22:51,561::task::957::TaskManager.Task::(_decref) Task=`2e1b966f-a833-402b-87f1-f37f9cd913e2`::ref 0 aborting False >Thread-318::DEBUG::2013-03-01 14:22:52,433::task::568::TaskManager.Task::(_updateState) Task=`a1d89397-8b71-4f9e-974f-a73f53e6df70`::moving from state init -> state preparing >Thread-318::INFO::2013-03-01 14:22:52,433::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-318::INFO::2013-03-01 14:22:52,434::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00957107543945', 'lastCheck': '8.5', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0212259292603', 'lastCheck': '8.7', 'code': 0, 'valid': True}} >Thread-318::DEBUG::2013-03-01 14:22:52,434::task::1151::TaskManager.Task::(prepare) Task=`a1d89397-8b71-4f9e-974f-a73f53e6df70`::finished: {'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00957107543945', 'lastCheck': '8.5', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0212259292603', 'lastCheck': '8.7', 'code': 0, 'valid': True}} >Thread-318::DEBUG::2013-03-01 14:22:52,434::task::568::TaskManager.Task::(_updateState) Task=`a1d89397-8b71-4f9e-974f-a73f53e6df70`::moving from state preparing -> state finished >Thread-318::DEBUG::2013-03-01 14:22:52,435::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-318::DEBUG::2013-03-01 14:22:52,435::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-318::DEBUG::2013-03-01 14:22:52,435::task::957::TaskManager.Task::(_decref) Task=`a1d89397-8b71-4f9e-974f-a73f53e6df70`::ref 0 aborting False >Thread-320::DEBUG::2013-03-01 14:22:53,197::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-320::DEBUG::2013-03-01 14:22:53,198::task::568::TaskManager.Task::(_updateState) Task=`9ef59da8-5aca-49be-bef0-76a2c6c2bc86`::moving from state init -> state preparing >Thread-320::INFO::2013-03-01 14:22:53,198::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='8fd46635-c46a-47a7-b122-316b2df29251', conList=[{'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'user': '', 'password': '******', 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7', 'port': '3260'}], options=None) >Thread-320::DEBUG::2013-03-01 14:22:53,199::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 --op=new' (cwd None) >Thread-320::DEBUG::2013-03-01 14:22:53,218::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-320::DEBUG::2013-03-01 14:22:53,219::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -l' (cwd None) >Thread-320::DEBUG::2013-03-01 14:22:53,237::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-320::DEBUG::2013-03-01 14:22:53,238::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2008-05.com.xtremio:001e675b8ee0 -I default -p 10.35.160.7:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-320::DEBUG::2013-03-01 14:22:53,255::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-320::INFO::2013-03-01 14:22:53,256::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-320::DEBUG::2013-03-01 14:22:53,256::task::1151::TaskManager.Task::(prepare) Task=`9ef59da8-5aca-49be-bef0-76a2c6c2bc86`::finished: {'statuslist': [{'status': 0, 'id': '4172801a-207e-4884-9b42-8c7fad1bf0d7'}]} >Thread-320::DEBUG::2013-03-01 14:22:53,257::task::568::TaskManager.Task::(_updateState) Task=`9ef59da8-5aca-49be-bef0-76a2c6c2bc86`::moving from state preparing -> state finished >Thread-320::DEBUG::2013-03-01 14:22:53,257::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-320::DEBUG::2013-03-01 14:22:53,257::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-320::DEBUG::2013-03-01 14:22:53,258::task::957::TaskManager.Task::(_decref) Task=`9ef59da8-5aca-49be-bef0-76a2c6c2bc86`::ref 0 aborting False >Thread-321::DEBUG::2013-03-01 14:22:53,285::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-321::DEBUG::2013-03-01 14:22:53,286::task::568::TaskManager.Task::(_updateState) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::moving from state init -> state preparing >Thread-321::INFO::2013-03-01 14:22:53,286::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='46a88efb-817e-49ba-b498-4fae08c6e657', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-321::DEBUG::2013-03-01 14:22:53,287::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b7c8a955-b272-45f6-bd3d-506503e6a6ce`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-321::DEBUG::2013-03-01 14:22:53,287::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-321::DEBUG::2013-03-01 14:22:53,287::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-321::DEBUG::2013-03-01 14:22:53,288::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b7c8a955-b272-45f6-bd3d-506503e6a6ce`::Granted request >Thread-321::DEBUG::2013-03-01 14:22:53,288::task::794::TaskManager.Task::(resourceAcquired) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-321::DEBUG::2013-03-01 14:22:53,289::task::957::TaskManager.Task::(_decref) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::ref 1 aborting False >Thread-321::DEBUG::2013-03-01 14:22:53,289::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`e03ee4af-ddee-4a25-8cfa-b752c5ea7733`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-321::DEBUG::2013-03-01 14:22:53,289::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' for lock type 'exclusive' >Thread-321::DEBUG::2013-03-01 14:22:53,290::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free. Now locking as 'exclusive' (1 active user) >Thread-321::DEBUG::2013-03-01 14:22:53,290::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`e03ee4af-ddee-4a25-8cfa-b752c5ea7733`::Granted request >Thread-321::DEBUG::2013-03-01 14:22:53,292::task::794::TaskManager.Task::(resourceAcquired) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::_resourcesAcquired: Storage.46a88efb-817e-49ba-b498-4fae08c6e657 (exclusive) >Thread-321::DEBUG::2013-03-01 14:22:53,292::task::957::TaskManager.Task::(_decref) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::ref 1 aborting False >Thread-321::INFO::2013-03-01 14:22:53,292::sp::1045::Storage.StoragePool::(activateSD) sdUUID=46a88efb-817e-49ba-b498-4fae08c6e657 spUUID=8fd46635-c46a-47a7-b122-316b2df29251 >Thread-321::DEBUG::2013-03-01 14:22:53,294::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/fsck -p /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-321::DEBUG::2013-03-01 14:22:53,336::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2013-03-01 14:22:53,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-321::DEBUG::2013-03-01 14:22:53,355::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >Thread-321::DEBUG::2013-03-01 14:22:53,355::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-321::DEBUG::2013-03-01 14:22:53,407::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-321::DEBUG::2013-03-01 14:22:53,423::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2013-03-01 14:22:53,426::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-321::DEBUG::2013-03-01 14:22:53,426::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-321::DEBUG::2013-03-01 14:22:53,427::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00'] >Thread-321::DEBUG::2013-03-01 14:22:53,427::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:53,428::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:53,428::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:53,428::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:53,429::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:53,430::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:53,526::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:53,610::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324964 s, 31.5 MB/s\n'; <rc> = 0 >Thread-321::DEBUG::2013-03-01 14:22:53,646::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2013-03-01 14:22:53,648::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:53,649::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00 removing=MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Attached&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=275e73d2ff907b9237981b6cfb1ce5ca0a45eec8 >Thread-321::DEBUG::2013-03-01 14:22:53,651::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=275e73d2ff907b9237981b6cfb1ce5ca0a45eec8 --deltag MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Attached&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --addtag MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --addtag MDT__SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:53,746::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:22:53,753::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000364348 s, 11.2 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:22:53,892::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:22:53,927::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000283567 s, 14.4 MB/s\n'; <rc> = 0 >Thread-321::DEBUG::2013-03-01 14:22:54,016::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2013-03-01 14:22:54,017::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:54,017::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2013-03-01 14:22:54,018::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-321::WARNING::2013-03-01 14:22:54,019::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/images already exists >Thread-321::WARNING::2013-03-01 14:22:54,021::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/dom_md already exists >Thread-321::INFO::2013-03-01 14:22:54,024::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-321::DEBUG::2013-03-01 14:22:54,026::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-321::DEBUG::2013-03-01 14:22:54,027::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-321::DEBUG::2013-03-01 14:22:54,029::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-321::DEBUG::2013-03-01 14:22:54,030::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-321::DEBUG::2013-03-01 14:22:54,031::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-321::DEBUG::2013-03-01 14:22:54,033::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-321::DEBUG::2013-03-01 14:22:54,036::sp::1570::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `8fd46635-c46a-47a7-b122-316b2df29251` started monitoring domain `46a88efb-817e-49ba-b498-4fae08c6e657` >Thread-322::DEBUG::2013-03-01 14:22:54,037::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-321::DEBUG::2013-03-01 14:22:54,039::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-321::INFO::2013-03-01 14:22:54,041::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-321::DEBUG::2013-03-01 14:22:54,043::task::1151::TaskManager.Task::(prepare) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::finished: None >Thread-321::DEBUG::2013-03-01 14:22:54,045::task::568::TaskManager.Task::(_updateState) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::moving from state preparing -> state finished >Thread-321::DEBUG::2013-03-01 14:22:54,047::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657': < ResourceRef 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', isValid: 'True' obj: 'None'>} >Thread-321::DEBUG::2013-03-01 14:22:54,048::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-322::DEBUG::2013-03-01 14:22:54,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-321::DEBUG::2013-03-01 14:22:54,050::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-321::DEBUG::2013-03-01 14:22:54,058::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-321::DEBUG::2013-03-01 14:22:54,058::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-321::DEBUG::2013-03-01 14:22:54,059::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-321::DEBUG::2013-03-01 14:22:54,059::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' >Thread-321::DEBUG::2013-03-01 14:22:54,060::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' (0 active users) >Thread-321::DEBUG::2013-03-01 14:22:54,060::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free, finding out if anyone is waiting for it. >Thread-321::DEBUG::2013-03-01 14:22:54,060::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', Clearing records. >Thread-321::DEBUG::2013-03-01 14:22:54,061::task::957::TaskManager.Task::(_decref) Task=`030a8f25-30ca-44cb-b7ce-235649d18fe0`::ref 0 aborting False >Thread-323::DEBUG::2013-03-01 14:22:54,101::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-323::DEBUG::2013-03-01 14:22:54,102::task::568::TaskManager.Task::(_updateState) Task=`6926e373-7324-408e-bd7d-83ac91cfff06`::moving from state init -> state preparing >Thread-323::INFO::2013-03-01 14:22:54,102::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-323::INFO::2013-03-01 14:22:54,103::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-323::DEBUG::2013-03-01 14:22:54,103::task::1151::TaskManager.Task::(prepare) Task=`6926e373-7324-408e-bd7d-83ac91cfff06`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-323::DEBUG::2013-03-01 14:22:54,103::task::568::TaskManager.Task::(_updateState) Task=`6926e373-7324-408e-bd7d-83ac91cfff06`::moving from state preparing -> state finished >Thread-323::DEBUG::2013-03-01 14:22:54,104::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2013-03-01 14:22:54,104::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2013-03-01 14:22:54,104::task::957::TaskManager.Task::(_decref) Task=`6926e373-7324-408e-bd7d-83ac91cfff06`::ref 0 aborting False >Thread-324::DEBUG::2013-03-01 14:22:54,112::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-324::DEBUG::2013-03-01 14:22:54,114::task::568::TaskManager.Task::(_updateState) Task=`4b14a00e-de5c-4ef2-a118-f9ebd42188d8`::moving from state init -> state preparing >Thread-324::INFO::2013-03-01 14:22:54,114::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', msdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', masterVersion=1, options=None) >Thread-324::DEBUG::2013-03-01 14:22:54,115::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`d0e889ff-b1de-4cfa-bfa4-d48567b8ab3a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-324::DEBUG::2013-03-01 14:22:54,115::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-324::DEBUG::2013-03-01 14:22:54,115::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-324::DEBUG::2013-03-01 14:22:54,116::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`d0e889ff-b1de-4cfa-bfa4-d48567b8ab3a`::Granted request >Thread-324::DEBUG::2013-03-01 14:22:54,116::task::794::TaskManager.Task::(resourceAcquired) Task=`4b14a00e-de5c-4ef2-a118-f9ebd42188d8`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-324::DEBUG::2013-03-01 14:22:54,116::task::957::TaskManager.Task::(_decref) Task=`4b14a00e-de5c-4ef2-a118-f9ebd42188d8`::ref 1 aborting False >Thread-324::INFO::2013-03-01 14:22:54,117::blockSD::818::Storage.StorageDomain::(validate) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-324::DEBUG::2013-03-01 14:22:54,118::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-325::DEBUG::2013-03-01 14:22:54,133::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-325::DEBUG::2013-03-01 14:22:54,134::task::568::TaskManager.Task::(_updateState) Task=`2f0025f3-00aa-408a-930d-47bf7b4d401c`::moving from state init -> state preparing >Thread-325::INFO::2013-03-01 14:22:54,134::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-325::DEBUG::2013-03-01 14:22:54,135::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`665c6476-7018-4f1e-85ca-8534dc91e57f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-325::DEBUG::2013-03-01 14:22:54,135::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-325::DEBUG::2013-03-01 14:22:54,136::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-325::DEBUG::2013-03-01 14:22:54,136::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`665c6476-7018-4f1e-85ca-8534dc91e57f`::Granted request >Thread-325::DEBUG::2013-03-01 14:22:54,137::task::794::TaskManager.Task::(resourceAcquired) Task=`2f0025f3-00aa-408a-930d-47bf7b4d401c`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-325::DEBUG::2013-03-01 14:22:54,137::task::957::TaskManager.Task::(_decref) Task=`2f0025f3-00aa-408a-930d-47bf7b4d401c`::ref 1 aborting False >Thread-325::DEBUG::2013-03-01 14:22:54,138::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:22:54,139::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-322::DEBUG::2013-03-01 14:22:54,292::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:22:54,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:22:54,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000288734 s, 14.2 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:22:54,301::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-322::DEBUG::2013-03-01 14:22:54,302::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-324::DEBUG::2013-03-01 14:22:54,337::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-324::DEBUG::2013-03-01 14:22:54,338::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-325::DEBUG::2013-03-01 14:22:54,372::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:22:54,501::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:22:54,503::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,504::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,504::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,504::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,504::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,505::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,505::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-324::DEBUG::2013-03-01 14:22:54,710::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-324::DEBUG::2013-03-01 14:22:54,712::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,712::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00'] >Thread-324::DEBUG::2013-03-01 14:22:54,715::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,715::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,715::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,716::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,716::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:22:54,716::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:22:54,717::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-325::DEBUG::2013-03-01 14:22:54,717::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-325::DEBUG::2013-03-01 14:22:54,717::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-325::DEBUG::2013-03-01 14:22:54,718::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-325::DEBUG::2013-03-01 14:22:54,718::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-325::DEBUG::2013-03-01 14:22:54,747::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:22:54,747::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:54,750::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:54,752::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:55,624::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:55,735::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464844 s, 22.0 MB/s\n'; <rc> = 0 >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:55,756::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:55,759::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:55,762::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:55,764::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:55,767::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-325::DEBUG::2013-03-01 14:22:55,770::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-195::DEBUG::2013-03-01 14:22:57,754::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-325::DEBUG::2013-03-01 14:22:57,774::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:57,862::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502104 s, 20.4 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:22:59,875::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:22:59,962::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425258 s, 24.1 MB/s\n'; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:01,518::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:01,519::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,519::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,519::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,520::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,520::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,521::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,521::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-325::DEBUG::2013-03-01 14:23:01,521::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:01,758::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:01,759::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,759::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-325::DEBUG::2013-03-01 14:23:01,760::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:01,767::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000306057 s, 6.7 MB/s\n'; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:01,768::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000306057 s, 6.7 MB/s'], size: 2048 >Thread-325::DEBUG::2013-03-01 14:23:01,768::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-325::WARNING::2013-03-01 14:23:01,768::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-325::DEBUG::2013-03-01 14:23:01,770::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-325::DEBUG::2013-03-01 14:23:01,770::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,771::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,771::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,771::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,772::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:01,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:01,976::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:01,992::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:01,999::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,001::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00'] >Thread-325::DEBUG::2013-03-01 14:23:02,005::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:02,097::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.074493 s, 13.7 MB/s\n'; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:02,262::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:02,262::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-325::WARNING::2013-03-01 14:23:02,263::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >Thread-325::WARNING::2013-03-01 14:23:02,263::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >Thread-325::WARNING::2013-03-01 14:23:02,264::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >Thread-324::DEBUG::2013-03-01 14:23:02,266::sp::1536::Storage.StoragePool::(getMasterDomain) Master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de verified, version 1 >Thread-324::DEBUG::2013-03-01 14:23:02,267::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-325::DEBUG::2013-03-01 14:23:02,267::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-324::DEBUG::2013-03-01 14:23:02,268::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-324::DEBUG::2013-03-01 14:23:02,270::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-324::WARNING::2013-03-01 14:23:02,272::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251 already exists >Thread-325::DEBUG::2013-03-01 14:23:02,273::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-324::DEBUG::2013-03-01 14:23:02,282::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-324::DEBUG::2013-03-01 14:23:02,283::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:02,531::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:02,533::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-325::DEBUG::2013-03-01 14:23:02,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:02,542::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000240576 s, 8.5 MB/s\n'; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:02,542::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000240576 s, 8.5 MB/s'], size: 2048 >Thread-325::DEBUG::2013-03-01 14:23:02,542::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=0', 'PHYBLKSIZE=4096', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=9150cd0205e3d12ae60fcb652778b25da8168a37'] >Thread-325::WARNING::2013-03-01 14:23:02,543::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 46a88efb-817e-49ba-b498-4fae08c6e657_imageNS already registered >Thread-325::WARNING::2013-03-01 14:23:02,543::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 46a88efb-817e-49ba-b498-4fae08c6e657_volumeNS already registered >Thread-325::WARNING::2013-03-01 14:23:02,544::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 46a88efb-817e-49ba-b498-4fae08c6e657_lvmActivationNS already registered >Thread-325::DEBUG::2013-03-01 14:23:02,544::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-325::DEBUG::2013-03-01 14:23:02,545::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-324::DEBUG::2013-03-01 14:23:02,554::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-324::WARNING::2013-03-01 14:23:02,556::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/dom_md already exists >Thread-324::WARNING::2013-03-01 14:23:02,557::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/images already exists >Thread-324::WARNING::2013-03-01 14:23:02,557::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/dom_md already exists >Thread-324::WARNING::2013-03-01 14:23:02,557::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898/images already exists >Thread-324::INFO::2013-03-01 14:23:02,614::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-324::INFO::2013-03-01 14:23:02,614::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/04bf19fa-db6c-4c8f-845f-b87411d8e898 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-324::WARNING::2013-03-01 14:23:02,615::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >Thread-324::WARNING::2013-03-01 14:23:02,615::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >Thread-324::INFO::2013-03-01 14:23:02,616::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-324::INFO::2013-03-01 14:23:02,616::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd >Thread-324::INFO::2013-03-01 14:23:02,617::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-324::DEBUG::2013-03-01 14:23:02,617::task::1151::TaskManager.Task::(prepare) Task=`4b14a00e-de5c-4ef2-a118-f9ebd42188d8`::finished: None >Thread-324::DEBUG::2013-03-01 14:23:02,617::task::568::TaskManager.Task::(_updateState) Task=`4b14a00e-de5c-4ef2-a118-f9ebd42188d8`::moving from state preparing -> state finished >Thread-324::DEBUG::2013-03-01 14:23:02,618::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-324::DEBUG::2013-03-01 14:23:02,618::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-324::DEBUG::2013-03-01 14:23:02,618::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-324::DEBUG::2013-03-01 14:23:02,619::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (1 active users) >Thread-324::DEBUG::2013-03-01 14:23:02,619::task::957::TaskManager.Task::(_decref) Task=`4b14a00e-de5c-4ef2-a118-f9ebd42188d8`::ref 0 aborting False >Thread-325::DEBUG::2013-03-01 14:23:02,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:02,772::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,773::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-325::DEBUG::2013-03-01 14:23:02,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:02,782::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000335537 s, 6.1 MB/s\n'; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:02,783::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000335537 s, 6.1 MB/s'], size: 2048 >Thread-325::DEBUG::2013-03-01 14:23:02,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-325::WARNING::2013-03-01 14:23:02,783::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-325::DEBUG::2013-03-01 14:23:02,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-325::DEBUG::2013-03-01 14:23:02,784::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,784::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,785::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,785::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,786::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:02,787::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-325::DEBUG::2013-03-01 14:23:03,048::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2013-03-01 14:23:03,050::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-325::DEBUG::2013-03-01 14:23:03,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', '_SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790', 'MASTER_VERSION=0'] >Thread-325::WARNING::2013-03-01 14:23:03,052::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_imageNS already registered >Thread-325::WARNING::2013-03-01 14:23:03,052::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_volumeNS already registered >Thread-325::WARNING::2013-03-01 14:23:03,053::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_lvmActivationNS already registered >Thread-325::INFO::2013-03-01 14:23:03,054::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-325::DEBUG::2013-03-01 14:23:03,054::task::1151::TaskManager.Task::(prepare) Task=`2f0025f3-00aa-408a-930d-47bf7b4d401c`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-325::DEBUG::2013-03-01 14:23:03,054::task::568::TaskManager.Task::(_updateState) Task=`2f0025f3-00aa-408a-930d-47bf7b4d401c`::moving from state preparing -> state finished >Thread-325::DEBUG::2013-03-01 14:23:03,055::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-325::DEBUG::2013-03-01 14:23:03,055::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-325::DEBUG::2013-03-01 14:23:03,055::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-325::DEBUG::2013-03-01 14:23:03,056::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-325::DEBUG::2013-03-01 14:23:03,056::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-325::DEBUG::2013-03-01 14:23:03,056::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-325::DEBUG::2013-03-01 14:23:03,057::task::957::TaskManager.Task::(_decref) Task=`2f0025f3-00aa-408a-930d-47bf7b4d401c`::ref 0 aborting False >Thread-352::DEBUG::2013-03-01 14:23:03,856::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-352::DEBUG::2013-03-01 14:23:03,857::task::568::TaskManager.Task::(_updateState) Task=`bfcb5669-81f8-4bad-9e75-952cc3533115`::moving from state init -> state preparing >Thread-352::INFO::2013-03-01 14:23:03,857::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-352::INFO::2013-03-01 14:23:03,857::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-352::DEBUG::2013-03-01 14:23:03,858::task::1151::TaskManager.Task::(prepare) Task=`bfcb5669-81f8-4bad-9e75-952cc3533115`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-352::DEBUG::2013-03-01 14:23:03,858::task::568::TaskManager.Task::(_updateState) Task=`bfcb5669-81f8-4bad-9e75-952cc3533115`::moving from state preparing -> state finished >Thread-352::DEBUG::2013-03-01 14:23:03,858::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-352::DEBUG::2013-03-01 14:23:03,858::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-352::DEBUG::2013-03-01 14:23:03,858::task::957::TaskManager.Task::(_decref) Task=`bfcb5669-81f8-4bad-9e75-952cc3533115`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:23:03,930::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-353::DEBUG::2013-03-01 14:23:03,940::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-353::DEBUG::2013-03-01 14:23:03,941::task::568::TaskManager.Task::(_updateState) Task=`1efd6d41-acf5-43d1-9f9b-65dc657e53eb`::moving from state init -> state preparing >Thread-353::INFO::2013-03-01 14:23:03,941::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-353::DEBUG::2013-03-01 14:23:03,945::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-10__nfs__2013__03__01__14__11__36__629533' (cwd None) >Thread-151::DEBUG::2013-03-01 14:23:04,047::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:04,110::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-229::DEBUG::2013-03-01 14:23:04,162::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:23:04,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:23:04,181::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026699 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:23:04,207::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285947 s, 35.8 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:23:04,302::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:23:04,302::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:23:04,311::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028281 s, 14.5 MB/s\n'; <rc> = 0 >Thread-353::INFO::2013-03-01 14:23:04,325::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-353::DEBUG::2013-03-01 14:23:04,325::task::1151::TaskManager.Task::(prepare) Task=`1efd6d41-acf5-43d1-9f9b-65dc657e53eb`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-353::DEBUG::2013-03-01 14:23:04,326::task::568::TaskManager.Task::(_updateState) Task=`1efd6d41-acf5-43d1-9f9b-65dc657e53eb`::moving from state preparing -> state finished >Thread-353::DEBUG::2013-03-01 14:23:04,326::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-353::DEBUG::2013-03-01 14:23:04,326::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-353::DEBUG::2013-03-01 14:23:04,327::task::957::TaskManager.Task::(_decref) Task=`1efd6d41-acf5-43d1-9f9b-65dc657e53eb`::ref 0 aborting False >Thread-354::DEBUG::2013-03-01 14:23:04,375::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-354::DEBUG::2013-03-01 14:23:04,376::task::568::TaskManager.Task::(_updateState) Task=`7d9ec099-5993-4e86-a375-6f39fd86b898`::moving from state init -> state preparing >Thread-354::INFO::2013-03-01 14:23:04,376::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', options=None) >Thread-354::DEBUG::2013-03-01 14:23:04,377::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-354::DEBUG::2013-03-01 14:23:04,377::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-354::DEBUG::2013-03-01 14:23:04,377::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-354::DEBUG::2013-03-01 14:23:04,377::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-354::DEBUG::2013-03-01 14:23:04,378::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-354::DEBUG::2013-03-01 14:23:04,413::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:04,413::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:04,416::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:04,505::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:04,764::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:23:04,764::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:04,773::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000345922 s, 11.8 MB/s\n'; <rc> = 0 >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:05,420::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:06,221::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:06,332::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463046 s, 22.1 MB/s\n'; <rc> = 0 >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:06,424::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:06,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:07,431::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-356::DEBUG::2013-03-01 14:23:07,716::task::568::TaskManager.Task::(_updateState) Task=`0d6cf332-db49-4777-89e6-99e563038eaa`::moving from state init -> state preparing >Thread-356::INFO::2013-03-01 14:23:07,716::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-356::INFO::2013-03-01 14:23:07,716::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.00905704498291', 'lastCheck': '2.9', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.0194580554962', 'lastCheck': '3.5', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00890183448792', 'lastCheck': '3.4', 'code': 0, 'valid': True}} >Thread-356::DEBUG::2013-03-01 14:23:07,717::task::1151::TaskManager.Task::(prepare) Task=`0d6cf332-db49-4777-89e6-99e563038eaa`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.00905704498291', 'lastCheck': '2.9', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.0194580554962', 'lastCheck': '3.5', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00890183448792', 'lastCheck': '3.4', 'code': 0, 'valid': True}} >Thread-356::DEBUG::2013-03-01 14:23:07,717::task::568::TaskManager.Task::(_updateState) Task=`0d6cf332-db49-4777-89e6-99e563038eaa`::moving from state preparing -> state finished >Thread-356::DEBUG::2013-03-01 14:23:07,717::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-356::DEBUG::2013-03-01 14:23:07,717::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-356::DEBUG::2013-03-01 14:23:07,718::task::957::TaskManager.Task::(_decref) Task=`0d6cf332-db49-4777-89e6-99e563038eaa`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:23:08,351::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:08,435::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:08,457::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383729 s, 26.7 MB/s\n'; <rc> = 0 >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:09,439::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2013-03-01 14:23:10,443::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Dummy-195::DEBUG::2013-03-01 14:23:10,477::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:10,558::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369031 s, 27.7 MB/s\n'; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:12,447::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:12,572::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:12,652::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361628 s, 28.3 MB/s\n'; <rc> = 0 >Thread-359::DEBUG::2013-03-01 14:23:13,131::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-359::DEBUG::2013-03-01 14:23:13,132::task::568::TaskManager.Task::(_updateState) Task=`d4186839-0d2f-4c7e-a139-ff0f70e09f34`::moving from state init -> state preparing >Thread-359::INFO::2013-03-01 14:23:13,132::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-359::INFO::2013-03-01 14:23:13,133::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-359::DEBUG::2013-03-01 14:23:13,133::task::1151::TaskManager.Task::(prepare) Task=`d4186839-0d2f-4c7e-a139-ff0f70e09f34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-359::DEBUG::2013-03-01 14:23:13,133::task::568::TaskManager.Task::(_updateState) Task=`d4186839-0d2f-4c7e-a139-ff0f70e09f34`::moving from state preparing -> state finished >Thread-359::DEBUG::2013-03-01 14:23:13,134::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-359::DEBUG::2013-03-01 14:23:13,134::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-359::DEBUG::2013-03-01 14:23:13,134::task::957::TaskManager.Task::(_decref) Task=`d4186839-0d2f-4c7e-a139-ff0f70e09f34`::ref 0 aborting False >Thread-360::DEBUG::2013-03-01 14:23:13,162::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-360::DEBUG::2013-03-01 14:23:13,162::task::568::TaskManager.Task::(_updateState) Task=`193d6c76-453d-4381-bbbf-1f17b5b985e1`::moving from state init -> state preparing >Thread-360::INFO::2013-03-01 14:23:13,162::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-360::DEBUG::2013-03-01 14:23:13,163::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`c915a476-7770-4430-9015-0469cae3366e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-360::DEBUG::2013-03-01 14:23:13,163::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-360::DEBUG::2013-03-01 14:23:13,164::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-360::DEBUG::2013-03-01 14:23:13,164::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`c915a476-7770-4430-9015-0469cae3366e`::Granted request >Thread-360::DEBUG::2013-03-01 14:23:13,165::task::794::TaskManager.Task::(resourceAcquired) Task=`193d6c76-453d-4381-bbbf-1f17b5b985e1`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-360::DEBUG::2013-03-01 14:23:13,165::task::957::TaskManager.Task::(_decref) Task=`193d6c76-453d-4381-bbbf-1f17b5b985e1`::ref 1 aborting False >Thread-360::INFO::2013-03-01 14:23:13,167::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-360::DEBUG::2013-03-01 14:23:13,167::task::1151::TaskManager.Task::(prepare) Task=`193d6c76-453d-4381-bbbf-1f17b5b985e1`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-360::DEBUG::2013-03-01 14:23:13,167::task::568::TaskManager.Task::(_updateState) Task=`193d6c76-453d-4381-bbbf-1f17b5b985e1`::moving from state preparing -> state finished >Thread-360::DEBUG::2013-03-01 14:23:13,167::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-360::DEBUG::2013-03-01 14:23:13,168::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-360::DEBUG::2013-03-01 14:23:13,168::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-360::DEBUG::2013-03-01 14:23:13,168::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-360::DEBUG::2013-03-01 14:23:13,169::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-360::DEBUG::2013-03-01 14:23:13,169::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-360::DEBUG::2013-03-01 14:23:13,169::task::957::TaskManager.Task::(_decref) Task=`193d6c76-453d-4381-bbbf-1f17b5b985e1`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:23:14,186::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:23:14,195::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000343652 s, 11.9 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:23:14,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:23:14,326::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000393139 s, 10.4 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:23:14,666::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:14,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416854 s, 24.6 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:23:14,776::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:14,795::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000363091 s, 11.3 MB/s\n'; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:16,142::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:16,142::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,143::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,143::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,143::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,144::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,144::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,144::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-354::DEBUG::2013-03-01 14:23:16,145::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,150::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-354::DEBUG::2013-03-01 14:23:16,432::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:16,436::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:16,575::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-354::DEBUG::2013-03-01 14:23:16,576::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y bf265c3d-3861-497d-88b8-523fb1f33269/metadata' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:16,816::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:16,943::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0532922 s, 19.2 MB/s\n'; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:18,665::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:18,665::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,665::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,666::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/bf265c3d-3861-497d-88b8-523fb1f33269/metadata count=1' (cwd None) >Thread-354::DEBUG::2013-03-01 14:23:18,674::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000313815 s, 6.5 MB/s\n'; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:18,675::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000313815 s, 6.5 MB/s'], size: 2048 >Thread-354::DEBUG::2013-03-01 14:23:18,675::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-354::WARNING::2013-03-01 14:23:18,676::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-354::DEBUG::2013-03-01 14:23:18,676::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-354::DEBUG::2013-03-01 14:23:18,676::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,677::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,677::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,678::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,678::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free bf265c3d-3861-497d-88b8-523fb1f33269' (cwd None) >Thread-354::DEBUG::2013-03-01 14:23:18,889::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:18,891::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:18,891::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'LOCKPOLICY=', 'VGUUID=oI342y-IagV-07MP-WV7O-yJLG-MZZr-qBN6S5', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=bf265c3d-3861-497d-88b8-523fb1f33269', 'DESCRIPTION=ISCSIDataDomain2', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'CLASS=Data', u'PV0=pv:3514f0c542a00048d,uuid:fuk6HX-YrrA-8PRv-u1d1-b59E-jVKM-tWfP3j,pestart:0,pecount:237,mapoffset:0', 'POOL_UUID=ca353020-9141-4ad0-b818-922be48ee0f1', 'POOL_SPM_ID=1', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=TestDataCenter', 'POOL_SPM_LVER=0', 'ROLE=Master', 'MASTER_VERSION=2', '_SHA_CKSUM=fa44eea6f87d4b31b635c967796b3b2dde203983', u'POOL_DOMAINS=bf265c3d-3861-497d-88b8-523fb1f33269:Active,801d77ab-5313-49a7-9955-a000071229e0:Attached'] >Thread-354::DEBUG::2013-03-01 14:23:18,892::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y bf265c3d-3861-497d-88b8-523fb1f33269/ids' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:18,958::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:19,035::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034187 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:23:21,053::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:21,759::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.442742 s, 2.3 MB/s\n'; <rc> = 0 >Thread-388::DEBUG::2013-03-01 14:23:23,091::task::568::TaskManager.Task::(_updateState) Task=`52f72b76-596e-4f7a-a533-500a78cc0c08`::moving from state init -> state preparing >Thread-388::INFO::2013-03-01 14:23:23,091::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-388::INFO::2013-03-01 14:23:23,092::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.0219368934631', 'lastCheck': '8.3', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00969886779785', 'lastCheck': '8.9', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00931000709534', 'lastCheck': '8.8', 'code': 0, 'valid': True}} >Thread-388::DEBUG::2013-03-01 14:23:23,092::task::1151::TaskManager.Task::(prepare) Task=`52f72b76-596e-4f7a-a533-500a78cc0c08`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.0219368934631', 'lastCheck': '8.3', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00969886779785', 'lastCheck': '8.9', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00931000709534', 'lastCheck': '8.8', 'code': 0, 'valid': True}} >Thread-388::DEBUG::2013-03-01 14:23:23,092::task::568::TaskManager.Task::(_updateState) Task=`52f72b76-596e-4f7a-a533-500a78cc0c08`::moving from state preparing -> state finished >Thread-388::DEBUG::2013-03-01 14:23:23,092::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-388::DEBUG::2013-03-01 14:23:23,093::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-388::DEBUG::2013-03-01 14:23:23,093::task::957::TaskManager.Task::(_decref) Task=`52f72b76-596e-4f7a-a533-500a78cc0c08`::ref 0 aborting False >Thread-390::DEBUG::2013-03-01 14:23:23,224::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-390::DEBUG::2013-03-01 14:23:23,225::task::568::TaskManager.Task::(_updateState) Task=`c622b7c7-e133-4015-99a6-d10d04a850e2`::moving from state init -> state preparing >Thread-390::INFO::2013-03-01 14:23:23,225::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-390::INFO::2013-03-01 14:23:23,225::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-390::DEBUG::2013-03-01 14:23:23,226::task::1151::TaskManager.Task::(prepare) Task=`c622b7c7-e133-4015-99a6-d10d04a850e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-390::DEBUG::2013-03-01 14:23:23,226::task::568::TaskManager.Task::(_updateState) Task=`c622b7c7-e133-4015-99a6-d10d04a850e2`::moving from state preparing -> state finished >Thread-390::DEBUG::2013-03-01 14:23:23,226::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-390::DEBUG::2013-03-01 14:23:23,227::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-390::DEBUG::2013-03-01 14:23:23,227::task::957::TaskManager.Task::(_decref) Task=`c622b7c7-e133-4015-99a6-d10d04a850e2`::ref 0 aborting False >Thread-391::DEBUG::2013-03-01 14:23:23,258::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-391::DEBUG::2013-03-01 14:23:23,259::task::568::TaskManager.Task::(_updateState) Task=`dd8bc194-9d3b-4b0c-b86c-d81bfb695258`::moving from state init -> state preparing >Thread-391::INFO::2013-03-01 14:23:23,259::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-391::DEBUG::2013-03-01 14:23:23,260::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`1a08b0bf-4346-4faf-a673-8c681ecdf830`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-391::DEBUG::2013-03-01 14:23:23,260::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-391::DEBUG::2013-03-01 14:23:23,261::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-391::DEBUG::2013-03-01 14:23:23,261::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`1a08b0bf-4346-4faf-a673-8c681ecdf830`::Granted request >Thread-391::DEBUG::2013-03-01 14:23:23,261::task::794::TaskManager.Task::(resourceAcquired) Task=`dd8bc194-9d3b-4b0c-b86c-d81bfb695258`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-391::DEBUG::2013-03-01 14:23:23,262::task::957::TaskManager.Task::(_decref) Task=`dd8bc194-9d3b-4b0c-b86c-d81bfb695258`::ref 1 aborting False >Thread-391::INFO::2013-03-01 14:23:23,264::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-391::DEBUG::2013-03-01 14:23:23,264::task::1151::TaskManager.Task::(prepare) Task=`dd8bc194-9d3b-4b0c-b86c-d81bfb695258`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-391::DEBUG::2013-03-01 14:23:23,264::task::568::TaskManager.Task::(_updateState) Task=`dd8bc194-9d3b-4b0c-b86c-d81bfb695258`::moving from state preparing -> state finished >Thread-391::DEBUG::2013-03-01 14:23:23,265::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-391::DEBUG::2013-03-01 14:23:23,265::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-391::DEBUG::2013-03-01 14:23:23,265::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-391::DEBUG::2013-03-01 14:23:23,266::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-391::DEBUG::2013-03-01 14:23:23,266::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-391::DEBUG::2013-03-01 14:23:23,266::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-391::DEBUG::2013-03-01 14:23:23,267::task::957::TaskManager.Task::(_decref) Task=`dd8bc194-9d3b-4b0c-b86c-d81bfb695258`::ref 0 aborting False >Thread-354::DEBUG::2013-03-01 14:23:23,321::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:23,321::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:23,322::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:23,323::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y bf265c3d-3861-497d-88b8-523fb1f33269/leases' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:23,779::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:23,870::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358043 s, 28.6 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:23:24,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:23:24,206::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000290818 s, 14.1 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:23:24,332::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:23:24,341::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000281326 s, 14.6 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:23:24,798::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:24,808::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000473536 s, 8.6 MB/s\n'; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:25,471::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:25,472::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:25,472::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:25,474::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y bf265c3d-3861-497d-88b8-523fb1f33269/inbox bf265c3d-3861-497d-88b8-523fb1f33269/outbox bf265c3d-3861-497d-88b8-523fb1f33269/master' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:25,887::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:25,980::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460796 s, 22.2 MB/s\n'; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:27,755::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:27,756::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:27,756::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:27,757::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:27,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-354::DEBUG::2013-03-01 14:23:27,978::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2013-03-01 14:23:27,978::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-354::DEBUG::2013-03-01 14:23:27,979::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'bf265c3d-3861-497d-88b8-523fb1f33269_imageNS' >Thread-354::DEBUG::2013-03-01 14:23:27,980::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'bf265c3d-3861-497d-88b8-523fb1f33269_volumeNS' >Thread-354::DEBUG::2013-03-01 14:23:27,980::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'bf265c3d-3861-497d-88b8-523fb1f33269_lvmActivationNS' >Thread-354::INFO::2013-03-01 14:23:27,981::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-354::DEBUG::2013-03-01 14:23:27,981::task::1151::TaskManager.Task::(prepare) Task=`7d9ec099-5993-4e86-a375-6f39fd86b898`::finished: {'domlist': []} >Thread-354::DEBUG::2013-03-01 14:23:27,981::task::568::TaskManager.Task::(_updateState) Task=`7d9ec099-5993-4e86-a375-6f39fd86b898`::moving from state preparing -> state finished >Thread-354::DEBUG::2013-03-01 14:23:27,982::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-354::DEBUG::2013-03-01 14:23:27,982::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-354::DEBUG::2013-03-01 14:23:27,982::task::957::TaskManager.Task::(_decref) Task=`7d9ec099-5993-4e86-a375-6f39fd86b898`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:23:27,994::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:28,083::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327136 s, 31.3 MB/s\n'; <rc> = 0 >Thread-393::DEBUG::2013-03-01 14:23:28,088::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-393::DEBUG::2013-03-01 14:23:28,090::task::568::TaskManager.Task::(_updateState) Task=`280c9ad1-e1cb-4a56-be7b-4ea89f1c82e5`::moving from state init -> state preparing >Thread-393::INFO::2013-03-01 14:23:28,091::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', domainName='shared-iso-domain', typeSpecificArg='10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', domClass=2, domVersion='0', options=None) >Thread-393::DEBUG::2013-03-01 14:23:28,093::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-393::DEBUG::2013-03-01 14:23:28,097::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' (cwd None) >Thread-393::DEBUG::2013-03-01 14:23:28,698::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70" not found\n'; <rc> = 5 >Thread-393::WARNING::2013-03-01 14:23:28,703::lvm::378::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70" not found'] >Thread-393::DEBUG::2013-03-01 14:23:28,703::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-393::INFO::2013-03-01 14:23:28,747::nfsSD::68::Storage.StorageDomain::(create) sdUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 domainName=shared-iso-domain remotePath=10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533 domClass=2 >Thread-393::DEBUG::2013-03-01 14:23:29,025::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-393::DEBUG::2013-03-01 14:23:29,027::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-393::WARNING::2013-03-01 14:23:29,027::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-393::DEBUG::2013-03-01 14:23:29,027::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-393::DEBUG::2013-03-01 14:23:29,027::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-393::DEBUG::2013-03-01 14:23:29,028::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=shared-iso-domain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'ROLE=Regular', 'SDUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2d99c84660acef66e086f48d82997edb58f203f8'] >Thread-393::DEBUG::2013-03-01 14:23:29,069::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-393::DEBUG::2013-03-01 14:23:29,086::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-10__nfs__2013__03__01__14__11__36__629533/eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 >Thread-393::DEBUG::2013-03-01 14:23:29,086::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-393::DEBUG::2013-03-01 14:23:29,092::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=shared-iso-domain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'ROLE=Regular', 'SDUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2d99c84660acef66e086f48d82997edb58f203f8'] >Thread-393::DEBUG::2013-03-01 14:23:29,095::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-393::DEBUG::2013-03-01 14:23:29,095::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70_imageNS' >Thread-393::DEBUG::2013-03-01 14:23:29,096::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70_volumeNS' >Thread-393::DEBUG::2013-03-01 14:23:29,096::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-10__nfs__2013__03__01__14__11__36__629533/eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-393::DEBUG::2013-03-01 14:23:29,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-393::DEBUG::2013-03-01 14:23:29,136::sd::402::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-393::INFO::2013-03-01 14:23:29,137::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-393::DEBUG::2013-03-01 14:23:29,137::task::1151::TaskManager.Task::(prepare) Task=`280c9ad1-e1cb-4a56-be7b-4ea89f1c82e5`::finished: None >Thread-393::DEBUG::2013-03-01 14:23:29,138::task::568::TaskManager.Task::(_updateState) Task=`280c9ad1-e1cb-4a56-be7b-4ea89f1c82e5`::moving from state preparing -> state finished >Thread-393::DEBUG::2013-03-01 14:23:29,555::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-393::DEBUG::2013-03-01 14:23:29,555::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-393::DEBUG::2013-03-01 14:23:29,555::task::957::TaskManager.Task::(_decref) Task=`280c9ad1-e1cb-4a56-be7b-4ea89f1c82e5`::ref 0 aborting False >Thread-419::DEBUG::2013-03-01 14:23:29,594::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-419::DEBUG::2013-03-01 14:23:29,595::task::568::TaskManager.Task::(_updateState) Task=`3f4f1cb9-4e32-4f67-becd-b2276fd4b5f7`::moving from state init -> state preparing >Thread-419::INFO::2013-03-01 14:23:29,595::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', options=None) >Thread-419::DEBUG::2013-03-01 14:23:29,596::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70`ReqID=`6653563f-5cf8-4e2a-873b-30bac487c599`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-419::DEBUG::2013-03-01 14:23:29,596::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' for lock type 'shared' >Thread-419::DEBUG::2013-03-01 14:23:29,596::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' is free. Now locking as 'shared' (1 active user) >Thread-419::DEBUG::2013-03-01 14:23:29,596::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70`ReqID=`6653563f-5cf8-4e2a-873b-30bac487c599`::Granted request >Thread-419::DEBUG::2013-03-01 14:23:29,597::task::794::TaskManager.Task::(resourceAcquired) Task=`3f4f1cb9-4e32-4f67-becd-b2276fd4b5f7`::_resourcesAcquired: Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 (shared) >Thread-419::DEBUG::2013-03-01 14:23:29,597::task::957::TaskManager.Task::(_decref) Task=`3f4f1cb9-4e32-4f67-becd-b2276fd4b5f7`::ref 1 aborting False >Thread-419::INFO::2013-03-01 14:23:29,598::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '938255319040', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-419::DEBUG::2013-03-01 14:23:29,598::task::1151::TaskManager.Task::(prepare) Task=`3f4f1cb9-4e32-4f67-becd-b2276fd4b5f7`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '938255319040', 'disktotal': '1098974756864', 'mdafree': 0}} >Thread-419::DEBUG::2013-03-01 14:23:29,599::task::568::TaskManager.Task::(_updateState) Task=`3f4f1cb9-4e32-4f67-becd-b2276fd4b5f7`::moving from state preparing -> state finished >Thread-419::DEBUG::2013-03-01 14:23:29,599::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': < ResourceRef 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', isValid: 'True' obj: 'None'>} >Thread-419::DEBUG::2013-03-01 14:23:29,599::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-419::DEBUG::2013-03-01 14:23:29,599::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' >Thread-419::DEBUG::2013-03-01 14:23:29,599::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' (0 active users) >Thread-419::DEBUG::2013-03-01 14:23:29,600::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' is free, finding out if anyone is waiting for it. >Thread-419::DEBUG::2013-03-01 14:23:29,600::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', Clearing records. >Thread-419::DEBUG::2013-03-01 14:23:29,600::task::957::TaskManager.Task::(_decref) Task=`3f4f1cb9-4e32-4f67-becd-b2276fd4b5f7`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:23:30,114::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-420::DEBUG::2013-03-01 14:23:31,314::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-229::DEBUG::2013-03-01 14:23:34,209::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:23:34,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:34,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-420::DEBUG::2013-03-01 14:23:41,515::task::568::TaskManager.Task::(_updateState) Task=`334a133a-5536-47a6-b233-3f71605fdc67`::moving from state init -> state preparing >Thread-420::INFO::2013-03-01 14:23:41,540::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'a6c88426-a444-41aa-b151-64e128b56890', 'port': ''}], options=None) >Thread-420::INFO::2013-03-01 14:23:41,544::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-420::DEBUG::2013-03-01 14:23:41,548::task::1151::TaskManager.Task::(prepare) Task=`334a133a-5536-47a6-b233-3f71605fdc67`::finished: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-420::DEBUG::2013-03-01 14:23:41,552::task::568::TaskManager.Task::(_updateState) Task=`334a133a-5536-47a6-b233-3f71605fdc67`::moving from state preparing -> state finished >Thread-420::DEBUG::2013-03-01 14:23:41,555::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-420::DEBUG::2013-03-01 14:23:41,558::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2013-03-01 14:23:41,559::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000265432 s, 15.4 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:23:41,560::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000226671 s, 18.1 MB/s\n'; <rc> = 0 >Thread-420::DEBUG::2013-03-01 14:23:41,562::task::957::TaskManager.Task::(_decref) Task=`334a133a-5536-47a6-b233-3f71605fdc67`::ref 0 aborting False >Thread-422::DEBUG::2013-03-01 14:23:41,571::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-322::DEBUG::2013-03-01 14:23:41,576::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000297482 s, 13.8 MB/s\n'; <rc> = 0 >Thread-422::DEBUG::2013-03-01 14:23:41,577::task::568::TaskManager.Task::(_updateState) Task=`c51c0805-30f7-4c7a-b2da-be0bb006ab2f`::moving from state init -> state preparing >Thread-422::INFO::2013-03-01 14:23:41,580::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-422::INFO::2013-03-01 14:23:41,583::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-422::DEBUG::2013-03-01 14:23:41,586::task::1151::TaskManager.Task::(prepare) Task=`c51c0805-30f7-4c7a-b2da-be0bb006ab2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-422::DEBUG::2013-03-01 14:23:41,588::task::568::TaskManager.Task::(_updateState) Task=`c51c0805-30f7-4c7a-b2da-be0bb006ab2f`::moving from state preparing -> state finished >Thread-422::DEBUG::2013-03-01 14:23:41,590::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-422::DEBUG::2013-03-01 14:23:41,591::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-422::DEBUG::2013-03-01 14:23:41,593::task::957::TaskManager.Task::(_decref) Task=`c51c0805-30f7-4c7a-b2da-be0bb006ab2f`::ref 0 aborting False >Thread-423::DEBUG::2013-03-01 14:23:41,622::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-423::DEBUG::2013-03-01 14:23:41,623::task::568::TaskManager.Task::(_updateState) Task=`15c31977-504d-4382-9eb3-6aa7055b699f`::moving from state init -> state preparing >Thread-423::INFO::2013-03-01 14:23:41,624::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'a6c88426-a444-41aa-b151-64e128b56890', 'port': ''}], options=None) >Thread-424::DEBUG::2013-03-01 14:23:41,637::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-424::DEBUG::2013-03-01 14:23:41,640::task::568::TaskManager.Task::(_updateState) Task=`0a9590bb-fd50-4228-b6b7-c2ca2049eaaa`::moving from state init -> state preparing >Thread-423::INFO::2013-03-01 14:23:41,642::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-424::INFO::2013-03-01 14:23:41,642::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-423::DEBUG::2013-03-01 14:23:41,643::task::1151::TaskManager.Task::(prepare) Task=`15c31977-504d-4382-9eb3-6aa7055b699f`::finished: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-423::DEBUG::2013-03-01 14:23:41,645::task::568::TaskManager.Task::(_updateState) Task=`15c31977-504d-4382-9eb3-6aa7055b699f`::moving from state preparing -> state finished >Thread-424::DEBUG::2013-03-01 14:23:41,645::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`ae13cae0-8000-4dcf-b148-fa180a637e49`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-423::DEBUG::2013-03-01 14:23:41,646::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-424::DEBUG::2013-03-01 14:23:41,647::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-423::DEBUG::2013-03-01 14:23:41,648::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-423::DEBUG::2013-03-01 14:23:41,649::task::957::TaskManager.Task::(_decref) Task=`15c31977-504d-4382-9eb3-6aa7055b699f`::ref 0 aborting False >Thread-424::DEBUG::2013-03-01 14:23:41,650::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-424::DEBUG::2013-03-01 14:23:41,652::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`ae13cae0-8000-4dcf-b148-fa180a637e49`::Granted request >Thread-424::DEBUG::2013-03-01 14:23:41,655::task::794::TaskManager.Task::(resourceAcquired) Task=`0a9590bb-fd50-4228-b6b7-c2ca2049eaaa`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-424::DEBUG::2013-03-01 14:23:41,657::task::957::TaskManager.Task::(_decref) Task=`0a9590bb-fd50-4228-b6b7-c2ca2049eaaa`::ref 1 aborting False >Thread-424::INFO::2013-03-01 14:23:41,661::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-424::DEBUG::2013-03-01 14:23:41,662::task::1151::TaskManager.Task::(prepare) Task=`0a9590bb-fd50-4228-b6b7-c2ca2049eaaa`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-424::DEBUG::2013-03-01 14:23:41,663::task::568::TaskManager.Task::(_updateState) Task=`0a9590bb-fd50-4228-b6b7-c2ca2049eaaa`::moving from state preparing -> state finished >Thread-424::DEBUG::2013-03-01 14:23:41,664::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-424::DEBUG::2013-03-01 14:23:41,665::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-424::DEBUG::2013-03-01 14:23:41,666::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-424::DEBUG::2013-03-01 14:23:41,667::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-424::DEBUG::2013-03-01 14:23:41,668::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-424::DEBUG::2013-03-01 14:23:41,668::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-424::DEBUG::2013-03-01 14:23:41,669::task::957::TaskManager.Task::(_decref) Task=`0a9590bb-fd50-4228-b6b7-c2ca2049eaaa`::ref 0 aborting False >Dummy-195::DEBUG::2013-03-01 14:23:41,713::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162374 s, 6.3 MB/s\n'; <rc> = 0 >Thread-425::DEBUG::2013-03-01 14:23:41,725::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-425::DEBUG::2013-03-01 14:23:41,726::task::568::TaskManager.Task::(_updateState) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::moving from state init -> state preparing >Thread-425::INFO::2013-03-01 14:23:41,727::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-425::DEBUG::2013-03-01 14:23:41,728::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`798d4dca-fce9-490f-a8c0-77068a4222fd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-425::DEBUG::2013-03-01 14:23:41,728::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-425::DEBUG::2013-03-01 14:23:41,729::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-425::DEBUG::2013-03-01 14:23:41,729::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`798d4dca-fce9-490f-a8c0-77068a4222fd`::Granted request >Thread-425::DEBUG::2013-03-01 14:23:41,729::task::794::TaskManager.Task::(resourceAcquired) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-425::DEBUG::2013-03-01 14:23:41,729::task::957::TaskManager.Task::(_decref) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::ref 1 aborting False >Thread-425::DEBUG::2013-03-01 14:23:41,730::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70`ReqID=`aa360a60-7164-44fa-b42d-6bc0298e763a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-425::DEBUG::2013-03-01 14:23:41,730::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' for lock type 'exclusive' >Thread-425::DEBUG::2013-03-01 14:23:41,730::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' is free. Now locking as 'exclusive' (1 active user) >Thread-425::DEBUG::2013-03-01 14:23:41,730::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70`ReqID=`aa360a60-7164-44fa-b42d-6bc0298e763a`::Granted request >Thread-425::DEBUG::2013-03-01 14:23:41,731::task::794::TaskManager.Task::(resourceAcquired) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::_resourcesAcquired: Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 (exclusive) >Thread-425::DEBUG::2013-03-01 14:23:41,731::task::957::TaskManager.Task::(_decref) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::ref 1 aborting False >Thread-425::INFO::2013-03-01 14:23:41,731::sp::918::Storage.StoragePool::(attachSD) sdUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 spUUID=8fd46635-c46a-47a7-b122-316b2df29251 >Thread-425::DEBUG::2013-03-01 14:23:41,732::clusterlock::81::SafeLease::(acquireHostId) Host id for domain eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 successfully acquired (id: 1) >Thread-425::DEBUG::2013-03-01 14:23:41,732::clusterlock::95::SafeLease::(acquire) Acquiring cluster lock for domain eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 >Thread-425::DEBUG::2013-03-01 14:23:41,733::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 1 5 /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-10__nfs__2013__03__01__14__11__36__629533/eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Dummy-195::DEBUG::2013-03-01 14:23:43,731::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-425::DEBUG::2013-03-01 14:23:46,367::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-425::DEBUG::2013-03-01 14:23:46,369::clusterlock::112::SafeLease::(acquire) Clustered lock acquired successfully >Thread-425::DEBUG::2013-03-01 14:23:46,380::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=shared-iso-domain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'ROLE=Regular', 'SDUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2d99c84660acef66e086f48d82997edb58f203f8'] >Thread-425::DEBUG::2013-03-01 14:23:46,382::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-425::DEBUG::2013-03-01 14:23:46,384::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-425::DEBUG::2013-03-01 14:23:46,385::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=shared-iso-domain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'ROLE=Regular', 'SDUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=14cc59580a043da5e000b4fbdbfa844e9852ec58'] >Thread-425::DEBUG::2013-03-01 14:23:46,436::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-425::DEBUG::2013-03-01 14:23:46,437::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-425::DEBUG::2013-03-01 14:23:46,439::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-425::DEBUG::2013-03-01 14:23:46,440::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=ca1ef5bafd4c387bf026c6b9d05f5e81e650b491'] >Thread-425::DEBUG::2013-03-01 14:23:46,442::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:46,444::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:46,445::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:46,447::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:46,448::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:46,451::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:23:46,481::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584129 s, 17.5 MB/s\n'; <rc> = 0 >Thread-425::DEBUG::2013-03-01 14:23:46,645::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-425::DEBUG::2013-03-01 14:23:46,647::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:46,647::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=ca1ef5bafd4c387bf026c6b9d05f5e81e650b491, MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active&44&eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active removing=MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active, MDT__SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00 >Thread-425::DEBUG::2013-03-01 14:23:46,648::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --deltag MDT__SHA_CKSUM=30668084bbd83639afe5e8075934931101437d00 --addtag MDT_POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active&44&eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached&44&04bf19fa-db6c-4c8f-845f-b87411d8e898:Active&44&5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active --addtag MDT__SHA_CKSUM=ca1ef5bafd4c387bf026c6b9d05f5e81e650b491 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >MainThread::DEBUG::2013-03-01 14:23:47,369::task::568::TaskManager.Task::(_updateState) Task=`9311a97f-1611-4c8e-b62b-3f190526e9f4`::moving from state init -> state preparing >MainThread::INFO::2013-03-01 14:23:47,369::logUtils::37::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >MainThread::INFO::2013-03-01 14:23:47,369::logUtils::39::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': ['8fd46635-c46a-47a7-b122-316b2df29251']} >MainThread::DEBUG::2013-03-01 14:23:47,369::task::1151::TaskManager.Task::(prepare) Task=`9311a97f-1611-4c8e-b62b-3f190526e9f4`::finished: {'poollist': ['8fd46635-c46a-47a7-b122-316b2df29251']} >MainThread::DEBUG::2013-03-01 14:23:47,370::task::568::TaskManager.Task::(_updateState) Task=`9311a97f-1611-4c8e-b62b-3f190526e9f4`::moving from state preparing -> state finished >MainThread::DEBUG::2013-03-01 14:23:47,370::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-03-01 14:23:47,370::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-03-01 14:23:47,370::task::957::TaskManager.Task::(_decref) Task=`9311a97f-1611-4c8e-b62b-3f190526e9f4`::ref 0 aborting False >MainThread::DEBUG::2013-03-01 14:23:47,371::task::568::TaskManager.Task::(_updateState) Task=`466b0ec9-ffa6-497f-a4c9-2f30bbff8812`::moving from state init -> state preparing >MainThread::INFO::2013-03-01 14:23:47,371::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >MainThread::DEBUG::2013-03-01 14:23:47,372::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b007b506-35ee-4531-9990-d93d6b4a0263`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >MainThread::DEBUG::2013-03-01 14:23:47,372::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >MainThread::DEBUG::2013-03-01 14:23:47,372::resourceManager::510::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is currently locked, Entering queue (1 in queue) >Thread-425::DEBUG::2013-03-01 14:23:47,583::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-425::DEBUG::2013-03-01 14:23:47,583::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:47,584::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-425::DEBUG::2013-03-01 14:23:47,584::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-425::INFO::2013-03-01 14:23:47,584::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.64.106:_export_jenkins-vm-10__nfs__2013__03__01__14__11__36__629533/eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 to /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 >Thread-425::DEBUG::2013-03-01 14:23:47,585::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-425::DEBUG::2013-03-01 14:23:47,586::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-425::DEBUG::2013-03-01 14:23:47,586::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-425::DEBUG::2013-03-01 14:23:47,586::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-425::DEBUG::2013-03-01 14:23:47,586::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=shared-iso-domain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'REMOTE_PATH=10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'ROLE=Regular', 'SDUUID=eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=106538b35ad027eaf45c7a1400cf19ed606779b0'] >Thread-425::DEBUG::2013-03-01 14:23:47,657::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-425::INFO::2013-03-01 14:23:47,657::clusterlock::122::SafeLease::(release) Releasing cluster lock for domain eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 >Thread-425::DEBUG::2013-03-01 14:23:47,657::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' (cwd /usr/libexec/vdsm) >Dummy-195::DEBUG::2013-03-01 14:23:48,495::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-425::DEBUG::2013-03-01 14:23:48,712::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-427::DEBUG::2013-03-01 14:23:49,409::task::568::TaskManager.Task::(_updateState) Task=`974b5c50-6df0-4634-a581-cfd50db6358c`::moving from state init -> state preparing >Thread-229::DEBUG::2013-03-01 14:23:51,566::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:23:51,581::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:23:51,599::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-425::DEBUG::2013-03-01 14:24:11,163::clusterlock::129::SafeLease::(release) Cluster lock released successfully >Thread-427::INFO::2013-03-01 14:24:11,179::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-151::DEBUG::2013-03-01 14:24:11,181::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-425::DEBUG::2013-03-01 14:24:11,182::clusterlock::85::SafeLease::(releaseHostId) Host id for domain eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 released successfully (id: 1) >Thread-151::DEBUG::2013-03-01 14:24:11,186::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-425::DEBUG::2013-03-01 14:24:11,187::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-427::INFO::2013-03-01 14:24:11,187::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '6.76937699318', 'lastCheck': '29.6', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '7.35294294357', 'lastCheck': '29.6', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '7.21514797211', 'lastCheck': '29.6', 'code': 0, 'valid': True}} >Thread-151::DEBUG::2013-03-01 14:24:11,190::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-425::DEBUG::2013-03-01 14:24:11,192::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-427::DEBUG::2013-03-01 14:24:11,194::task::1151::TaskManager.Task::(prepare) Task=`974b5c50-6df0-4634-a581-cfd50db6358c`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '6.76937699318', 'lastCheck': '29.6', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '7.35294294357', 'lastCheck': '29.6', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '7.21514797211', 'lastCheck': '29.6', 'code': 0, 'valid': True}} >Thread-151::DEBUG::2013-03-01 14:24:11,195::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-427::DEBUG::2013-03-01 14:24:11,198::task::568::TaskManager.Task::(_updateState) Task=`974b5c50-6df0-4634-a581-cfd50db6358c`::moving from state preparing -> state finished >Thread-427::DEBUG::2013-03-01 14:24:11,202::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2013-03-01 14:24:11,203::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-427::DEBUG::2013-03-01 14:24:11,205::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2013-03-01 14:24:11,216::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000271086 s, 15.1 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:24:11,221::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292382 s, 14.0 MB/s\n'; <rc> = 0 >Thread-427::DEBUG::2013-03-01 14:24:11,256::task::957::TaskManager.Task::(_decref) Task=`974b5c50-6df0-4634-a581-cfd50db6358c`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 14:24:11,261::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:11,263::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:11,269::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:11,271::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:11,273::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:11,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:11,277::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:11,278::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:24:11,289::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0982965 s, 10.4 MB/s\n'; <rc> = 0 >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:12,381::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:24:13,390::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >MainProcess|Thread-151::DEBUG::2013-03-01 14:24:32,619::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-322::DEBUG::2013-03-01 14:24:21,260::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:24:21,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:24:32,655::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000309047 s, 13.3 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:24:32,660::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000306656 s, 13.4 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:24:32,727::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0619751 s, 16.5 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:34,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:24:34,740::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:24:34,822::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377029 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:24:36,835::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-229::DEBUG::2013-03-01 14:24:42,660::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:24:42,662::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:24:44,606::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028068 s, 14.6 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:24:44,612::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000312816 s, 13.1 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:24:44,678::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630634 s, 16.2 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:24:46,691::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-195::DEBUG::2013-03-01 14:24:46,773::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366977 s, 27.9 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:47,793::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:47,795::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,801::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,802::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,802::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,802::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,803::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,803::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-151::DEBUG::2013-03-01 14:24:47,803::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:47,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:48,056::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:48,058::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,058::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-151::DEBUG::2013-03-01 14:24:48,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:48,066::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000250923 s, 8.2 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:48,066::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000250923 s, 8.2 MB/s'], size: 2048 >Thread-151::DEBUG::2013-03-01 14:24:48,066::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-151::WARNING::2013-03-01 14:24:48,067::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-151::DEBUG::2013-03-01 14:24:48,068::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-151::DEBUG::2013-03-01 14:24:48,068::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,068::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,069::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,069::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,069::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,070::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:48,293::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:48,295::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,296::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=ca1ef5bafd4c387bf026c6b9d05f5e81e650b491'] >Thread-151::DEBUG::2013-03-01 14:24:48,296::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:48,297::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:48,528::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:48,529::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-151::WARNING::2013-03-01 14:24:48,529::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >Thread-151::WARNING::2013-03-01 14:24:48,530::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >Thread-151::WARNING::2013-03-01 14:24:48,530::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >Thread-425::DEBUG::2013-03-01 14:24:48,532::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-151::DEBUG::2013-03-01 14:24:48,534::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-425::INFO::2013-03-01 14:24:48,534::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-425::DEBUG::2013-03-01 14:24:48,543::task::1151::TaskManager.Task::(prepare) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::finished: None >Thread-425::DEBUG::2013-03-01 14:24:48,544::task::568::TaskManager.Task::(_updateState) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::moving from state preparing -> state finished >Thread-425::DEBUG::2013-03-01 14:24:48,544::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': < ResourceRef 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', isValid: 'True' obj: 'None'>} >Thread-425::DEBUG::2013-03-01 14:24:48,544::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-425::DEBUG::2013-03-01 14:24:48,545::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-425::DEBUG::2013-03-01 14:24:48,545::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-425::DEBUG::2013-03-01 14:24:48,546::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-425::DEBUG::2013-03-01 14:24:48,546::resourceManager::568::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' has 1 requests in queue. Handling top request. >Thread-425::DEBUG::2013-03-01 14:24:48,546::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b007b506-35ee-4531-9990-d93d6b4a0263`::Granted request >Thread-425::DEBUG::2013-03-01 14:24:48,547::resourceManager::589::ResourceManager::(releaseResource) Request 'Request for Storage.8fd46635-c46a-47a7-b122-316b2df29251 - exclusive: granted' was granted >Thread-425::DEBUG::2013-03-01 14:24:48,550::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' >MainThread::DEBUG::2013-03-01 14:24:48,549::task::794::TaskManager.Task::(resourceAcquired) Task=`466b0ec9-ffa6-497f-a4c9-2f30bbff8812`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-425::DEBUG::2013-03-01 14:24:48,551::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' (0 active users) >MainThread::DEBUG::2013-03-01 14:24:48,551::task::957::TaskManager.Task::(_decref) Task=`466b0ec9-ffa6-497f-a4c9-2f30bbff8812`::ref 1 aborting False >Thread-425::DEBUG::2013-03-01 14:24:48,552::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' is free, finding out if anyone is waiting for it. >MainThread::DEBUG::2013-03-01 14:24:48,553::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-425::DEBUG::2013-03-01 14:24:48,553::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', Clearing records. >Thread-425::DEBUG::2013-03-01 14:24:48,555::task::957::TaskManager.Task::(_decref) Task=`71e63ed9-fb18-4af5-8d44-26ee5df6d5bb`::ref 0 aborting False >MainThread::DEBUG::2013-03-01 14:24:48,555::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`7c58f3d2-5870-4f83-9aef-b49965839b1f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >MainThread::DEBUG::2013-03-01 14:24:48,556::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >MainThread::DEBUG::2013-03-01 14:24:48,556::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >MainThread::DEBUG::2013-03-01 14:24:48,557::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`7c58f3d2-5870-4f83-9aef-b49965839b1f`::Granted request >MainThread::DEBUG::2013-03-01 14:24:48,557::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' >MainThread::DEBUG::2013-03-01 14:24:48,558::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >MainThread::DEBUG::2013-03-01 14:24:48,558::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >MainThread::DEBUG::2013-03-01 14:24:48,558::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >MainThread::DEBUG::2013-03-01 14:24:48,566::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b205023a-05fc-4d2a-9b84-1732f0a8fe51/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,569::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4c5fc5ef-e7fb-4bee-b39d-516051da8197/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,575::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18fdd5de-f5a2-497c-9a53-396377a77c91/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,580::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/42dfc246-3532-4224-ae8c-fe8f0e55ddae/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,584::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1f7d3f2e-fda8-4308-b99a-d272c7b3aace/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,588::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9eaf9eb-d71c-4dd7-b51d-9c2d3d9f7c0a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,591::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8249e42a-5b09-468d-8118-18aca7afda30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,594::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/26dbe42a-789e-4b28-832a-ddd74cc609e1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,597::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4038c6a9-dbbc-4739-a2e5-a83132aecaf7/master` is not mounted, skipping >Thread-432::DEBUG::2013-03-01 14:24:48,602::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-432::DEBUG::2013-03-01 14:24:48,604::task::568::TaskManager.Task::(_updateState) Task=`9e9d2257-fd95-428b-b1d0-736a3b644f99`::moving from state init -> state preparing >Thread-432::INFO::2013-03-01 14:24:48,606::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-432::INFO::2013-03-01 14:24:48,608::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-432::DEBUG::2013-03-01 14:24:48,609::task::1151::TaskManager.Task::(prepare) Task=`9e9d2257-fd95-428b-b1d0-736a3b644f99`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-432::DEBUG::2013-03-01 14:24:48,611::task::568::TaskManager.Task::(_updateState) Task=`9e9d2257-fd95-428b-b1d0-736a3b644f99`::moving from state preparing -> state finished >Thread-432::DEBUG::2013-03-01 14:24:48,612::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-03-01 14:24:48,614::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/18744da7-6a32-4bad-8a74-640265166e97/master` is not mounted, skipping >Thread-432::DEBUG::2013-03-01 14:24:48,614::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-432::DEBUG::2013-03-01 14:24:48,616::task::957::TaskManager.Task::(_decref) Task=`9e9d2257-fd95-428b-b1d0-736a3b644f99`::ref 0 aborting False >MainThread::DEBUG::2013-03-01 14:24:48,624::sp::353::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master >Thread-433::DEBUG::2013-03-01 14:24:48,654::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-433::DEBUG::2013-03-01 14:24:48,656::task::568::TaskManager.Task::(_updateState) Task=`75dd3595-2730-4c50-970c-053f376f4f11`::moving from state init -> state preparing >Thread-433::INFO::2013-03-01 14:24:48,658::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-433::DEBUG::2013-03-01 14:24:48,661::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`bf2069d5-3e1b-4880-a9cb-febf594cdb10`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-433::DEBUG::2013-03-01 14:24:48,662::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-433::DEBUG::2013-03-01 14:24:48,664::resourceManager::510::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is currently locked, Entering queue (1 in queue) >Thread-151::DEBUG::2013-03-01 14:24:48,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:48,771::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:48,785::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000294245 s, 13.9 MB/s\n'; <rc> = 0 >Dummy-195::DEBUG::2013-03-01 14:24:48,791::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >MainThread::DEBUG::2013-03-01 14:24:48,864::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >MainThread::DEBUG::2013-03-01 14:24:48,937::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c8b38bab-42e2-4b32-aa99-da36878c07b7/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,955::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/de5bb40c-a3cc-40b7-8dbc-e56fc93e1d33/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,968::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f471e6fb-3c95-42b0-be6c-1be90385464c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,983::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a558fc2a-a4a3-4118-9b81-d1d601eaa295/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:48,998::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38c82d38-e773-4c76-8c39-a08f840588d6/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,012::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/56fd57a2-8329-492f-b545-0b048e7c61fe/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,022::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/92e0c501-7501-45d0-8056-e34555252593/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,032::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8488cc76-20f6-4108-812e-fd53be192530/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,044::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8a2891e6-2af8-48e2-8a82-0b61e1b31cb0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,057::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ed34bf1e-3170-4e0e-8527-6bc0c736736e/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,071::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6b9cfb07-2e5e-43da-a1eb-14a0e1ce6bd0/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,085::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/07ae022a-09a1-4f7e-b396-de059bcdc9d8/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,100::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5782aece-60a3-42ed-a549-9fb29eb2e9ef/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,112::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2bbeb81b-9f4f-4986-89b1-10ddbb29582a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,124::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/17771bb8-e4e5-4e57-bc2b-b59947429be4/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,133::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d8750ed1-10a7-4bea-bfc1-f8634caac00a/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,143::sp::353::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master >Dummy-195::DEBUG::2013-03-01 14:24:49,215::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11284 s, 9.1 MB/s\n'; <rc> = 0 >MainThread::DEBUG::2013-03-01 14:24:49,281::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >MainThread::DEBUG::2013-03-01 14:24:49,309::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/551cb787-1f1f-4c72-8771-df0054aa2a50/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,321::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b110d4f4-7475-4999-98e9-20464bb2fc30/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,323::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/38eed165-dd8b-45d1-876d-b2fb3fb878ec/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,324::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9cb448a7-788a-4b66-9d0e-57a4aa432164/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,326::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/46f642bd-86a2-4e82-927d-6af76608252c/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,328::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a721d40f-585f-40c4-92dc-56cf49262ae9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,330::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dd45b000-61b8-4a8e-908d-ba9f91bd92b1/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,331::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f759632b-0256-4554-aca6-84786894c0db/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,333::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c58489cc-f419-4869-bdaa-529de58e88b9/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,335::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78f32116-d7a7-4fa2-ba2a-322a473f933d/master` is not mounted, skipping >MainThread::DEBUG::2013-03-01 14:24:49,335::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >MainThread::DEBUG::2013-03-01 14:24:49,336::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >MainThread::DEBUG::2013-03-01 14:24:49,336::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03'] >MainThread::DEBUG::2013-03-01 14:24:49,336::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >MainThread::DEBUG::2013-03-01 14:24:49,337::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >MainThread::DEBUG::2013-03-01 14:24:49,337::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >MainThread::DEBUG::2013-03-01 14:24:49,337::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >MainThread::DEBUG::2013-03-01 14:24:49,337::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >MainThread::DEBUG::2013-03-01 14:24:49,338::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >MainThread::DEBUG::2013-03-01 14:24:49,596::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-03-01 14:24:50,220::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >MainThread::DEBUG::2013-03-01 14:24:50,221::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03 removing=MDT__SHA_CKSUM=ca1ef5bafd4c387bf026c6b9d05f5e81e650b491, MDT_POOL_SPM_ID=1 >MainThread::DEBUG::2013-03-01 14:24:50,222::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=ca1ef5bafd4c387bf026c6b9d05f5e81e650b491 --addtag MDT__SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03 --addtag MDT_POOL_SPM_ID=-1 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-434::DEBUG::2013-03-01 14:24:50,252::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-434::DEBUG::2013-03-01 14:24:50,253::task::568::TaskManager.Task::(_updateState) Task=`27c7263c-9f9c-47c6-8f77-b846e98df1c9`::moving from state init -> state preparing >Thread-434::INFO::2013-03-01 14:24:50,253::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'a6c88426-a444-41aa-b151-64e128b56890', 'port': ''}], options=None) >Thread-434::INFO::2013-03-01 14:24:50,253::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-434::DEBUG::2013-03-01 14:24:50,253::task::1151::TaskManager.Task::(prepare) Task=`27c7263c-9f9c-47c6-8f77-b846e98df1c9`::finished: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-434::DEBUG::2013-03-01 14:24:50,254::task::568::TaskManager.Task::(_updateState) Task=`27c7263c-9f9c-47c6-8f77-b846e98df1c9`::moving from state preparing -> state finished >Thread-434::DEBUG::2013-03-01 14:24:50,254::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-434::DEBUG::2013-03-01 14:24:50,254::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-434::DEBUG::2013-03-01 14:24:50,254::task::957::TaskManager.Task::(_decref) Task=`27c7263c-9f9c-47c6-8f77-b846e98df1c9`::ref 0 aborting False >Thread-435::DEBUG::2013-03-01 14:24:50,286::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-435::DEBUG::2013-03-01 14:24:50,286::task::568::TaskManager.Task::(_updateState) Task=`e6e49509-0c46-4567-891d-378e8315a840`::moving from state init -> state preparing >Thread-435::INFO::2013-03-01 14:24:50,287::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.64.106:/export/jenkins-vm-10_nfs_2013_03_01_14_11_36_629533', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'a6c88426-a444-41aa-b151-64e128b56890', 'port': ''}], options=None) >Thread-435::INFO::2013-03-01 14:24:50,290::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-435::DEBUG::2013-03-01 14:24:50,291::task::1151::TaskManager.Task::(prepare) Task=`e6e49509-0c46-4567-891d-378e8315a840`::finished: {'statuslist': [{'status': 0, 'id': 'a6c88426-a444-41aa-b151-64e128b56890'}]} >Thread-435::DEBUG::2013-03-01 14:24:50,291::task::568::TaskManager.Task::(_updateState) Task=`e6e49509-0c46-4567-891d-378e8315a840`::moving from state preparing -> state finished >Thread-435::DEBUG::2013-03-01 14:24:50,291::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-435::DEBUG::2013-03-01 14:24:50,291::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-435::DEBUG::2013-03-01 14:24:50,292::task::957::TaskManager.Task::(_decref) Task=`e6e49509-0c46-4567-891d-378e8315a840`::ref 0 aborting False >MainThread::DEBUG::2013-03-01 14:24:50,650::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-03-01 14:24:50,650::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >MainThread::DEBUG::2013-03-01 14:24:50,651::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >MainThread::DEBUG::2013-03-01 14:24:50,651::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >MainThread::INFO::2013-03-01 14:24:50,651::clusterlock::252::SANLock::(release) Releasing cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >MainThread::DEBUG::2013-03-01 14:24:50,653::clusterlock::263::SANLock::(release) Cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully released >MainThread::INFO::2013-03-01 14:24:50,653::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >MainThread::DEBUG::2013-03-01 14:24:50,653::task::1151::TaskManager.Task::(prepare) Task=`466b0ec9-ffa6-497f-a4c9-2f30bbff8812`::finished: None >MainThread::DEBUG::2013-03-01 14:24:50,654::task::568::TaskManager.Task::(_updateState) Task=`466b0ec9-ffa6-497f-a4c9-2f30bbff8812`::moving from state preparing -> state finished >MainThread::DEBUG::2013-03-01 14:24:50,654::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >MainThread::DEBUG::2013-03-01 14:24:50,654::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-03-01 14:24:50,654::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >MainThread::DEBUG::2013-03-01 14:24:50,655::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >MainThread::DEBUG::2013-03-01 14:24:50,655::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >MainThread::DEBUG::2013-03-01 14:24:50,655::resourceManager::568::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' has 1 requests in queue. Handling top request. >MainThread::DEBUG::2013-03-01 14:24:50,655::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`bf2069d5-3e1b-4880-a9cb-febf594cdb10`::Granted request >MainThread::DEBUG::2013-03-01 14:24:50,656::resourceManager::589::ResourceManager::(releaseResource) Request 'Request for Storage.8fd46635-c46a-47a7-b122-316b2df29251 - shared: granted' was granted >MainThread::DEBUG::2013-03-01 14:24:50,656::resourceManager::597::ResourceManager::(releaseResource) This is a shared lock. Granting all shared requests >MainThread::DEBUG::2013-03-01 14:24:50,657::task::957::TaskManager.Task::(_decref) Task=`466b0ec9-ffa6-497f-a4c9-2f30bbff8812`::ref 0 aborting False >Thread-433::DEBUG::2013-03-01 14:24:50,657::task::794::TaskManager.Task::(resourceAcquired) Task=`75dd3595-2730-4c50-970c-053f376f4f11`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-433::DEBUG::2013-03-01 14:24:50,658::task::957::TaskManager.Task::(_decref) Task=`75dd3595-2730-4c50-970c-053f376f4f11`::ref 1 aborting False >Thread-433::DEBUG::2013-03-01 14:24:50,658::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-433::DEBUG::2013-03-01 14:24:50,659::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-433::DEBUG::2013-03-01 14:24:50,898::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-433::DEBUG::2013-03-01 14:24:50,900::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-433::INFO::2013-03-01 14:24:50,901::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': -1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-433::DEBUG::2013-03-01 14:24:50,901::task::1151::TaskManager.Task::(prepare) Task=`75dd3595-2730-4c50-970c-053f376f4f11`::finished: {'info': {'spm_id': -1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-433::DEBUG::2013-03-01 14:24:50,901::task::568::TaskManager.Task::(_updateState) Task=`75dd3595-2730-4c50-970c-053f376f4f11`::moving from state preparing -> state finished >Thread-433::DEBUG::2013-03-01 14:24:50,902::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-433::DEBUG::2013-03-01 14:24:50,902::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-433::DEBUG::2013-03-01 14:24:50,902::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-433::DEBUG::2013-03-01 14:24:50,903::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-433::DEBUG::2013-03-01 14:24:50,903::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-433::DEBUG::2013-03-01 14:24:50,903::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-433::DEBUG::2013-03-01 14:24:50,904::task::957::TaskManager.Task::(_decref) Task=`75dd3595-2730-4c50-970c-053f376f4f11`::ref 0 aborting False >Thread-437::DEBUG::2013-03-01 14:24:50,961::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-437::DEBUG::2013-03-01 14:24:50,962::task::568::TaskManager.Task::(_updateState) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::moving from state init -> state preparing >Thread-437::INFO::2013-03-01 14:24:50,962::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-437::DEBUG::2013-03-01 14:24:50,963::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`3703046a-3e97-4920-92ce-714d0ccefc75`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-437::DEBUG::2013-03-01 14:24:50,963::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-437::DEBUG::2013-03-01 14:24:50,963::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-437::DEBUG::2013-03-01 14:24:50,964::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`3703046a-3e97-4920-92ce-714d0ccefc75`::Granted request >Thread-437::DEBUG::2013-03-01 14:24:50,964::task::794::TaskManager.Task::(resourceAcquired) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-437::DEBUG::2013-03-01 14:24:50,964::task::957::TaskManager.Task::(_decref) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::ref 1 aborting False >Thread-437::DEBUG::2013-03-01 14:24:50,965::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70`ReqID=`22132787-3da1-43ef-ae5e-06a403b67a21`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-437::DEBUG::2013-03-01 14:24:50,965::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' for lock type 'exclusive' >Thread-437::DEBUG::2013-03-01 14:24:50,966::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' is free. Now locking as 'exclusive' (1 active user) >Thread-437::DEBUG::2013-03-01 14:24:50,966::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70`ReqID=`22132787-3da1-43ef-ae5e-06a403b67a21`::Granted request >Thread-437::DEBUG::2013-03-01 14:24:50,966::task::794::TaskManager.Task::(resourceAcquired) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::_resourcesAcquired: Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70 (exclusive) >Thread-437::DEBUG::2013-03-01 14:24:50,967::task::957::TaskManager.Task::(_decref) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::ref 1 aborting False >Thread-437::ERROR::2013-03-01 14:24:50,967::task::833::TaskManager.Task::(_setError) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 1142, in activateStorageDomain > pool.activateSD(sdUUID) > File "/usr/share/vdsm/storage/securable.py", line 66, in wrapper > raise SecureError() >SecureError >Thread-437::DEBUG::2013-03-01 14:24:50,969::task::852::TaskManager.Task::(_run) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::Task._run: 6231aea0-2f53-419e-b577-5d12334cbdcb ('eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', '8fd46635-c46a-47a7-b122-316b2df29251') {} failed - stopping task >Thread-437::DEBUG::2013-03-01 14:24:50,969::task::1177::TaskManager.Task::(stop) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::stopping in state preparing (force False) >Thread-437::DEBUG::2013-03-01 14:24:50,970::task::957::TaskManager.Task::(_decref) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::ref 1 aborting True >Thread-437::INFO::2013-03-01 14:24:50,970::task::1134::TaskManager.Task::(prepare) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::aborting: Task is aborted: u'' - code 100 >Thread-437::DEBUG::2013-03-01 14:24:50,970::task::1139::TaskManager.Task::(prepare) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::Prepare: aborted: >Thread-437::DEBUG::2013-03-01 14:24:50,971::task::957::TaskManager.Task::(_decref) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::ref 0 aborting True >Thread-437::DEBUG::2013-03-01 14:24:50,971::task::892::TaskManager.Task::(_doAbort) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::Task._doAbort: force False >Thread-437::DEBUG::2013-03-01 14:24:50,971::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-437::DEBUG::2013-03-01 14:24:50,971::task::568::TaskManager.Task::(_updateState) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::moving from state preparing -> state aborting >Thread-437::DEBUG::2013-03-01 14:24:50,971::task::523::TaskManager.Task::(__state_aborting) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::_aborting: recover policy none >Thread-437::DEBUG::2013-03-01 14:24:50,972::task::568::TaskManager.Task::(_updateState) Task=`6231aea0-2f53-419e-b577-5d12334cbdcb`::moving from state aborting -> state failed >Thread-437::DEBUG::2013-03-01 14:24:50,972::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>, 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': < ResourceRef 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', isValid: 'True' obj: 'None'>} >Thread-437::DEBUG::2013-03-01 14:24:50,972::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-437::DEBUG::2013-03-01 14:24:50,972::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-437::DEBUG::2013-03-01 14:24:50,973::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-437::DEBUG::2013-03-01 14:24:50,973::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-437::DEBUG::2013-03-01 14:24:50,973::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-437::DEBUG::2013-03-01 14:24:50,974::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' >Thread-437::DEBUG::2013-03-01 14:24:50,974::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' (0 active users) >Thread-437::DEBUG::2013-03-01 14:24:50,974::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70' is free, finding out if anyone is waiting for it. >Thread-437::DEBUG::2013-03-01 14:24:50,974::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70', Clearing records. >Thread-437::ERROR::2013-03-01 14:24:50,975::dispatcher::69::Storage.Dispatcher.Protect::(run) >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 61, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 1142, in prepare > raise self.error >SecureError >Dummy-195::INFO::2013-03-01 14:24:53,483::storage_mailbox::692::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-438::DEBUG::2013-03-01 14:24:53,730::task::568::TaskManager.Task::(_updateState) Task=`91add158-c404-4c89-8e8a-bfd08c6615f4`::moving from state init -> state preparing >Thread-438::INFO::2013-03-01 14:24:53,736::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-438::INFO::2013-03-01 14:24:53,737::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '1.95068216324', 'lastCheck': '9.1', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '1.94774603844', 'lastCheck': '9.1', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0170521736145', 'lastCheck': '4.9', 'code': 0, 'valid': True}} >Thread-438::DEBUG::2013-03-01 14:24:53,737::task::1151::TaskManager.Task::(prepare) Task=`91add158-c404-4c89-8e8a-bfd08c6615f4`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '1.95068216324', 'lastCheck': '9.1', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '1.94774603844', 'lastCheck': '9.1', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0170521736145', 'lastCheck': '4.9', 'code': 0, 'valid': True}} >Thread-438::DEBUG::2013-03-01 14:24:53,737::task::568::TaskManager.Task::(_updateState) Task=`91add158-c404-4c89-8e8a-bfd08c6615f4`::moving from state preparing -> state finished >Thread-438::DEBUG::2013-03-01 14:24:53,737::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-438::DEBUG::2013-03-01 14:24:53,738::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-438::DEBUG::2013-03-01 14:24:53,738::task::957::TaskManager.Task::(_decref) Task=`91add158-c404-4c89-8e8a-bfd08c6615f4`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:24:54,611::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:24:54,612::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-322::DEBUG::2013-03-01 14:24:54,618::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-322::DEBUG::2013-03-01 14:24:54,619::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-322::DEBUG::2013-03-01 14:24:54,845::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:24:54,847::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:24:54,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000283003 s, 14.5 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:24:54,860::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:24:54,861::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:24:54,861::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:24:54,868::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000337308 s, 12.1 MB/s\n'; <rc> = 0 >Thread-441::DEBUG::2013-03-01 14:24:58,420::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-441::DEBUG::2013-03-01 14:24:58,420::task::568::TaskManager.Task::(_updateState) Task=`35121e5b-bfe4-4ba7-884d-d0c238aa256a`::moving from state init -> state preparing >Thread-441::INFO::2013-03-01 14:24:58,421::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-441::INFO::2013-03-01 14:24:58,421::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-441::DEBUG::2013-03-01 14:24:58,421::task::1151::TaskManager.Task::(prepare) Task=`35121e5b-bfe4-4ba7-884d-d0c238aa256a`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-441::DEBUG::2013-03-01 14:24:58,421::task::568::TaskManager.Task::(_updateState) Task=`35121e5b-bfe4-4ba7-884d-d0c238aa256a`::moving from state preparing -> state finished >Thread-441::DEBUG::2013-03-01 14:24:58,422::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-441::DEBUG::2013-03-01 14:24:58,422::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-441::DEBUG::2013-03-01 14:24:58,422::task::957::TaskManager.Task::(_decref) Task=`35121e5b-bfe4-4ba7-884d-d0c238aa256a`::ref 0 aborting False >Thread-442::DEBUG::2013-03-01 14:24:58,456::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-442::DEBUG::2013-03-01 14:24:58,457::task::568::TaskManager.Task::(_updateState) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::moving from state init -> state preparing >Thread-442::INFO::2013-03-01 14:24:58,457::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-442::DEBUG::2013-03-01 14:24:58,457::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`71db7d4c-77d6-4686-91f0-a7fc656a52f7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-442::DEBUG::2013-03-01 14:24:58,457::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >Thread-442::DEBUG::2013-03-01 14:24:58,458::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >Thread-442::DEBUG::2013-03-01 14:24:58,458::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`71db7d4c-77d6-4686-91f0-a7fc656a52f7`::Granted request >Thread-442::DEBUG::2013-03-01 14:24:58,459::task::794::TaskManager.Task::(resourceAcquired) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (exclusive) >Thread-442::DEBUG::2013-03-01 14:24:58,459::task::957::TaskManager.Task::(_decref) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::ref 1 aborting False >Thread-442::INFO::2013-03-01 14:24:58,459::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-442::DEBUG::2013-03-01 14:24:58,459::task::1146::TaskManager.Task::(prepare) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::Prepare: 1 jobs exist, move to acquiring >Thread-442::DEBUG::2013-03-01 14:24:58,460::task::568::TaskManager.Task::(_updateState) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::moving from state preparing -> state acquiring >Thread-442::DEBUG::2013-03-01 14:24:58,460::task::568::TaskManager.Task::(_updateState) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::moving from state acquiring -> state queued >Thread-442::DEBUG::2013-03-01 14:24:58,460::taskManager::50::TaskManager::(_queueTask) queuing task: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-442::DEBUG::2013-03-01 14:24:58,460::taskManager::56::TaskManager::(_queueTask) task queued: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-10::DEBUG::2013-03-01 14:24:58,460::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-442::DEBUG::2013-03-01 14:24:58,461::task::1148::TaskManager.Task::(prepare) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::returning >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,461::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: c7d77fc5-8b9d-4b52-b2cd-0821de628aba running: <bound method Task.commit of <storage.task.Task instance at 0x7fcf54104ef0>> with: None >Thread-442::DEBUG::2013-03-01 14:24:58,461::task::957::TaskManager.Task::(_decref) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,462::task::1159::TaskManager.Task::(commit) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::committing task: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,463::task::568::TaskManager.Task::(_updateState) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::moving from state queued -> state running >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,463::task::872::TaskManager.Task::(_runJobs) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fcf28045450>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,463::task::304::TaskManager.Task::(run) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fcf28045450>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,464::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,464::misc::1055::SamplingMethod::(__call__) Got in to sampling method >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,464::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,464::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,465::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,465::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,465::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,466::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,725::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,727::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,728::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03', 'POOL_SPM_ID=-1'] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,728::misc::1063::SamplingMethod::(__call__) Returning last result >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,729::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,729::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,730::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,730::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,730::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:58,841::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-151::DEBUG::2013-03-01 14:24:58,842::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,989::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,991::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03', 'POOL_SPM_ID=-1'] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::INFO::2013-03-01 14:24:58,992::clusterlock::173::SANLock::(acquireHostId) Acquiring host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 1) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,993::clusterlock::191::SANLock::(acquireHostId) Host id for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 1) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:24:58,993::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images already exists >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:24:58,994::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/dom_md already exists >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:58,994::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-151::DEBUG::2013-03-01 14:24:59,087::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:59,089::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,090::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:59,090::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:59,100::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000264234 s, 15.5 MB/s\n'; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,100::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:24:59,101::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,102::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-151::DEBUG::2013-03-01 14:24:59,103::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-151::DEBUG::2013-03-01 14:24:59,314::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:24:59,316::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,317::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,320::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,323::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,327::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,334::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000237381 s, 8.6 MB/s\n'; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,335::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000237381 s, 8.6 MB/s'], size: 2048 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,335::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:24:59,335::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,335::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,336::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,336::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,336::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,336::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,337::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-443::DEBUG::2013-03-01 14:24:59,492::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-443::DEBUG::2013-03-01 14:24:59,492::task::568::TaskManager.Task::(_updateState) Task=`5bb89116-983e-4bc0-a8a8-5625958e4cc6`::moving from state init -> state preparing >Thread-443::INFO::2013-03-01 14:24:59,493::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-443::DEBUG::2013-03-01 14:24:59,493::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-443::DEBUG::2013-03-01 14:24:59,493::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-443::INFO::2013-03-01 14:24:59,493::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-443::DEBUG::2013-03-01 14:24:59,493::task::1151::TaskManager.Task::(prepare) Task=`5bb89116-983e-4bc0-a8a8-5625958e4cc6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-443::DEBUG::2013-03-01 14:24:59,494::task::568::TaskManager.Task::(_updateState) Task=`5bb89116-983e-4bc0-a8a8-5625958e4cc6`::moving from state preparing -> state finished >Thread-443::DEBUG::2013-03-01 14:24:59,494::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-443::DEBUG::2013-03-01 14:24:59,494::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-443::DEBUG::2013-03-01 14:24:59,494::task::957::TaskManager.Task::(_decref) Task=`5bb89116-983e-4bc0-a8a8-5625958e4cc6`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,538::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,539::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,540::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03', 'POOL_SPM_ID=-1'] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::INFO::2013-03-01 14:24:59,540::clusterlock::224::SANLock::(acquire) Acquiring cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de (id: 1) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,549::clusterlock::248::SANLock::(acquire) Cluster lock for domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de successfully acquired (id: 1) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,549::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,550::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,550::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,550::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,551::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,551::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,743::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,745::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,745::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', '_SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03', 'POOL_SPM_ID=-1'] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,745::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,746::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,746::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=iscsiStorageTest', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'ROLE=Master', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', '_SHA_CKSUM=5029bd0c0b3b10ecde73750144b6d864017035c7'] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,746::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,747::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,747::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,747::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,747::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,748::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,955::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,957::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,957::blockSD::299::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=5029bd0c0b3b10ecde73750144b6d864017035c7, MDT_POOL_SPM_LVER=1, MDT_POOL_SPM_ID=1 removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=0, MDT__SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:24:59,958::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=e377d1b72db68e7a4d92deb41d2a9348fbc4eb03 --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=0 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=5029bd0c0b3b10ecde73750144b6d864017035c7 --addtag MDT_POOL_SPM_LVER=1 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-445::DEBUG::2013-03-01 14:25:00,526::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-445::DEBUG::2013-03-01 14:25:00,526::task::568::TaskManager.Task::(_updateState) Task=`acdbb1d7-483d-42cd-90af-46203ec5cc19`::moving from state init -> state preparing >Thread-445::INFO::2013-03-01 14:25:00,527::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-445::DEBUG::2013-03-01 14:25:00,527::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-445::DEBUG::2013-03-01 14:25:00,527::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-445::INFO::2013-03-01 14:25:00,527::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-445::DEBUG::2013-03-01 14:25:00,528::task::1151::TaskManager.Task::(prepare) Task=`acdbb1d7-483d-42cd-90af-46203ec5cc19`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-445::DEBUG::2013-03-01 14:25:00,528::task::568::TaskManager.Task::(_updateState) Task=`acdbb1d7-483d-42cd-90af-46203ec5cc19`::moving from state preparing -> state finished >Thread-445::DEBUG::2013-03-01 14:25:00,528::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-445::DEBUG::2013-03-01 14:25:00,528::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-445::DEBUG::2013-03-01 14:25:00,528::task::957::TaskManager.Task::(_decref) Task=`acdbb1d7-483d-42cd-90af-46203ec5cc19`::ref 0 aborting False >Thread-446::DEBUG::2013-03-01 14:25:01,557::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-446::DEBUG::2013-03-01 14:25:01,558::task::568::TaskManager.Task::(_updateState) Task=`53540f2d-60b3-48e6-b24e-a5582e611814`::moving from state init -> state preparing >Thread-446::INFO::2013-03-01 14:25:01,558::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-446::DEBUG::2013-03-01 14:25:01,559::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-446::DEBUG::2013-03-01 14:25:01,559::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-446::INFO::2013-03-01 14:25:01,559::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-446::DEBUG::2013-03-01 14:25:01,559::task::1151::TaskManager.Task::(prepare) Task=`53540f2d-60b3-48e6-b24e-a5582e611814`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-446::DEBUG::2013-03-01 14:25:01,560::task::568::TaskManager.Task::(_updateState) Task=`53540f2d-60b3-48e6-b24e-a5582e611814`::moving from state preparing -> state finished >Thread-446::DEBUG::2013-03-01 14:25:01,560::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-446::DEBUG::2013-03-01 14:25:01,560::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-446::DEBUG::2013-03-01 14:25:01,560::task::957::TaskManager.Task::(_decref) Task=`53540f2d-60b3-48e6-b24e-a5582e611814`::ref 0 aborting False >Thread-447::DEBUG::2013-03-01 14:25:02,589::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-447::DEBUG::2013-03-01 14:25:04,013::task::568::TaskManager.Task::(_updateState) Task=`ed433102-4531-4587-85fd-fccc54d20ed9`::moving from state init -> state preparing >Thread-447::INFO::2013-03-01 14:25:04,014::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-447::DEBUG::2013-03-01 14:25:04,014::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-447::DEBUG::2013-03-01 14:25:04,014::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-447::INFO::2013-03-01 14:25:04,014::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-447::DEBUG::2013-03-01 14:25:04,014::task::1151::TaskManager.Task::(prepare) Task=`ed433102-4531-4587-85fd-fccc54d20ed9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-447::DEBUG::2013-03-01 14:25:04,015::task::568::TaskManager.Task::(_updateState) Task=`ed433102-4531-4587-85fd-fccc54d20ed9`::moving from state preparing -> state finished >Thread-447::DEBUG::2013-03-01 14:25:04,015::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-447::DEBUG::2013-03-01 14:25:04,015::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-447::DEBUG::2013-03-01 14:25:04,015::task::957::TaskManager.Task::(_decref) Task=`ed433102-4531-4587-85fd-fccc54d20ed9`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:25:04,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:25:04,865::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000425274 s, 9.6 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:25:04,872::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:25:04,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292291 s, 14.0 MB/s\n'; <rc> = 0 >Thread-449::DEBUG::2013-03-01 14:25:05,045::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-449::DEBUG::2013-03-01 14:25:05,046::task::568::TaskManager.Task::(_updateState) Task=`5ae69395-4c91-4d2e-8cf9-8a8f20af0609`::moving from state init -> state preparing >Thread-449::INFO::2013-03-01 14:25:05,046::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-449::DEBUG::2013-03-01 14:25:05,046::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-449::DEBUG::2013-03-01 14:25:05,046::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-449::INFO::2013-03-01 14:25:05,046::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-449::DEBUG::2013-03-01 14:25:05,047::task::1151::TaskManager.Task::(prepare) Task=`5ae69395-4c91-4d2e-8cf9-8a8f20af0609`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-449::DEBUG::2013-03-01 14:25:05,047::task::568::TaskManager.Task::(_updateState) Task=`5ae69395-4c91-4d2e-8cf9-8a8f20af0609`::moving from state preparing -> state finished >Thread-449::DEBUG::2013-03-01 14:25:05,047::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-449::DEBUG::2013-03-01 14:25:05,047::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-449::DEBUG::2013-03-01 14:25:05,047::task::957::TaskManager.Task::(_decref) Task=`5ae69395-4c91-4d2e-8cf9-8a8f20af0609`::ref 0 aborting False >Thread-451::DEBUG::2013-03-01 14:25:06,076::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-451::DEBUG::2013-03-01 14:25:06,076::task::568::TaskManager.Task::(_updateState) Task=`fbbbc926-84a6-429c-9c10-a5ee5090431d`::moving from state init -> state preparing >Thread-451::INFO::2013-03-01 14:25:06,077::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-451::DEBUG::2013-03-01 14:25:06,077::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-451::DEBUG::2013-03-01 14:25:06,077::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-451::INFO::2013-03-01 14:25:06,077::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-451::DEBUG::2013-03-01 14:25:06,077::task::1151::TaskManager.Task::(prepare) Task=`fbbbc926-84a6-429c-9c10-a5ee5090431d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-451::DEBUG::2013-03-01 14:25:06,077::task::568::TaskManager.Task::(_updateState) Task=`fbbbc926-84a6-429c-9c10-a5ee5090431d`::moving from state preparing -> state finished >Thread-451::DEBUG::2013-03-01 14:25:06,078::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-451::DEBUG::2013-03-01 14:25:06,078::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-451::DEBUG::2013-03-01 14:25:06,078::task::957::TaskManager.Task::(_decref) Task=`fbbbc926-84a6-429c-9c10-a5ee5090431d`::ref 0 aborting False >Thread-452::DEBUG::2013-03-01 14:25:07,105::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-452::DEBUG::2013-03-01 14:25:07,106::task::568::TaskManager.Task::(_updateState) Task=`7aa03c64-34d6-4d1c-b767-1959df83adef`::moving from state init -> state preparing >Thread-452::INFO::2013-03-01 14:25:07,106::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-452::DEBUG::2013-03-01 14:25:07,106::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-452::DEBUG::2013-03-01 14:25:07,106::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-452::INFO::2013-03-01 14:25:07,107::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-452::DEBUG::2013-03-01 14:25:07,107::task::1151::TaskManager.Task::(prepare) Task=`7aa03c64-34d6-4d1c-b767-1959df83adef`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-452::DEBUG::2013-03-01 14:25:07,107::task::568::TaskManager.Task::(_updateState) Task=`7aa03c64-34d6-4d1c-b767-1959df83adef`::moving from state preparing -> state finished >Thread-452::DEBUG::2013-03-01 14:25:07,107::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-452::DEBUG::2013-03-01 14:25:07,107::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-452::DEBUG::2013-03-01 14:25:07,107::task::957::TaskManager.Task::(_decref) Task=`7aa03c64-34d6-4d1c-b767-1959df83adef`::ref 0 aborting False >Thread-453::DEBUG::2013-03-01 14:25:08,135::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-453::DEBUG::2013-03-01 14:25:08,136::task::568::TaskManager.Task::(_updateState) Task=`b5d85f7f-080e-47c8-b99c-09f6eedd1f36`::moving from state init -> state preparing >Thread-453::INFO::2013-03-01 14:25:08,136::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-453::DEBUG::2013-03-01 14:25:08,136::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-453::DEBUG::2013-03-01 14:25:08,136::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-453::INFO::2013-03-01 14:25:08,136::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-453::DEBUG::2013-03-01 14:25:08,137::task::1151::TaskManager.Task::(prepare) Task=`b5d85f7f-080e-47c8-b99c-09f6eedd1f36`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-453::DEBUG::2013-03-01 14:25:08,137::task::568::TaskManager.Task::(_updateState) Task=`b5d85f7f-080e-47c8-b99c-09f6eedd1f36`::moving from state preparing -> state finished >Thread-453::DEBUG::2013-03-01 14:25:08,137::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-453::DEBUG::2013-03-01 14:25:08,137::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-453::DEBUG::2013-03-01 14:25:08,137::task::957::TaskManager.Task::(_decref) Task=`b5d85f7f-080e-47c8-b99c-09f6eedd1f36`::ref 0 aborting False >Thread-454::DEBUG::2013-03-01 14:25:09,029::task::568::TaskManager.Task::(_updateState) Task=`43b878c9-3490-4aa0-8f59-932464a2154f`::moving from state init -> state preparing >Thread-454::INFO::2013-03-01 14:25:09,029::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-454::INFO::2013-03-01 14:25:09,029::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.00938200950623', 'lastCheck': '4.2', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00788593292236', 'lastCheck': '4.1', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0110669136047', 'lastCheck': '9.7', 'code': 0, 'valid': True}} >Thread-454::DEBUG::2013-03-01 14:25:09,029::task::1151::TaskManager.Task::(prepare) Task=`43b878c9-3490-4aa0-8f59-932464a2154f`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.00938200950623', 'lastCheck': '4.2', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00788593292236', 'lastCheck': '4.1', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0110669136047', 'lastCheck': '9.7', 'code': 0, 'valid': True}} >Thread-454::DEBUG::2013-03-01 14:25:09,030::task::568::TaskManager.Task::(_updateState) Task=`43b878c9-3490-4aa0-8f59-932464a2154f`::moving from state preparing -> state finished >Thread-454::DEBUG::2013-03-01 14:25:09,030::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-454::DEBUG::2013-03-01 14:25:09,030::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-454::DEBUG::2013-03-01 14:25:09,030::task::957::TaskManager.Task::(_decref) Task=`43b878c9-3490-4aa0-8f59-932464a2154f`::ref 0 aborting False >Thread-456::DEBUG::2013-03-01 14:25:09,165::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-456::DEBUG::2013-03-01 14:25:09,166::task::568::TaskManager.Task::(_updateState) Task=`412f507e-3722-4270-a394-5aee387e2473`::moving from state init -> state preparing >Thread-456::INFO::2013-03-01 14:25:09,166::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-456::DEBUG::2013-03-01 14:25:09,166::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-456::DEBUG::2013-03-01 14:25:09,166::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-456::INFO::2013-03-01 14:25:09,166::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-456::DEBUG::2013-03-01 14:25:09,167::task::1151::TaskManager.Task::(prepare) Task=`412f507e-3722-4270-a394-5aee387e2473`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-456::DEBUG::2013-03-01 14:25:09,167::task::568::TaskManager.Task::(_updateState) Task=`412f507e-3722-4270-a394-5aee387e2473`::moving from state preparing -> state finished >Thread-456::DEBUG::2013-03-01 14:25:09,167::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-456::DEBUG::2013-03-01 14:25:09,167::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-456::DEBUG::2013-03-01 14:25:09,167::task::957::TaskManager.Task::(_decref) Task=`412f507e-3722-4270-a394-5aee387e2473`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 14:25:09,334::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:25:09,342::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000378071 s, 10.8 MB/s\n'; <rc> = 0 >Thread-457::DEBUG::2013-03-01 14:25:10,196::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-457::DEBUG::2013-03-01 14:25:10,197::task::568::TaskManager.Task::(_updateState) Task=`12b1ced2-714e-4cb5-ae1e-f47fe2dd317e`::moving from state init -> state preparing >Thread-457::INFO::2013-03-01 14:25:10,197::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-457::DEBUG::2013-03-01 14:25:10,197::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-457::DEBUG::2013-03-01 14:25:10,197::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-457::INFO::2013-03-01 14:25:10,198::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-457::DEBUG::2013-03-01 14:25:10,198::task::1151::TaskManager.Task::(prepare) Task=`12b1ced2-714e-4cb5-ae1e-f47fe2dd317e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-457::DEBUG::2013-03-01 14:25:10,198::task::568::TaskManager.Task::(_updateState) Task=`12b1ced2-714e-4cb5-ae1e-f47fe2dd317e`::moving from state preparing -> state finished >Thread-457::DEBUG::2013-03-01 14:25:10,198::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-457::DEBUG::2013-03-01 14:25:10,198::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-457::DEBUG::2013-03-01 14:25:10,199::task::957::TaskManager.Task::(_decref) Task=`12b1ced2-714e-4cb5-ae1e-f47fe2dd317e`::ref 0 aborting False >Thread-458::DEBUG::2013-03-01 14:25:11,228::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-458::DEBUG::2013-03-01 14:25:12,501::task::568::TaskManager.Task::(_updateState) Task=`c8461cba-ab6a-450a-9fba-a393b35bf6b5`::moving from state init -> state preparing >Thread-458::INFO::2013-03-01 14:25:12,502::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-458::DEBUG::2013-03-01 14:25:12,502::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-458::DEBUG::2013-03-01 14:25:12,502::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-458::INFO::2013-03-01 14:25:12,502::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-458::DEBUG::2013-03-01 14:25:12,502::task::1151::TaskManager.Task::(prepare) Task=`c8461cba-ab6a-450a-9fba-a393b35bf6b5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-458::DEBUG::2013-03-01 14:25:12,503::task::568::TaskManager.Task::(_updateState) Task=`c8461cba-ab6a-450a-9fba-a393b35bf6b5`::moving from state preparing -> state finished >Thread-458::DEBUG::2013-03-01 14:25:12,503::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-458::DEBUG::2013-03-01 14:25:12,503::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-458::DEBUG::2013-03-01 14:25:12,503::task::957::TaskManager.Task::(_decref) Task=`c8461cba-ab6a-450a-9fba-a393b35bf6b5`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,690::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,690::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,691::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,691::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,693::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`eb442f2c-9a3b-47c4-98c5-3fd8548c3d4d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,693::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'exclusive' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,695::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'exclusive' (1 active user) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,695::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`eb442f2c-9a3b-47c4-98c5-3fd8548c3d4d`::Granted request >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::INFO::2013-03-01 14:25:12,697::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `5dd04e7f-8474-4d0a-ae61-24f8fd2556de` >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,699::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`65dc218e-42f8-4d1d-a34e-d202b2b975ab`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,699::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' for lock type 'exclusive' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,700::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free. Now locking as 'exclusive' (1 active user) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,700::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`65dc218e-42f8-4d1d-a34e-d202b2b975ab`::Granted request >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,701::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,701::misc::1055::SamplingMethod::(__call__) Got in to sampling method >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,701::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,702::misc::1055::SamplingMethod::(__call__) Got in to sampling method >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,702::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,732::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,732::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:12,735::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-460::DEBUG::2013-03-01 14:25:13,532::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:13,738::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-322::DEBUG::2013-03-01 14:25:14,866::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:25:14,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:43,438::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-460::DEBUG::2013-03-01 14:25:43,435::task::568::TaskManager.Task::(_updateState) Task=`8a84f4c8-565c-4379-aefe-14d7043849f4`::moving from state init -> state preparing >Thread-460::INFO::2013-03-01 14:25:43,453::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-460::DEBUG::2013-03-01 14:25:43,456::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-460::DEBUG::2013-03-01 14:25:43,458::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-460::INFO::2013-03-01 14:25:43,460::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-460::DEBUG::2013-03-01 14:25:43,461::task::1151::TaskManager.Task::(prepare) Task=`8a84f4c8-565c-4379-aefe-14d7043849f4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-460::DEBUG::2013-03-01 14:25:43,463::task::568::TaskManager.Task::(_updateState) Task=`8a84f4c8-565c-4379-aefe-14d7043849f4`::moving from state preparing -> state finished >Thread-460::DEBUG::2013-03-01 14:25:43,464::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-229::DEBUG::2013-03-01 14:25:43,464::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000251167 s, 16.3 MB/s\n'; <rc> = 0 >Thread-460::DEBUG::2013-03-01 14:25:43,466::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-460::DEBUG::2013-03-01 14:25:43,467::task::957::TaskManager.Task::(_decref) Task=`8a84f4c8-565c-4379-aefe-14d7043849f4`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:25:43,470::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000340797 s, 12.0 MB/s\n'; <rc> = 0 >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:44,442::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-462::DEBUG::2013-03-01 14:25:44,500::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-462::DEBUG::2013-03-01 14:25:44,501::task::568::TaskManager.Task::(_updateState) Task=`aae4bcbe-f7b4-4dab-b7f8-b35b37341ff2`::moving from state init -> state preparing >Thread-462::INFO::2013-03-01 14:25:44,501::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-462::DEBUG::2013-03-01 14:25:44,501::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-462::DEBUG::2013-03-01 14:25:44,501::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-462::INFO::2013-03-01 14:25:44,502::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-462::DEBUG::2013-03-01 14:25:44,502::task::1151::TaskManager.Task::(prepare) Task=`aae4bcbe-f7b4-4dab-b7f8-b35b37341ff2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-462::DEBUG::2013-03-01 14:25:44,502::task::568::TaskManager.Task::(_updateState) Task=`aae4bcbe-f7b4-4dab-b7f8-b35b37341ff2`::moving from state preparing -> state finished >Thread-462::DEBUG::2013-03-01 14:25:44,502::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-462::DEBUG::2013-03-01 14:25:44,502::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-462::DEBUG::2013-03-01 14:25:44,503::task::957::TaskManager.Task::(_decref) Task=`aae4bcbe-f7b4-4dab-b7f8-b35b37341ff2`::ref 0 aborting False >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:45,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:45,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-463::DEBUG::2013-03-01 14:25:45,531::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-463::DEBUG::2013-03-01 14:25:45,532::task::568::TaskManager.Task::(_updateState) Task=`1f0721e3-3bb2-45b5-baaf-56b3b3476a50`::moving from state init -> state preparing >Thread-463::INFO::2013-03-01 14:25:45,532::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-463::DEBUG::2013-03-01 14:25:45,532::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-463::DEBUG::2013-03-01 14:25:45,532::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-463::INFO::2013-03-01 14:25:45,532::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-463::DEBUG::2013-03-01 14:25:45,533::task::1151::TaskManager.Task::(prepare) Task=`1f0721e3-3bb2-45b5-baaf-56b3b3476a50`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-463::DEBUG::2013-03-01 14:25:45,533::task::568::TaskManager.Task::(_updateState) Task=`1f0721e3-3bb2-45b5-baaf-56b3b3476a50`::moving from state preparing -> state finished >Thread-463::DEBUG::2013-03-01 14:25:45,533::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-463::DEBUG::2013-03-01 14:25:45,533::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-463::DEBUG::2013-03-01 14:25:45,533::task::957::TaskManager.Task::(_decref) Task=`1f0721e3-3bb2-45b5-baaf-56b3b3476a50`::ref 0 aborting False >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:46,453::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >Thread-465::DEBUG::2013-03-01 14:25:46,564::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-465::DEBUG::2013-03-01 14:25:46,565::task::568::TaskManager.Task::(_updateState) Task=`388e2a73-a943-4466-a99d-6db647c40456`::moving from state init -> state preparing >Thread-465::INFO::2013-03-01 14:25:46,565::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-465::DEBUG::2013-03-01 14:25:46,565::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-465::DEBUG::2013-03-01 14:25:46,565::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-465::INFO::2013-03-01 14:25:46,565::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-465::DEBUG::2013-03-01 14:25:46,565::task::1151::TaskManager.Task::(prepare) Task=`388e2a73-a943-4466-a99d-6db647c40456`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-465::DEBUG::2013-03-01 14:25:46,566::task::568::TaskManager.Task::(_updateState) Task=`388e2a73-a943-4466-a99d-6db647c40456`::moving from state preparing -> state finished >Thread-465::DEBUG::2013-03-01 14:25:46,566::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-465::DEBUG::2013-03-01 14:25:46,566::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-465::DEBUG::2013-03-01 14:25:46,566::task::957::TaskManager.Task::(_decref) Task=`388e2a73-a943-4466-a99d-6db647c40456`::ref 0 aborting False >MainProcess|c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:47,457::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-466::DEBUG::2013-03-01 14:25:47,595::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-466::DEBUG::2013-03-01 14:25:47,762::task::568::TaskManager.Task::(_updateState) Task=`91930f31-79ed-4843-bbfa-9fc2d48c7a5b`::moving from state init -> state preparing >Thread-466::INFO::2013-03-01 14:25:47,762::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-466::DEBUG::2013-03-01 14:25:47,763::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-466::DEBUG::2013-03-01 14:25:47,763::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-466::INFO::2013-03-01 14:25:47,763::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-466::DEBUG::2013-03-01 14:25:47,763::task::1151::TaskManager.Task::(prepare) Task=`91930f31-79ed-4843-bbfa-9fc2d48c7a5b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-466::DEBUG::2013-03-01 14:25:47,763::task::568::TaskManager.Task::(_updateState) Task=`91930f31-79ed-4843-bbfa-9fc2d48c7a5b`::moving from state preparing -> state finished >Thread-466::DEBUG::2013-03-01 14:25:47,764::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-466::DEBUG::2013-03-01 14:25:47,764::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-466::DEBUG::2013-03-01 14:25:47,764::task::957::TaskManager.Task::(_decref) Task=`91930f31-79ed-4843-bbfa-9fc2d48c7a5b`::ref 0 aborting False >Thread-467::DEBUG::2013-03-01 14:25:48,793::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-467::DEBUG::2013-03-01 14:25:48,793::task::568::TaskManager.Task::(_updateState) Task=`99ff5876-26dd-40fb-9aa3-af02a62050fd`::moving from state init -> state preparing >Thread-467::INFO::2013-03-01 14:25:48,793::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-467::DEBUG::2013-03-01 14:25:48,793::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-467::DEBUG::2013-03-01 14:25:48,794::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-467::INFO::2013-03-01 14:25:48,794::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-467::DEBUG::2013-03-01 14:25:48,794::task::1151::TaskManager.Task::(prepare) Task=`99ff5876-26dd-40fb-9aa3-af02a62050fd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-467::DEBUG::2013-03-01 14:25:48,794::task::568::TaskManager.Task::(_updateState) Task=`99ff5876-26dd-40fb-9aa3-af02a62050fd`::moving from state preparing -> state finished >Thread-467::DEBUG::2013-03-01 14:25:48,794::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-467::DEBUG::2013-03-01 14:25:48,794::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-467::DEBUG::2013-03-01 14:25:48,795::task::957::TaskManager.Task::(_decref) Task=`99ff5876-26dd-40fb-9aa3-af02a62050fd`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:25:49,765::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-469::DEBUG::2013-03-01 14:25:49,822::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-229::DEBUG::2013-03-01 14:25:53,469::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:25:53,471::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-469::DEBUG::2013-03-01 14:26:20,589::task::568::TaskManager.Task::(_updateState) Task=`beec3d4f-c379-40a7-9ae8-9fddaaacdba5`::moving from state init -> state preparing >Thread-469::INFO::2013-03-01 14:26:20,957::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-469::DEBUG::2013-03-01 14:26:21,012::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-469::DEBUG::2013-03-01 14:26:21,056::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-469::INFO::2013-03-01 14:26:21,095::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-469::DEBUG::2013-03-01 14:26:21,121::task::1151::TaskManager.Task::(prepare) Task=`beec3d4f-c379-40a7-9ae8-9fddaaacdba5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-469::DEBUG::2013-03-01 14:26:21,146::task::568::TaskManager.Task::(_updateState) Task=`beec3d4f-c379-40a7-9ae8-9fddaaacdba5`::moving from state preparing -> state finished >Thread-469::DEBUG::2013-03-01 14:26:21,170::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-229::DEBUG::2013-03-01 14:26:21,169::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00424835 s, 964 kB/s\n'; <rc> = 0 >Thread-469::DEBUG::2013-03-01 14:26:21,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-469::DEBUG::2013-03-01 14:26:21,233::task::957::TaskManager.Task::(_decref) Task=`beec3d4f-c379-40a7-9ae8-9fddaaacdba5`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:26:21,270::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00351024 s, 1.2 MB/s\n'; <rc> = 0 >Thread-470::DEBUG::2013-03-01 14:26:22,321::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-470::DEBUG::2013-03-01 14:26:22,321::task::568::TaskManager.Task::(_updateState) Task=`f7ced1c7-b89b-46b3-bca5-a3fc136ba879`::moving from state init -> state preparing >Thread-470::INFO::2013-03-01 14:26:22,322::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-470::DEBUG::2013-03-01 14:26:22,322::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-470::DEBUG::2013-03-01 14:26:22,322::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-470::INFO::2013-03-01 14:26:22,322::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-470::DEBUG::2013-03-01 14:26:22,322::task::1151::TaskManager.Task::(prepare) Task=`f7ced1c7-b89b-46b3-bca5-a3fc136ba879`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-470::DEBUG::2013-03-01 14:26:22,323::task::568::TaskManager.Task::(_updateState) Task=`f7ced1c7-b89b-46b3-bca5-a3fc136ba879`::moving from state preparing -> state finished >Thread-470::DEBUG::2013-03-01 14:26:22,323::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-470::DEBUG::2013-03-01 14:26:22,323::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-470::DEBUG::2013-03-01 14:26:22,323::task::957::TaskManager.Task::(_decref) Task=`f7ced1c7-b89b-46b3-bca5-a3fc136ba879`::ref 0 aborting False >Thread-471::DEBUG::2013-03-01 14:26:23,359::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-472::DEBUG::2013-03-01 14:26:23,942::task::568::TaskManager.Task::(_updateState) Task=`207246cc-bd43-4a9d-8c7e-26354010da4c`::moving from state init -> state preparing >Thread-229::DEBUG::2013-03-01 14:26:31,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:26:31,301::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-471::DEBUG::2013-03-01 14:26:45,249::task::568::TaskManager.Task::(_updateState) Task=`95f03bc1-b090-4e83-ae11-5fb5d91f4c05`::moving from state init -> state preparing >Thread-472::INFO::2013-03-01 14:26:45,250::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-471::INFO::2013-03-01 14:26:45,259::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-471::DEBUG::2013-03-01 14:26:45,268::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-472::INFO::2013-03-01 14:26:45,270::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '27.8145611286', 'lastCheck': '24.0', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '27.7298281193', 'lastCheck': '24.0', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00882601737976', 'lastCheck': '92.6', 'code': 0, 'valid': True}} >Thread-471::DEBUG::2013-03-01 14:26:45,272::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-472::DEBUG::2013-03-01 14:26:45,273::task::1151::TaskManager.Task::(prepare) Task=`207246cc-bd43-4a9d-8c7e-26354010da4c`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '27.8145611286', 'lastCheck': '24.0', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '27.7298281193', 'lastCheck': '24.0', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.00882601737976', 'lastCheck': '92.6', 'code': 0, 'valid': True}} >Thread-471::INFO::2013-03-01 14:26:45,275::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-472::DEBUG::2013-03-01 14:26:45,277::task::568::TaskManager.Task::(_updateState) Task=`207246cc-bd43-4a9d-8c7e-26354010da4c`::moving from state preparing -> state finished >Thread-471::DEBUG::2013-03-01 14:26:45,278::task::1151::TaskManager.Task::(prepare) Task=`95f03bc1-b090-4e83-ae11-5fb5d91f4c05`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-472::DEBUG::2013-03-01 14:26:45,280::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-471::DEBUG::2013-03-01 14:26:45,281::task::568::TaskManager.Task::(_updateState) Task=`95f03bc1-b090-4e83-ae11-5fb5d91f4c05`::moving from state preparing -> state finished >Thread-472::DEBUG::2013-03-01 14:26:45,282::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-471::DEBUG::2013-03-01 14:26:45,284::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-472::DEBUG::2013-03-01 14:26:45,285::task::957::TaskManager.Task::(_decref) Task=`207246cc-bd43-4a9d-8c7e-26354010da4c`::ref 0 aborting False >Thread-471::DEBUG::2013-03-01 14:26:45,286::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2013-03-01 14:26:45,288::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000344844 s, 11.9 MB/s\n'; <rc> = 0 >Thread-471::DEBUG::2013-03-01 14:26:45,290::task::957::TaskManager.Task::(_decref) Task=`95f03bc1-b090-4e83-ae11-5fb5d91f4c05`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:26:45,301::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000378439 s, 10.8 MB/s\n'; <rc> = 0 >Thread-474::DEBUG::2013-03-01 14:26:46,327::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-474::DEBUG::2013-03-01 14:26:46,328::task::568::TaskManager.Task::(_updateState) Task=`2b08032a-0dcc-45ab-99f4-a9033568866f`::moving from state init -> state preparing >Thread-474::INFO::2013-03-01 14:26:46,328::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-474::DEBUG::2013-03-01 14:26:46,328::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-474::DEBUG::2013-03-01 14:26:46,329::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-474::INFO::2013-03-01 14:26:46,329::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-474::DEBUG::2013-03-01 14:26:46,329::task::1151::TaskManager.Task::(prepare) Task=`2b08032a-0dcc-45ab-99f4-a9033568866f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-474::DEBUG::2013-03-01 14:26:46,330::task::568::TaskManager.Task::(_updateState) Task=`2b08032a-0dcc-45ab-99f4-a9033568866f`::moving from state preparing -> state finished >Thread-474::DEBUG::2013-03-01 14:26:46,330::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-474::DEBUG::2013-03-01 14:26:46,330::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-474::DEBUG::2013-03-01 14:26:46,330::task::957::TaskManager.Task::(_decref) Task=`2b08032a-0dcc-45ab-99f4-a9033568866f`::ref 0 aborting False >Thread-475::DEBUG::2013-03-01 14:26:47,362::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-475::DEBUG::2013-03-01 14:26:47,362::task::568::TaskManager.Task::(_updateState) Task=`cef643b4-eb13-4965-8bd0-39b2ebd76a91`::moving from state init -> state preparing >Thread-475::INFO::2013-03-01 14:26:47,363::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-475::DEBUG::2013-03-01 14:26:47,363::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-475::DEBUG::2013-03-01 14:26:47,363::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-475::INFO::2013-03-01 14:26:47,363::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-475::DEBUG::2013-03-01 14:26:47,364::task::1151::TaskManager.Task::(prepare) Task=`cef643b4-eb13-4965-8bd0-39b2ebd76a91`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-475::DEBUG::2013-03-01 14:26:47,364::task::568::TaskManager.Task::(_updateState) Task=`cef643b4-eb13-4965-8bd0-39b2ebd76a91`::moving from state preparing -> state finished >Thread-475::DEBUG::2013-03-01 14:26:47,364::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-475::DEBUG::2013-03-01 14:26:47,365::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-475::DEBUG::2013-03-01 14:26:47,365::task::957::TaskManager.Task::(_decref) Task=`cef643b4-eb13-4965-8bd0-39b2ebd76a91`::ref 0 aborting False >Thread-477::DEBUG::2013-03-01 14:26:48,408::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-229::DEBUG::2013-03-01 14:26:55,294::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-322::DEBUG::2013-03-01 14:26:55,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:26:55,954::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-477::DEBUG::2013-03-01 14:26:55,954::task::568::TaskManager.Task::(_updateState) Task=`46626833-4019-496f-b63e-f2df5f1f8d82`::moving from state init -> state preparing >Thread-477::INFO::2013-03-01 14:26:55,962::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-477::DEBUG::2013-03-01 14:26:55,964::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-477::DEBUG::2013-03-01 14:26:55,966::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-477::INFO::2013-03-01 14:26:55,968::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-477::DEBUG::2013-03-01 14:26:55,969::task::1151::TaskManager.Task::(prepare) Task=`46626833-4019-496f-b63e-f2df5f1f8d82`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-477::DEBUG::2013-03-01 14:26:55,971::task::568::TaskManager.Task::(_updateState) Task=`46626833-4019-496f-b63e-f2df5f1f8d82`::moving from state preparing -> state finished >Thread-477::DEBUG::2013-03-01 14:26:55,972::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-477::DEBUG::2013-03-01 14:26:55,974::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-477::DEBUG::2013-03-01 14:26:55,975::task::957::TaskManager.Task::(_decref) Task=`46626833-4019-496f-b63e-f2df5f1f8d82`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:26:55,979::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000361219 s, 11.3 MB/s\n'; <rc> = 0 >Thread-478::DEBUG::2013-03-01 14:26:57,008::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-478::DEBUG::2013-03-01 14:26:57,009::task::568::TaskManager.Task::(_updateState) Task=`2329a080-e9df-444f-8a48-25d2a64f613b`::moving from state init -> state preparing >Thread-478::INFO::2013-03-01 14:26:57,009::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-478::DEBUG::2013-03-01 14:26:57,009::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-478::DEBUG::2013-03-01 14:26:57,010::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-478::INFO::2013-03-01 14:26:57,010::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-478::DEBUG::2013-03-01 14:26:57,010::task::1151::TaskManager.Task::(prepare) Task=`2329a080-e9df-444f-8a48-25d2a64f613b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-478::DEBUG::2013-03-01 14:26:57,011::task::568::TaskManager.Task::(_updateState) Task=`2329a080-e9df-444f-8a48-25d2a64f613b`::moving from state preparing -> state finished >Thread-478::DEBUG::2013-03-01 14:26:57,011::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-478::DEBUG::2013-03-01 14:26:57,011::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-478::DEBUG::2013-03-01 14:26:57,011::task::957::TaskManager.Task::(_decref) Task=`2329a080-e9df-444f-8a48-25d2a64f613b`::ref 0 aborting False >Thread-479::DEBUG::2013-03-01 14:26:58,039::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-479::DEBUG::2013-03-01 14:27:04,233::task::568::TaskManager.Task::(_updateState) Task=`f88bf9b6-36f1-4a31-b7d1-77c793474bea`::moving from state init -> state preparing >Thread-479::INFO::2013-03-01 14:27:04,233::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-479::DEBUG::2013-03-01 14:27:04,234::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-479::DEBUG::2013-03-01 14:27:04,234::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-479::INFO::2013-03-01 14:27:04,234::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-479::DEBUG::2013-03-01 14:27:04,234::task::1151::TaskManager.Task::(prepare) Task=`f88bf9b6-36f1-4a31-b7d1-77c793474bea`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-479::DEBUG::2013-03-01 14:27:04,234::task::568::TaskManager.Task::(_updateState) Task=`f88bf9b6-36f1-4a31-b7d1-77c793474bea`::moving from state preparing -> state finished >Thread-479::DEBUG::2013-03-01 14:27:04,234::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-479::DEBUG::2013-03-01 14:27:04,235::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-479::DEBUG::2013-03-01 14:27:04,235::task::957::TaskManager.Task::(_decref) Task=`f88bf9b6-36f1-4a31-b7d1-77c793474bea`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,244::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,245::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,245::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,246::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,246::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,246::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,247::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,247::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-229::DEBUG::2013-03-01 14:27:04,247::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-229::DEBUG::2013-03-01 14:27:04,249::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,249::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:27:04,250::misc::1055::SamplingMethod::(__call__) Got in to sampling method >Thread-229::DEBUG::2013-03-01 14:27:04,252::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,267::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-229::DEBUG::2013-03-01 14:27:04,294::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:27:04,295::misc::1063::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:04,296::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:04,299::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,496::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,497::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,498::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,498::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,505::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000290878 s, 7.0 MB/s\n'; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,505::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000290878 s, 7.0 MB/s'], size: 2048 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,505::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:27:04,506::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,507::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,508::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,508::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,509::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,509::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,509::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:04,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:05,180::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:05,182::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:05,183::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=5029bd0c0b3b10ecde73750144b6d864017035c7', 'POOL_SPM_LVER=1'] >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:05,184::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:05,185::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-481::DEBUG::2013-03-01 14:27:05,265::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-481::DEBUG::2013-03-01 14:27:05,266::task::568::TaskManager.Task::(_updateState) Task=`4002ca0f-7533-45e2-81d0-4fd7b092ad97`::moving from state init -> state preparing >Thread-481::INFO::2013-03-01 14:27:05,266::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-481::DEBUG::2013-03-01 14:27:05,267::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-481::DEBUG::2013-03-01 14:27:05,267::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-481::INFO::2013-03-01 14:27:05,267::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-481::DEBUG::2013-03-01 14:27:05,267::task::1151::TaskManager.Task::(prepare) Task=`4002ca0f-7533-45e2-81d0-4fd7b092ad97`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-481::DEBUG::2013-03-01 14:27:05,267::task::568::TaskManager.Task::(_updateState) Task=`4002ca0f-7533-45e2-81d0-4fd7b092ad97`::moving from state preparing -> state finished >Thread-481::DEBUG::2013-03-01 14:27:05,267::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-481::DEBUG::2013-03-01 14:27:05,268::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-481::DEBUG::2013-03-01 14:27:05,268::task::957::TaskManager.Task::(_decref) Task=`4002ca0f-7533-45e2-81d0-4fd7b092ad97`::ref 0 aborting False >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:05,303::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-322::DEBUG::2013-03-01 14:27:05,981::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:06,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >Thread-482::DEBUG::2013-03-01 14:27:06,301::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:29,115::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-322::DEBUG::2013-03-01 14:27:29,113::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-482::DEBUG::2013-03-01 14:27:29,124::task::568::TaskManager.Task::(_updateState) Task=`fb7bfd07-b47c-40d0-8195-7b3d3c003389`::moving from state init -> state preparing >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:29,126::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-482::INFO::2013-03-01 14:27:29,125::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-482::DEBUG::2013-03-01 14:27:29,131::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-482::DEBUG::2013-03-01 14:27:29,131::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-482::INFO::2013-03-01 14:27:29,132::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-482::DEBUG::2013-03-01 14:27:29,132::task::1151::TaskManager.Task::(prepare) Task=`fb7bfd07-b47c-40d0-8195-7b3d3c003389`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-482::DEBUG::2013-03-01 14:27:29,132::task::568::TaskManager.Task::(_updateState) Task=`fb7bfd07-b47c-40d0-8195-7b3d3c003389`::moving from state preparing -> state finished >Thread-482::DEBUG::2013-03-01 14:27:29,132::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-482::DEBUG::2013-03-01 14:27:29,132::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-482::DEBUG::2013-03-01 14:27:29,133::task::957::TaskManager.Task::(_decref) Task=`fb7bfd07-b47c-40d0-8195-7b3d3c003389`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:27:29,135::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:27:29,135::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:27:29,136::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,137::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,138::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (0 active users) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,139::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free, finding out if anyone is waiting for it. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,140::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', Clearing records. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,141::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >Thread-151::DEBUG::2013-03-01 14:27:29,142::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,143::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,150::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >Thread-484::DEBUG::2013-03-01 14:27:29,152::sp::167::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain 46a88efb-817e-49ba-b498-4fae08c6e657 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,154::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' >Thread-484::DEBUG::2013-03-01 14:27:29,156::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`fd62ba2a-d4d4-4707-bdfc-1948b1b5701f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,157::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-484::DEBUG::2013-03-01 14:27:29,158::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657' for lock type 'exclusive' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,158::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,159::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-484::DEBUG::2013-03-01 14:27:29,160::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657' is free. Now locking as 'exclusive' (1 active user) >Thread-484::DEBUG::2013-03-01 14:27:29,161::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`fd62ba2a-d4d4-4707-bdfc-1948b1b5701f`::Granted request >Thread-484::DEBUG::2013-03-01 14:27:29,162::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`6f8845b1-4ada-49be-ad52-b6958e73f570`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-484::DEBUG::2013-03-01 14:27:29,163::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' for lock type 'exclusive' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:27:29,162::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master already exists >Thread-484::DEBUG::2013-03-01 14:27:29,164::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free. Now locking as 'exclusive' (1 active user) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/fsck -p /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >Thread-484::DEBUG::2013-03-01 14:27:29,165::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.46a88efb-817e-49ba-b498-4fae08c6e657`ReqID=`6f8845b1-4ada-49be-ad52-b6958e73f570`::Granted request >Thread-484::DEBUG::2013-03-01 14:27:29,174::sp::185::Storage.StoragePool::(_upgradePoolDomain) Domain `46a88efb-817e-49ba-b498-4fae08c6e657` is not a data domain it is an 3 domain, not upgrading >Thread-484::DEBUG::2013-03-01 14:27:29,174::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' >Thread-484::DEBUG::2013-03-01 14:27:29,174::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' (0 active users) >Thread-484::DEBUG::2013-03-01 14:27:29,174::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657' is free, finding out if anyone is waiting for it. >Thread-484::DEBUG::2013-03-01 14:27:29,175::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.46a88efb-817e-49ba-b498-4fae08c6e657', Clearing records. >Thread-484::DEBUG::2013-03-01 14:27:29,175::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657' >Thread-484::DEBUG::2013-03-01 14:27:29,175::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657' (0 active users) >Thread-484::DEBUG::2013-03-01 14:27:29,175::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657' is free, finding out if anyone is waiting for it. >Thread-484::DEBUG::2013-03-01 14:27:29,176::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_46a88efb-817e-49ba-b498-4fae08c6e657', Clearing records. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,205::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,206::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,221::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,221::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,295::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/master' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,313::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::WARNING::2013-03-01 14:27:29,316::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master already exists >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,325::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/fsck -p /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-151::DEBUG::2013-03-01 14:27:29,359::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:27:29,361::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:27:29,362::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:27:29,364::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-322::DEBUG::2013-03-01 14:27:29,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,383::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,388::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >Thread-151::DEBUG::2013-03-01 14:27:29,397::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000311251 s, 13.2 MB/s\n'; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,406::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >Thread-322::DEBUG::2013-03-01 14:27:29,407::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000381419 s, 10.7 MB/s\n'; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,410::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/46a88efb-817e-49ba-b498-4fae08c6e657/master /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,467::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/46a88efb-817e-49ba-b498-4fae08c6e657/master' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:27:29,483::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:30,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >Thread-486::DEBUG::2013-03-01 14:27:30,235::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-322::DEBUG::2013-03-01 14:27:39,411::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:27:39,421::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >MainProcess|Thread-229::DEBUG::2013-03-01 14:27:59,585::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-486::DEBUG::2013-03-01 14:27:59,584::task::568::TaskManager.Task::(_updateState) Task=`55ab5b72-82cf-4434-9515-6280e14a5602`::moving from state init -> state preparing >Thread-486::INFO::2013-03-01 14:27:59,602::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-486::DEBUG::2013-03-01 14:27:59,604::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-486::DEBUG::2013-03-01 14:27:59,606::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-486::INFO::2013-03-01 14:27:59,608::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-486::DEBUG::2013-03-01 14:27:59,611::task::1151::TaskManager.Task::(prepare) Task=`55ab5b72-82cf-4434-9515-6280e14a5602`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-486::DEBUG::2013-03-01 14:27:59,613::task::568::TaskManager.Task::(_updateState) Task=`55ab5b72-82cf-4434-9515-6280e14a5602`::moving from state preparing -> state finished >Thread-151::DEBUG::2013-03-01 14:27:59,614::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000265452 s, 15.4 MB/s\n'; <rc> = 0 >Thread-486::DEBUG::2013-03-01 14:27:59,615::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-486::DEBUG::2013-03-01 14:27:59,617::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-486::DEBUG::2013-03-01 14:27:59,619::task::957::TaskManager.Task::(_decref) Task=`55ab5b72-82cf-4434-9515-6280e14a5602`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:27:59,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00036411 s, 11.2 MB/s\n'; <rc> = 0 >Thread-488::DEBUG::2013-03-01 14:28:00,726::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-488::DEBUG::2013-03-01 14:28:00,727::task::568::TaskManager.Task::(_updateState) Task=`342b2b9e-3533-4a65-88a0-51bd0e5e203a`::moving from state init -> state preparing >Thread-488::INFO::2013-03-01 14:28:00,727::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-488::DEBUG::2013-03-01 14:28:00,727::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-488::DEBUG::2013-03-01 14:28:00,727::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-488::INFO::2013-03-01 14:28:00,728::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-488::DEBUG::2013-03-01 14:28:00,728::task::1151::TaskManager.Task::(prepare) Task=`342b2b9e-3533-4a65-88a0-51bd0e5e203a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-488::DEBUG::2013-03-01 14:28:00,728::task::568::TaskManager.Task::(_updateState) Task=`342b2b9e-3533-4a65-88a0-51bd0e5e203a`::moving from state preparing -> state finished >Thread-488::DEBUG::2013-03-01 14:28:00,728::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-488::DEBUG::2013-03-01 14:28:00,728::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-488::DEBUG::2013-03-01 14:28:00,729::task::957::TaskManager.Task::(_decref) Task=`342b2b9e-3533-4a65-88a0-51bd0e5e203a`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:28:01,589::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-489::DEBUG::2013-03-01 14:28:01,763::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-489::DEBUG::2013-03-01 14:28:01,764::task::568::TaskManager.Task::(_updateState) Task=`8657f013-5188-4e98-8be2-b4f2eac43228`::moving from state init -> state preparing >Thread-489::INFO::2013-03-01 14:28:01,764::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-489::DEBUG::2013-03-01 14:28:01,764::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-489::DEBUG::2013-03-01 14:28:01,764::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-489::INFO::2013-03-01 14:28:01,765::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-489::DEBUG::2013-03-01 14:28:01,765::task::1151::TaskManager.Task::(prepare) Task=`8657f013-5188-4e98-8be2-b4f2eac43228`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-489::DEBUG::2013-03-01 14:28:01,765::task::568::TaskManager.Task::(_updateState) Task=`8657f013-5188-4e98-8be2-b4f2eac43228`::moving from state preparing -> state finished >Thread-489::DEBUG::2013-03-01 14:28:01,765::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-489::DEBUG::2013-03-01 14:28:01,765::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-489::DEBUG::2013-03-01 14:28:01,766::task::957::TaskManager.Task::(_decref) Task=`8657f013-5188-4e98-8be2-b4f2eac43228`::ref 0 aborting False >Thread-490::DEBUG::2013-03-01 14:28:02,632::task::568::TaskManager.Task::(_updateState) Task=`aca78198-86d7-4831-a2be-8882cf9cbc20`::moving from state init -> state preparing >Thread-490::INFO::2013-03-01 14:28:02,632::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-490::INFO::2013-03-01 14:28:02,633::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '20.2129678726', 'lastCheck': '3.0', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '14.0423090458', 'lastCheck': '77.3', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '20.1942868233', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-490::DEBUG::2013-03-01 14:28:02,633::task::1151::TaskManager.Task::(prepare) Task=`aca78198-86d7-4831-a2be-8882cf9cbc20`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '20.2129678726', 'lastCheck': '3.0', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '14.0423090458', 'lastCheck': '77.3', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '20.1942868233', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-490::DEBUG::2013-03-01 14:28:02,633::task::568::TaskManager.Task::(_updateState) Task=`aca78198-86d7-4831-a2be-8882cf9cbc20`::moving from state preparing -> state finished >Thread-490::DEBUG::2013-03-01 14:28:02,633::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-490::DEBUG::2013-03-01 14:28:02,633::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-490::DEBUG::2013-03-01 14:28:02,634::task::957::TaskManager.Task::(_decref) Task=`aca78198-86d7-4831-a2be-8882cf9cbc20`::ref 0 aborting False >Thread-492::DEBUG::2013-03-01 14:28:02,796::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-492::DEBUG::2013-03-01 14:28:02,797::task::568::TaskManager.Task::(_updateState) Task=`f2f6dd58-0a40-44f1-aa9c-b502016f075f`::moving from state init -> state preparing >Thread-492::INFO::2013-03-01 14:28:02,797::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-492::DEBUG::2013-03-01 14:28:02,797::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-492::DEBUG::2013-03-01 14:28:02,797::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-492::INFO::2013-03-01 14:28:02,797::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-492::DEBUG::2013-03-01 14:28:02,797::task::1151::TaskManager.Task::(prepare) Task=`f2f6dd58-0a40-44f1-aa9c-b502016f075f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-492::DEBUG::2013-03-01 14:28:02,798::task::568::TaskManager.Task::(_updateState) Task=`f2f6dd58-0a40-44f1-aa9c-b502016f075f`::moving from state preparing -> state finished >Thread-492::DEBUG::2013-03-01 14:28:02,798::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-492::DEBUG::2013-03-01 14:28:02,798::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-492::DEBUG::2013-03-01 14:28:02,798::task::957::TaskManager.Task::(_decref) Task=`f2f6dd58-0a40-44f1-aa9c-b502016f075f`::ref 0 aborting False >Thread-493::DEBUG::2013-03-01 14:28:03,827::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-493::DEBUG::2013-03-01 14:28:05,082::task::568::TaskManager.Task::(_updateState) Task=`5d194cfc-7f2a-4d7b-86a7-09cabe8ae1e1`::moving from state init -> state preparing >Thread-493::INFO::2013-03-01 14:28:05,083::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-493::DEBUG::2013-03-01 14:28:05,083::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-493::DEBUG::2013-03-01 14:28:05,083::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-493::INFO::2013-03-01 14:28:05,083::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-493::DEBUG::2013-03-01 14:28:05,083::task::1151::TaskManager.Task::(prepare) Task=`5d194cfc-7f2a-4d7b-86a7-09cabe8ae1e1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-493::DEBUG::2013-03-01 14:28:05,084::task::568::TaskManager.Task::(_updateState) Task=`5d194cfc-7f2a-4d7b-86a7-09cabe8ae1e1`::moving from state preparing -> state finished >Thread-493::DEBUG::2013-03-01 14:28:05,084::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-493::DEBUG::2013-03-01 14:28:05,084::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-493::DEBUG::2013-03-01 14:28:05,084::task::957::TaskManager.Task::(_decref) Task=`5d194cfc-7f2a-4d7b-86a7-09cabe8ae1e1`::ref 0 aborting False >Thread-495::DEBUG::2013-03-01 14:28:06,114::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-495::DEBUG::2013-03-01 14:28:06,119::task::568::TaskManager.Task::(_updateState) Task=`38394e10-c4f3-4675-b939-1dea9dc7c8d7`::moving from state init -> state preparing >Thread-495::INFO::2013-03-01 14:28:06,120::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-495::DEBUG::2013-03-01 14:28:06,120::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-495::DEBUG::2013-03-01 14:28:06,120::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-495::INFO::2013-03-01 14:28:06,120::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-495::DEBUG::2013-03-01 14:28:06,120::task::1151::TaskManager.Task::(prepare) Task=`38394e10-c4f3-4675-b939-1dea9dc7c8d7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-495::DEBUG::2013-03-01 14:28:06,121::task::568::TaskManager.Task::(_updateState) Task=`38394e10-c4f3-4675-b939-1dea9dc7c8d7`::moving from state preparing -> state finished >Thread-495::DEBUG::2013-03-01 14:28:06,121::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-495::DEBUG::2013-03-01 14:28:06,121::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-495::DEBUG::2013-03-01 14:28:06,121::task::957::TaskManager.Task::(_decref) Task=`38394e10-c4f3-4675-b939-1dea9dc7c8d7`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:28:06,766::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:06,766::lvm::482::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,767::lvm::484::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,767::lvm::493::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,767::lvm::495::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,767::lvm::513::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,768::lvm::515::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,768::misc::1063::SamplingMethod::(__call__) Returning last result >Thread-229::DEBUG::2013-03-01 14:28:06,768::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:06,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-229::DEBUG::2013-03-01 14:28:07,040::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,042::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,042::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-229::DEBUG::2013-03-01 14:28:07,043::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:28:07,050::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000446806 s, 4.6 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,050::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000446806 s, 4.6 MB/s'], size: 2048 >Thread-229::DEBUG::2013-03-01 14:28:07,050::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-229::WARNING::2013-03-01 14:28:07,051::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-229::DEBUG::2013-03-01 14:28:07,052::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-229::DEBUG::2013-03-01 14:28:07,052::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,053::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,053::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,053::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,053::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,054::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-496::DEBUG::2013-03-01 14:28:07,159::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-496::DEBUG::2013-03-01 14:28:07,159::task::568::TaskManager.Task::(_updateState) Task=`60061141-9093-4eaa-b373-2cca2b3bf75e`::moving from state init -> state preparing >Thread-496::INFO::2013-03-01 14:28:07,160::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-496::DEBUG::2013-03-01 14:28:07,160::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-496::DEBUG::2013-03-01 14:28:07,160::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-496::INFO::2013-03-01 14:28:07,161::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-496::DEBUG::2013-03-01 14:28:07,161::task::1151::TaskManager.Task::(prepare) Task=`60061141-9093-4eaa-b373-2cca2b3bf75e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-496::DEBUG::2013-03-01 14:28:07,161::task::568::TaskManager.Task::(_updateState) Task=`60061141-9093-4eaa-b373-2cca2b3bf75e`::moving from state preparing -> state finished >Thread-496::DEBUG::2013-03-01 14:28:07,161::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-496::DEBUG::2013-03-01 14:28:07,162::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-496::DEBUG::2013-03-01 14:28:07,162::task::957::TaskManager.Task::(_decref) Task=`60061141-9093-4eaa-b373-2cca2b3bf75e`::ref 0 aborting False >Thread-229::DEBUG::2013-03-01 14:28:07,273::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,274::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,275::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', '_SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790', 'MASTER_VERSION=0'] >Thread-229::DEBUG::2013-03-01 14:28:07,276::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-229::DEBUG::2013-03-01 14:28:07,276::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-229::DEBUG::2013-03-01 14:28:07,530::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,530::lvm::364::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-229::WARNING::2013-03-01 14:28:07,531::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_imageNS already registered >Thread-229::WARNING::2013-03-01 14:28:07,531::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_volumeNS already registered >Thread-229::WARNING::2013-03-01 14:28:07,531::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 04bf19fa-db6c-4c8f-845f-b87411d8e898_lvmActivationNS already registered >Thread-485::DEBUG::2013-03-01 14:28:07,532::sp::167::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain 04bf19fa-db6c-4c8f-845f-b87411d8e898 >Thread-485::DEBUG::2013-03-01 14:28:07,536::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`8c73cf28-17aa-41a7-bde3-1cac9083b04e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,537::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-485::DEBUG::2013-03-01 14:28:07,537::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898' for lock type 'exclusive' >Thread-229::DEBUG::2013-03-01 14:28:07,539::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-485::DEBUG::2013-03-01 14:28:07,540::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898' is free. Now locking as 'exclusive' (1 active user) >Thread-485::DEBUG::2013-03-01 14:28:07,549::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`8c73cf28-17aa-41a7-bde3-1cac9083b04e`::Granted request >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,552::storage_mailbox::504::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >Thread-485::DEBUG::2013-03-01 14:28:07,553::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`2596f4da-2b4b-4415-a65f-3e9e655f2449`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-485::DEBUG::2013-03-01 14:28:07,554::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' for lock type 'exclusive' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,555::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd of=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Thread-485::DEBUG::2013-03-01 14:28:07,555::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free. Now locking as 'exclusive' (1 active user) >Thread-485::DEBUG::2013-03-01 14:28:07,564::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898`ReqID=`2596f4da-2b4b-4415-a65f-3e9e655f2449`::Granted request >Thread-485::DEBUG::2013-03-01 14:28:07,568::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-485::DEBUG::2013-03-01 14:28:07,569::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-485::DEBUG::2013-03-01 14:28:07,570::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-485::DEBUG::2013-03-01 14:28:07,571::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-485::DEBUG::2013-03-01 14:28:07,572::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-485::DEBUG::2013-03-01 14:28:07,575::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,627::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.064871 s, 15.8 MB/s\n'; <rc> = 0 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,628::storage_mailbox::511::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 8fd46635-c46a-47a7-b122-316b2df29251 >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,630::sp::302::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 8fd46635-c46a-47a7-b122-316b2df29251 on master domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Dummy-502::DEBUG::2013-03-01 14:28:07,630::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,631::sp::309::Storage.StoragePool::(startSpm) ended. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,639::task::568::TaskManager.Task::(_updateState) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::moving from state running -> state finished >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,639::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,639::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,640::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,640::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,642::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,643::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,646::task::880::TaskManager.Task::(_runJobs) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::Task.run: exit - success: result >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,648::task::957::TaskManager.Task::(_decref) Task=`c7d77fc5-8b9d-4b52-b2cd-0821de628aba`::ref 0 aborting False >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:07,649::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-502::DEBUG::2013-03-01 14:28:07,716::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415101 s, 24.7 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,757::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,758::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:28:07,766::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0013922 s, 2.9 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,766::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-229::DEBUG::2013-03-01 14:28:07,767::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 04bf19fa-db6c-4c8f-845f-b87411d8e898' (cwd None) >Thread-485::DEBUG::2013-03-01 14:28:07,820::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-485::DEBUG::2013-03-01 14:28:07,821::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', u'PV0=pv:3514f0c542a0004c3,uuid:nxMvma-fQlK-p7im-6Mnx-fbua-w0xk-NIkSHo,pestart:0,pecount:397,mapoffset:0', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'SDUUID=04bf19fa-db6c-4c8f-845f-b87411d8e898', 'VGUUID=GS6yS9-BHiB-tHMR-DwNt-RBE0-Zc7j-SPbgjD', 'IOOPTIMEOUTSEC=1', 'LOCKPOLICY=', 'DESCRIPTION=iscsiStorageTest_data_domain1', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', '_SHA_CKSUM=563fd922eb26dfdb8cda0b50afe0b5def131a790', 'MASTER_VERSION=0'] >Thread-485::DEBUG::2013-03-01 14:28:07,822::sp::200::Storage.StoragePool::(_upgradePoolDomain) All domains are upgraded, unregistering from state change event >Thread-485::DEBUG::2013-03-01 14:28:07,822::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' >Thread-485::DEBUG::2013-03-01 14:28:07,823::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' (0 active users) >Thread-485::DEBUG::2013-03-01 14:28:07,823::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898' is free, finding out if anyone is waiting for it. >Thread-485::DEBUG::2013-03-01 14:28:07,823::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.04bf19fa-db6c-4c8f-845f-b87411d8e898', Clearing records. >Thread-485::DEBUG::2013-03-01 14:28:07,823::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898' >Thread-485::DEBUG::2013-03-01 14:28:07,824::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898' (0 active users) >Thread-485::DEBUG::2013-03-01 14:28:07,824::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898' is free, finding out if anyone is waiting for it. >Thread-485::DEBUG::2013-03-01 14:28:07,824::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_04bf19fa-db6c-4c8f-845f-b87411d8e898', Clearing records. >Thread-229::DEBUG::2013-03-01 14:28:07,969::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:07,971::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-503::DEBUG::2013-03-01 14:28:08,191::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-503::DEBUG::2013-03-01 14:28:08,192::task::568::TaskManager.Task::(_updateState) Task=`cea37dbd-8d17-4e8c-b113-ba80698eacba`::moving from state init -> state preparing >Thread-503::INFO::2013-03-01 14:28:08,192::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-503::DEBUG::2013-03-01 14:28:08,192::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-503::DEBUG::2013-03-01 14:28:08,193::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'} >Thread-503::INFO::2013-03-01 14:28:08,193::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-503::DEBUG::2013-03-01 14:28:08,193::task::1151::TaskManager.Task::(prepare) Task=`cea37dbd-8d17-4e8c-b113-ba80698eacba`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c7d77fc5-8b9d-4b52-b2cd-0821de628aba'}} >Thread-503::DEBUG::2013-03-01 14:28:08,194::task::568::TaskManager.Task::(_updateState) Task=`cea37dbd-8d17-4e8c-b113-ba80698eacba`::moving from state preparing -> state finished >Thread-503::DEBUG::2013-03-01 14:28:08,194::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-503::DEBUG::2013-03-01 14:28:08,194::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-503::DEBUG::2013-03-01 14:28:08,195::task::957::TaskManager.Task::(_decref) Task=`cea37dbd-8d17-4e8c-b113-ba80698eacba`::ref 0 aborting False >Thread-504::DEBUG::2013-03-01 14:28:08,220::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-504::DEBUG::2013-03-01 14:28:08,220::task::568::TaskManager.Task::(_updateState) Task=`c1af98af-0699-447a-afc3-eb8748681288`::moving from state init -> state preparing >Thread-504::INFO::2013-03-01 14:28:08,221::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-504::INFO::2013-03-01 14:28:08,221::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-504::DEBUG::2013-03-01 14:28:08,221::task::1151::TaskManager.Task::(prepare) Task=`c1af98af-0699-447a-afc3-eb8748681288`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-504::DEBUG::2013-03-01 14:28:08,221::task::568::TaskManager.Task::(_updateState) Task=`c1af98af-0699-447a-afc3-eb8748681288`::moving from state preparing -> state finished >Thread-504::DEBUG::2013-03-01 14:28:08,221::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-504::DEBUG::2013-03-01 14:28:08,222::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-504::DEBUG::2013-03-01 14:28:08,222::task::957::TaskManager.Task::(_decref) Task=`c1af98af-0699-447a-afc3-eb8748681288`::ref 0 aborting False >Thread-505::DEBUG::2013-03-01 14:28:08,251::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-505::DEBUG::2013-03-01 14:28:08,252::task::568::TaskManager.Task::(_updateState) Task=`f219239d-6e1c-471b-9393-8bf0368c897c`::moving from state init -> state preparing >Thread-505::INFO::2013-03-01 14:28:08,252::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='c7d77fc5-8b9d-4b52-b2cd-0821de628aba', spUUID=None, options=None) >Thread-505::DEBUG::2013-03-01 14:28:08,253::taskManager::161::TaskManager::(clearTask) Entry. taskID: c7d77fc5-8b9d-4b52-b2cd-0821de628aba >Thread-505::DEBUG::2013-03-01 14:28:08,253::taskManager::166::TaskManager::(clearTask) Return. >Thread-505::INFO::2013-03-01 14:28:08,253::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-505::DEBUG::2013-03-01 14:28:08,253::task::1151::TaskManager.Task::(prepare) Task=`f219239d-6e1c-471b-9393-8bf0368c897c`::finished: None >Thread-505::DEBUG::2013-03-01 14:28:08,254::task::568::TaskManager.Task::(_updateState) Task=`f219239d-6e1c-471b-9393-8bf0368c897c`::moving from state preparing -> state finished >Thread-505::DEBUG::2013-03-01 14:28:08,254::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-505::DEBUG::2013-03-01 14:28:08,254::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-505::DEBUG::2013-03-01 14:28:08,254::task::957::TaskManager.Task::(_decref) Task=`f219239d-6e1c-471b-9393-8bf0368c897c`::ref 0 aborting False >Thread-506::DEBUG::2013-03-01 14:28:08,308::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-506::DEBUG::2013-03-01 14:28:08,309::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state init -> state preparing >Thread-506::INFO::2013-03-01 14:28:08,309::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='5dd04e7f-8474-4d0a-ae61-24f8fd2556de', spUUID='8fd46635-c46a-47a7-b122-316b2df29251', imgUUID='1a4716ae-3960-478e-84e3-22f14c539280', size='21474836480', volFormat=4, preallocate=2, diskType=2, volUUID='8b39a324-63e8-4aab-bd5b-e7055b208687', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-506::INFO::2013-03-01 14:28:08,310::blockSD::818::Storage.StorageDomain::(validate) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-506::DEBUG::2013-03-01 14:28:08,310::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-506::DEBUG::2013-03-01 14:28:08,554::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-506::DEBUG::2013-03-01 14:28:08,555::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-506::DEBUG::2013-03-01 14:28:08,555::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-506::DEBUG::2013-03-01 14:28:08,555::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-506::DEBUG::2013-03-01 14:28:08,556::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-506::DEBUG::2013-03-01 14:28:08,556::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-506::DEBUG::2013-03-01 14:28:08,557::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-506::DEBUG::2013-03-01 14:28:08,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-506::DEBUG::2013-03-01 14:28:08,811::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-506::DEBUG::2013-03-01 14:28:08,811::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=5029bd0c0b3b10ecde73750144b6d864017035c7', 'POOL_SPM_LVER=1'] >Thread-506::DEBUG::2013-03-01 14:28:08,812::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`e3195648-6008-49a8-bf1f-68691f3e8b71`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-506::DEBUG::2013-03-01 14:28:08,812::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' for lock type 'shared' >Thread-506::DEBUG::2013-03-01 14:28:08,813::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free. Now locking as 'shared' (1 active user) >Thread-506::DEBUG::2013-03-01 14:28:08,813::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de`ReqID=`e3195648-6008-49a8-bf1f-68691f3e8b71`::Granted request >Thread-506::DEBUG::2013-03-01 14:28:08,813::task::794::TaskManager.Task::(resourceAcquired) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_resourcesAcquired: Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de (shared) >Thread-506::DEBUG::2013-03-01 14:28:08,814::task::957::TaskManager.Task::(_decref) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::ref 1 aborting False >Thread-506::DEBUG::2013-03-01 14:28:08,816::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >Thread-506::DEBUG::2013-03-01 14:28:08,822::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-506::INFO::2013-03-01 14:28:08,822::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-506::DEBUG::2013-03-01 14:28:08,822::task::1146::TaskManager.Task::(prepare) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::Prepare: 1 jobs exist, move to acquiring >Thread-506::DEBUG::2013-03-01 14:28:08,822::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state preparing -> state acquiring >Thread-506::DEBUG::2013-03-01 14:28:08,823::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >Thread-506::DEBUG::2013-03-01 14:28:08,828::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state acquiring -> state queued >Thread-506::DEBUG::2013-03-01 14:28:08,829::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >Thread-506::DEBUG::2013-03-01 14:28:08,834::taskManager::50::TaskManager::(_queueTask) queuing task: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-506::DEBUG::2013-03-01 14:28:08,835::taskManager::56::TaskManager::(_queueTask) task queued: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-506::DEBUG::2013-03-01 14:28:08,835::task::1148::TaskManager.Task::(prepare) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::returning >c7d77fc5-8b9d-4b52-b2cd-0821de628aba::DEBUG::2013-03-01 14:28:08,835::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-506::DEBUG::2013-03-01 14:28:08,836::task::957::TaskManager.Task::(_decref) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::ref 0 aborting False >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,837::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: b4460f6b-1a40-4277-afdf-825911b46a10 running: <bound method Task.commit of <storage.task.Task instance at 0x7fcf54100a70>> with: None >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,837::task::1159::TaskManager.Task::(commit) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::committing task: b4460f6b-1a40-4277-afdf-825911b46a10 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,839::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state queued -> state running >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,841::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,846::task::872::TaskManager.Task::(_runJobs) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fcf28045450>> (args: ('5dd04e7f-8474-4d0a-ae61-24f8fd2556de', '1a4716ae-3960-478e-84e3-22f14c539280', 41943040, 4, 2, 2, '8b39a324-63e8-4aab-bd5b-e7055b208687', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,847::task::304::TaskManager.Task::(run) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fcf28045450>> (args: ('5dd04e7f-8474-4d0a-ae61-24f8fd2556de', '1a4716ae-3960-478e-84e3-22f14c539280', 41943040, 4, 2, 2, '8b39a324-63e8-4aab-bd5b-e7055b208687', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,847::resourceManager::175::ResourceManager.Request::(__init__) ResName=`5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280`ReqID=`7307d18e-c1eb-43f6-8fc5-fc597055cc75`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,847::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280' for lock type 'exclusive' >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,848::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:08,849::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-508::DEBUG::2013-03-01 14:28:08,895::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-508::DEBUG::2013-03-01 14:28:08,896::task::568::TaskManager.Task::(_updateState) Task=`a9e5eddb-9df9-444f-9f37-85077c70504b`::moving from state init -> state preparing >Thread-508::INFO::2013-03-01 14:28:08,896::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None) >Thread-508::DEBUG::2013-03-01 14:28:08,897::taskManager::181::TaskManager::(getAllTasksInfo) Entry. >Thread-508::DEBUG::2013-03-01 14:28:08,897::taskManager::171::TaskManager::(getTaskInfo) Entry. taskID: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-508::DEBUG::2013-03-01 14:28:08,897::taskManager::174::TaskManager::(getTaskInfo) Return. Response: {'verb': 'createVolume', 'id': 'b4460f6b-1a40-4277-afdf-825911b46a10'} >Thread-508::DEBUG::2013-03-01 14:28:08,897::taskManager::192::TaskManager::(getAllTasksInfo) Return. Response: {'b4460f6b-1a40-4277-afdf-825911b46a10': {'verb': 'createVolume', 'id': 'b4460f6b-1a40-4277-afdf-825911b46a10'}} >Thread-508::INFO::2013-03-01 14:28:08,897::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {'b4460f6b-1a40-4277-afdf-825911b46a10': {'verb': 'createVolume', 'id': 'b4460f6b-1a40-4277-afdf-825911b46a10'}}} >Thread-508::DEBUG::2013-03-01 14:28:08,898::task::1151::TaskManager.Task::(prepare) Task=`a9e5eddb-9df9-444f-9f37-85077c70504b`::finished: {'allTasksInfo': {'b4460f6b-1a40-4277-afdf-825911b46a10': {'verb': 'createVolume', 'id': 'b4460f6b-1a40-4277-afdf-825911b46a10'}}} >Thread-508::DEBUG::2013-03-01 14:28:08,898::task::568::TaskManager.Task::(_updateState) Task=`a9e5eddb-9df9-444f-9f37-85077c70504b`::moving from state preparing -> state finished >Thread-508::DEBUG::2013-03-01 14:28:08,898::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-508::DEBUG::2013-03-01 14:28:08,898::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-508::DEBUG::2013-03-01 14:28:08,898::task::957::TaskManager.Task::(_decref) Task=`a9e5eddb-9df9-444f-9f37-85077c70504b`::ref 0 aborting False >Thread-509::DEBUG::2013-03-01 14:28:08,980::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-509::DEBUG::2013-03-01 14:28:08,980::task::568::TaskManager.Task::(_updateState) Task=`cf9f6758-0420-476d-b01a-0d103e7b2974`::moving from state init -> state preparing >Thread-509::INFO::2013-03-01 14:28:08,981::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-509::INFO::2013-03-01 14:28:08,981::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-509::DEBUG::2013-03-01 14:28:08,981::task::1151::TaskManager.Task::(prepare) Task=`cf9f6758-0420-476d-b01a-0d103e7b2974`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-509::DEBUG::2013-03-01 14:28:08,981::task::568::TaskManager.Task::(_updateState) Task=`cf9f6758-0420-476d-b01a-0d103e7b2974`::moving from state preparing -> state finished >Thread-509::DEBUG::2013-03-01 14:28:08,981::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-509::DEBUG::2013-03-01 14:28:08,982::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-509::DEBUG::2013-03-01 14:28:08,982::task::957::TaskManager.Task::(_decref) Task=`cf9f6758-0420-476d-b01a-0d103e7b2974`::ref 0 aborting False >Thread-510::DEBUG::2013-03-01 14:28:09,045::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-510::DEBUG::2013-03-01 14:28:09,045::task::568::TaskManager.Task::(_updateState) Task=`b7df31cc-a5cf-47b8-a513-c7ddeea2bea7`::moving from state init -> state preparing >Thread-510::INFO::2013-03-01 14:28:09,046::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-510::DEBUG::2013-03-01 14:28:09,046::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b32a371d-79c2-4f25-b4b5-87e6eda93e54`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-510::DEBUG::2013-03-01 14:28:09,046::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-510::DEBUG::2013-03-01 14:28:09,047::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-510::DEBUG::2013-03-01 14:28:09,047::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b32a371d-79c2-4f25-b4b5-87e6eda93e54`::Granted request >Thread-510::DEBUG::2013-03-01 14:28:09,047::task::794::TaskManager.Task::(resourceAcquired) Task=`b7df31cc-a5cf-47b8-a513-c7ddeea2bea7`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-510::DEBUG::2013-03-01 14:28:09,048::task::957::TaskManager.Task::(_decref) Task=`b7df31cc-a5cf-47b8-a513-c7ddeea2bea7`::ref 1 aborting False >Thread-510::INFO::2013-03-01 14:28:09,049::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-510::DEBUG::2013-03-01 14:28:09,049::task::1151::TaskManager.Task::(prepare) Task=`b7df31cc-a5cf-47b8-a513-c7ddeea2bea7`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-510::DEBUG::2013-03-01 14:28:09,050::task::568::TaskManager.Task::(_updateState) Task=`b7df31cc-a5cf-47b8-a513-c7ddeea2bea7`::moving from state preparing -> state finished >Thread-510::DEBUG::2013-03-01 14:28:09,050::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-510::DEBUG::2013-03-01 14:28:09,050::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-510::DEBUG::2013-03-01 14:28:09,051::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-510::DEBUG::2013-03-01 14:28:09,051::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-510::DEBUG::2013-03-01 14:28:09,051::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-510::DEBUG::2013-03-01 14:28:09,051::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-510::DEBUG::2013-03-01 14:28:09,052::task::957::TaskManager.Task::(_decref) Task=`b7df31cc-a5cf-47b8-a513-c7ddeea2bea7`::ref 0 aborting False >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,062::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,069::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,070::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 1a4716ae-3960-478e-84e3-22f14c539280 does not exist in domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,070::resourceManager::528::ResourceManager::(registerResource) Resource '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280' is free. Now locking as 'exclusive' (1 active user) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,070::resourceManager::212::ResourceManager.Request::(grant) ResName=`5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280`ReqID=`7307d18e-c1eb-43f6-8fc5-fc597055cc75`::Granted request >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:09,071::image::120::Storage.Image::(create) Create placeholder /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280 for image's volumes >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,071::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,078::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,078::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-511::DEBUG::2013-03-01 14:28:09,138::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-511::DEBUG::2013-03-01 14:28:09,139::task::568::TaskManager.Task::(_updateState) Task=`8245160c-2b9b-462b-8260-bd2e6c588acd`::moving from state init -> state preparing >Thread-511::INFO::2013-03-01 14:28:09,139::logUtils::37::dispatcher::(wrapper) Run and protect: stopTask(taskID='b4460f6b-1a40-4277-afdf-825911b46a10', spUUID=None, options=None) >Thread-511::DEBUG::2013-03-01 14:28:09,139::taskManager::145::TaskManager::(stopTask) Entry. taskID: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-511::DEBUG::2013-03-01 14:28:09,139::task::1177::TaskManager.Task::(stop) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::stopping in state running (force False) >Thread-511::DEBUG::2013-03-01 14:28:09,140::task::957::TaskManager.Task::(_decref) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::ref 1 aborting True >Thread-511::DEBUG::2013-03-01 14:28:09,140::taskManager::148::TaskManager::(stopTask) Return. >Thread-511::INFO::2013-03-01 14:28:09,140::logUtils::39::dispatcher::(wrapper) Run and protect: stopTask, Return response: True >Thread-511::DEBUG::2013-03-01 14:28:09,140::task::1151::TaskManager.Task::(prepare) Task=`8245160c-2b9b-462b-8260-bd2e6c588acd`::finished: True >Thread-511::DEBUG::2013-03-01 14:28:09,140::task::568::TaskManager.Task::(_updateState) Task=`8245160c-2b9b-462b-8260-bd2e6c588acd`::moving from state preparing -> state finished >Thread-511::DEBUG::2013-03-01 14:28:09,141::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-511::DEBUG::2013-03-01 14:28:09,141::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-511::DEBUG::2013-03-01 14:28:09,141::task::957::TaskManager.Task::(_decref) Task=`8245160c-2b9b-462b-8260-bd2e6c588acd`::ref 0 aborting False >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,279::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,284::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::WARNING::2013-03-01 14:28:09,284::lvm::593::Storage.LVM::(getLv) lv: 8b39a324-63e8-4aab-bd5b-e7055b208687 not found in lvs vg: 5dd04e7f-8474-4d0a-ae61-24f8fd2556de response >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:09,286::volume::457::Storage.Volume::(create) Creating volume 8b39a324-63e8-4aab-bd5b-e7055b208687 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,286::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,296::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:09,306::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 8b39a324-63e8-4aab-bd5b-e7055b208687 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-322::DEBUG::2013-03-01 14:28:09,626::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 46a88efb-817e-49ba-b498-4fae08c6e657 >Thread-322::DEBUG::2013-03-01 14:28:09,627::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-322::DEBUG::2013-03-01 14:28:09,628::misc::83::Storage.Misc.excCmd::(<lambda>) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-151::DEBUG::2013-03-01 14:28:09,637::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:28:09,646::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000353204 s, 11.6 MB/s\n'; <rc> = 0 >Dummy-502::DEBUG::2013-03-01 14:28:09,730::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:09,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318066 s, 32.2 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:28:09,845::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:28:09,846::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-322::DEBUG::2013-03-01 14:28:09,846::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-322::DEBUG::2013-03-01 14:28:09,847::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:28:09,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000289123 s, 7.1 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:28:09,856::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000289123 s, 7.1 MB/s'], size: 2048 >Thread-322::DEBUG::2013-03-01 14:28:09,856::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ImpExp_iscsi', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=0', 'PHYBLKSIZE=4096', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', 'PV0=pv:3514f0c542a0004c4,uuid:73Krnh-uv58-OAdK-YgFQ-Fd3g-L4k0-hmm9ib,pestart:0,pecount:397,mapoffset:0', 'ROLE=Regular', 'SDUUID=46a88efb-817e-49ba-b498-4fae08c6e657', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=gXgDqO-etsV-EHKJ-ytyk-Z89s-JG8B-oQnwHI', '_SHA_CKSUM=9150cd0205e3d12ae60fcb652778b25da8168a37'] >Thread-322::WARNING::2013-03-01 14:28:09,857::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 46a88efb-817e-49ba-b498-4fae08c6e657_imageNS already registered >Thread-322::WARNING::2013-03-01 14:28:09,857::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 46a88efb-817e-49ba-b498-4fae08c6e657_volumeNS already registered >Thread-322::WARNING::2013-03-01 14:28:09,857::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 46a88efb-817e-49ba-b498-4fae08c6e657_lvmActivationNS already registered >Thread-322::DEBUG::2013-03-01 14:28:09,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 46a88efb-817e-49ba-b498-4fae08c6e657' (cwd None) >Thread-512::DEBUG::2013-03-01 14:28:09,946::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-512::DEBUG::2013-03-01 14:28:09,946::task::568::TaskManager.Task::(_updateState) Task=`5f0cb65b-d33e-4ea5-96ad-0f29ef19313b`::moving from state init -> state preparing >Thread-512::INFO::2013-03-01 14:28:09,946::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-512::DEBUG::2013-03-01 14:28:09,947::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-512::DEBUG::2013-03-01 14:28:09,947::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-512::DEBUG::2013-03-01 14:28:09,947::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'} >Thread-512::DEBUG::2013-03-01 14:28:09,947::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'b4460f6b-1a40-4277-afdf-825911b46a10': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'}} >Thread-512::INFO::2013-03-01 14:28:09,947::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'b4460f6b-1a40-4277-afdf-825911b46a10': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'}}} >Thread-512::DEBUG::2013-03-01 14:28:09,948::task::1151::TaskManager.Task::(prepare) Task=`5f0cb65b-d33e-4ea5-96ad-0f29ef19313b`::finished: {'allTasksStatus': {'b4460f6b-1a40-4277-afdf-825911b46a10': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'}}} >Thread-512::DEBUG::2013-03-01 14:28:09,948::task::568::TaskManager.Task::(_updateState) Task=`5f0cb65b-d33e-4ea5-96ad-0f29ef19313b`::moving from state preparing -> state finished >Thread-512::DEBUG::2013-03-01 14:28:09,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-512::DEBUG::2013-03-01 14:28:09,948::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-512::DEBUG::2013-03-01 14:28:09,948::task::957::TaskManager.Task::(_decref) Task=`5f0cb65b-d33e-4ea5-96ad-0f29ef19313b`::ref 0 aborting False >Thread-322::DEBUG::2013-03-01 14:28:10,057::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:28:10,057::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:28:10,065::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000296424 s, 13.8 MB/s\n'; <rc> = 0 >Dummy-502::DEBUG::2013-03-01 14:28:11,822::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:11,924::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470374 s, 21.8 MB/s\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,143::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,144::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,144::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,145::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,145::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:12,146::blockVolume::174::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280/8b39a324-63e8-4aab-bd5b-e7055b208687 with size = 41943040 sectors >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,146::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280/8b39a324-63e8-4aab-bd5b-e7055b208687 20971520K' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,174::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,175::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,176::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,431::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,439::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::WARNING::2013-03-01 14:28:12,439::blockSD::737::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 5dd04e7f-8474-4d0a-ae61-24f8fd2556de/8b39a324-63e8-4aab-bd5b-e7055b208687 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,439::blockSD::760::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:12,440::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_1a4716ae-3960-478e-84e3-22f14c539280 5dd04e7f-8474-4d0a-ae61-24f8fd2556de/8b39a324-63e8-4aab-bd5b-e7055b208687' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:13,945::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:14,130::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:14,159::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:14,188::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:14,275::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 5dd04e7f-8474-4d0a-ae61-24f8fd2556de/8b39a324-63e8-4aab-bd5b-e7055b208687' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:15,140::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.930493 s, 1.1 MB/s\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,322::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,322::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,323::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,324::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,334::blockVolume::607::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=8b39a324-63e8-4aab-bd5b-e7055b208687 sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de, metaId=('5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 4) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,339::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,346::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280' >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,346::resourceManager::553::ResourceManager::(releaseResource) Released resource '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280' (0 active users) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,347::resourceManager::558::ResourceManager::(releaseResource) Resource '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280' is free, finding out if anyone is waiting for it. >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,347::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS.1a4716ae-3960-478e-84e3-22f14c539280', Clearing records. >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,347::task::571::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state running -> state aborting instead of finished >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,348::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,355::task::523::TaskManager.Task::(__state_aborting) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_aborting: recover policy auto >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,355::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state aborting -> state racquiring >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,355::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,362::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state racquiring -> state recovering >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,363::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,371::task::765::TaskManager.Task::(_recover) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_recover >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,372::task::772::TaskManager.Task::(_recover) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::running recovery Create volume rollback: BlockVolume->createVolumeRollback(/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251,5dd04e7f-8474-4d0a-ae61-24f8fd2556de,1a4716ae-3960-478e-84e3-22f14c539280,8b39a324-63e8-4aab-bd5b-e7055b208687,/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280) >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:15,372::volume::366::Storage.Volume::(createVolumeRollback) createVolumeRollback: repoPath=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251 sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de imgUUID=1a4716ae-3960-478e-84e3-22f14c539280 volUUID=8b39a324-63e8-4aab-bd5b-e7055b208687 imageDir=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,373::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,374::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,617::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,654::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,660::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,661::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,895::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,903::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:15,904::blockVolume::207::Storage.Volume::(delete) Request to delete LV 8b39a324-63e8-4aab-bd5b-e7055b208687 of image 1a4716ae-3960-478e-84e3-22f14c539280 in VG 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:15,905::volume::582::Storage.Volume::(setLegality) sdUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de imgUUID=1a4716ae-3960-478e-84e3-22f14c539280 volUUID = 8b39a324-63e8-4aab-bd5b-e7055b208687 legality = ILLEGAL >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,905::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,914::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00029572 s, 1.7 MB/s\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,914::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00029572 s, 1.7 MB/s'], size: 512 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,916::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,924::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000300466 s, 1.7 MB/s\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,924::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000300466 s, 1.7 MB/s'], size: 512 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:15,926::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 5dd04e7f-8474-4d0a-ae61-24f8fd2556de/8b39a324-63e8-4aab-bd5b-e7055b208687' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,158::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,158::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,159::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,160::lvm::414::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,378::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,386::lvm::447::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,386::task::772::TaskManager.Task::(_recover) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::running recovery create image rollback: 1a4716ae-3960-478e-84e3-22f14c539280: Image->createImageRollback(/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280) >b4460f6b-1a40-4277-afdf-825911b46a10::INFO::2013-03-01 14:28:16,387::image::101::Storage.Image::(createImageRollback) createImageRollback: imageDir=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/images/1a4716ae-3960-478e-84e3-22f14c539280 >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,387::task::772::TaskManager.Task::(_recover) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::running recovery None >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,387::task::753::TaskManager.Task::(_recoverDone) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::Recover Done: state recovering >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,387::task::568::TaskManager.Task::(_updateState) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::moving from state recovering -> state recovered >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,389::task::719::TaskManager.Task::(_save) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::_save: orig /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10 temp /rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/master/tasks/b4460f6b-1a40-4277-afdf-825911b46a10.temp >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,395::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de': < ResourceRef 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', isValid: 'True' obj: 'None'>} >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,396::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,396::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,396::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (0 active users) >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,396::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de' is free, finding out if anyone is waiting for it. >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,397::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5dd04e7f-8474-4d0a-ae61-24f8fd2556de', Clearing records. >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,397::task::880::TaskManager.Task::(_runJobs) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::Task.run: exit - success: result {'uuid': '8b39a324-63e8-4aab-bd5b-e7055b208687'} >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,397::task::957::TaskManager.Task::(_decref) Task=`b4460f6b-1a40-4277-afdf-825911b46a10`::ref 0 aborting False >b4460f6b-1a40-4277-afdf-825911b46a10::DEBUG::2013-03-01 14:28:16,397::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-502::DEBUG::2013-03-01 14:28:17,153::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:17,233::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312903 s, 32.7 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:17,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:28:17,982::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000266232 s, 15.4 MB/s\n'; <rc> = 0 >Thread-515::DEBUG::2013-03-01 14:28:18,056::task::568::TaskManager.Task::(_updateState) Task=`fa895045-6872-4a2a-9831-ab1cb254dd0d`::moving from state init -> state preparing >Thread-515::INFO::2013-03-01 14:28:18,057::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-515::INFO::2013-03-01 14:28:18,057::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.00860381126404', 'lastCheck': '8.0', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00856304168701', 'lastCheck': '0.1', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0107090473175', 'lastCheck': '8.4', 'code': 0, 'valid': True}} >Thread-515::DEBUG::2013-03-01 14:28:18,057::task::1151::TaskManager.Task::(prepare) Task=`fa895045-6872-4a2a-9831-ab1cb254dd0d`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '0.00860381126404', 'lastCheck': '8.0', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '0.00856304168701', 'lastCheck': '0.1', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '0.0107090473175', 'lastCheck': '8.4', 'code': 0, 'valid': True}} >Thread-515::DEBUG::2013-03-01 14:28:18,057::task::568::TaskManager.Task::(_updateState) Task=`fa895045-6872-4a2a-9831-ab1cb254dd0d`::moving from state preparing -> state finished >Thread-515::DEBUG::2013-03-01 14:28:18,057::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-515::DEBUG::2013-03-01 14:28:18,058::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-515::DEBUG::2013-03-01 14:28:18,058::task::957::TaskManager.Task::(_decref) Task=`fa895045-6872-4a2a-9831-ab1cb254dd0d`::ref 0 aborting False >Thread-517::DEBUG::2013-03-01 14:28:19,148::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-517::DEBUG::2013-03-01 14:28:19,165::task::568::TaskManager.Task::(_updateState) Task=`26ddb66d-74dd-4054-89d7-10dadb629100`::moving from state init -> state preparing >Thread-517::INFO::2013-03-01 14:28:19,165::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-517::INFO::2013-03-01 14:28:19,166::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-517::DEBUG::2013-03-01 14:28:19,166::task::1151::TaskManager.Task::(prepare) Task=`26ddb66d-74dd-4054-89d7-10dadb629100`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-517::DEBUG::2013-03-01 14:28:19,166::task::568::TaskManager.Task::(_updateState) Task=`26ddb66d-74dd-4054-89d7-10dadb629100`::moving from state preparing -> state finished >Thread-517::DEBUG::2013-03-01 14:28:19,166::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-517::DEBUG::2013-03-01 14:28:19,167::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-517::DEBUG::2013-03-01 14:28:19,167::task::957::TaskManager.Task::(_decref) Task=`26ddb66d-74dd-4054-89d7-10dadb629100`::ref 0 aborting False >Dummy-502::DEBUG::2013-03-01 14:28:19,247::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-151::DEBUG::2013-03-01 14:28:19,654::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:28:19,656::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-518::DEBUG::2013-03-01 14:28:19,665::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-518::DEBUG::2013-03-01 14:28:19,668::task::568::TaskManager.Task::(_updateState) Task=`546cda57-a662-4a35-9d4f-109aefc59e35`::moving from state init -> state preparing >Thread-518::INFO::2013-03-01 14:28:19,668::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-518::DEBUG::2013-03-01 14:28:19,669::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`66448856-6e78-4035-b0a9-95b727e81de9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-518::DEBUG::2013-03-01 14:28:19,670::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-518::DEBUG::2013-03-01 14:28:19,670::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-518::DEBUG::2013-03-01 14:28:19,671::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`66448856-6e78-4035-b0a9-95b727e81de9`::Granted request >Thread-518::DEBUG::2013-03-01 14:28:19,671::task::794::TaskManager.Task::(resourceAcquired) Task=`546cda57-a662-4a35-9d4f-109aefc59e35`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-518::DEBUG::2013-03-01 14:28:19,672::task::957::TaskManager.Task::(_decref) Task=`546cda57-a662-4a35-9d4f-109aefc59e35`::ref 1 aborting False >Thread-518::DEBUG::2013-03-01 14:28:19,673::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-518::DEBUG::2013-03-01 14:28:19,673::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:19,739::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0599403 s, 17.1 MB/s\n'; <rc> = 0 >Thread-322::DEBUG::2013-03-01 14:28:20,067::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:21,752::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-229::DEBUG::2013-03-01 14:28:27,986::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:28:49,167::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000379786 s, 10.8 MB/s\n'; <rc> = 0 >Thread-229::DEBUG::2013-03-01 14:28:53,664::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000308568 s, 13.3 MB/s\n'; <rc> = 0 >Dummy-502::DEBUG::2013-03-01 14:28:53,739::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437434 s, 23.4 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:28:53,751::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:28:54,337::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:28:54,346::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304895 s, 13.4 MB/s\n'; <rc> = 0 >Thread-518::DEBUG::2013-03-01 14:28:54,449::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-518::DEBUG::2013-03-01 14:28:54,451::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-518::INFO::2013-03-01 14:28:54,453::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-518::DEBUG::2013-03-01 14:28:54,453::task::1151::TaskManager.Task::(prepare) Task=`546cda57-a662-4a35-9d4f-109aefc59e35`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-518::DEBUG::2013-03-01 14:28:54,454::task::568::TaskManager.Task::(_updateState) Task=`546cda57-a662-4a35-9d4f-109aefc59e35`::moving from state preparing -> state finished >Thread-518::DEBUG::2013-03-01 14:28:54,454::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-518::DEBUG::2013-03-01 14:28:54,455::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-518::DEBUG::2013-03-01 14:28:54,455::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-518::DEBUG::2013-03-01 14:28:54,455::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-518::DEBUG::2013-03-01 14:28:54,456::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-518::DEBUG::2013-03-01 14:28:54,456::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-518::DEBUG::2013-03-01 14:28:54,457::task::957::TaskManager.Task::(_decref) Task=`546cda57-a662-4a35-9d4f-109aefc59e35`::ref 0 aborting False >Thread-521::DEBUG::2013-03-01 14:28:54,528::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-521::DEBUG::2013-03-01 14:28:54,528::task::568::TaskManager.Task::(_updateState) Task=`5307e5d6-16e6-44ac-a135-ba5acced72db`::moving from state init -> state preparing >Thread-521::INFO::2013-03-01 14:28:54,528::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-521::DEBUG::2013-03-01 14:28:54,529::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-521::DEBUG::2013-03-01 14:28:54,529::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-521::DEBUG::2013-03-01 14:28:54,529::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'cleanSuccess', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'} >Thread-521::DEBUG::2013-03-01 14:28:54,529::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'b4460f6b-1a40-4277-afdf-825911b46a10': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'cleanSuccess', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'}} >Thread-521::INFO::2013-03-01 14:28:54,529::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'b4460f6b-1a40-4277-afdf-825911b46a10': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'cleanSuccess', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'}}} >Thread-521::DEBUG::2013-03-01 14:28:54,530::task::1151::TaskManager.Task::(prepare) Task=`5307e5d6-16e6-44ac-a135-ba5acced72db`::finished: {'allTasksStatus': {'b4460f6b-1a40-4277-afdf-825911b46a10': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'cleanSuccess', 'taskID': 'b4460f6b-1a40-4277-afdf-825911b46a10'}}} >Thread-521::DEBUG::2013-03-01 14:28:54,530::task::568::TaskManager.Task::(_updateState) Task=`5307e5d6-16e6-44ac-a135-ba5acced72db`::moving from state preparing -> state finished >Thread-521::DEBUG::2013-03-01 14:28:54,530::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-521::DEBUG::2013-03-01 14:28:54,530::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-521::DEBUG::2013-03-01 14:28:54,530::task::957::TaskManager.Task::(_decref) Task=`5307e5d6-16e6-44ac-a135-ba5acced72db`::ref 0 aborting False >Thread-522::DEBUG::2013-03-01 14:28:54,692::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-522::DEBUG::2013-03-01 14:28:54,919::task::568::TaskManager.Task::(_updateState) Task=`0ee3d144-a1ea-47a3-89d2-1227e85286c1`::moving from state init -> state preparing >Thread-522::INFO::2013-03-01 14:28:54,919::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='b4460f6b-1a40-4277-afdf-825911b46a10', spUUID=None, options=None) >Thread-522::DEBUG::2013-03-01 14:28:54,919::taskManager::161::TaskManager::(clearTask) Entry. taskID: b4460f6b-1a40-4277-afdf-825911b46a10 >Thread-522::DEBUG::2013-03-01 14:28:54,920::taskManager::166::TaskManager::(clearTask) Return. >Thread-522::INFO::2013-03-01 14:28:54,921::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-522::DEBUG::2013-03-01 14:28:54,921::task::1151::TaskManager.Task::(prepare) Task=`0ee3d144-a1ea-47a3-89d2-1227e85286c1`::finished: None >Thread-522::DEBUG::2013-03-01 14:28:54,921::task::568::TaskManager.Task::(_updateState) Task=`0ee3d144-a1ea-47a3-89d2-1227e85286c1`::moving from state preparing -> state finished >Thread-522::DEBUG::2013-03-01 14:28:54,921::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-522::DEBUG::2013-03-01 14:28:54,922::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-522::DEBUG::2013-03-01 14:28:54,922::task::957::TaskManager.Task::(_decref) Task=`0ee3d144-a1ea-47a3-89d2-1227e85286c1`::ref 0 aborting False >Dummy-502::DEBUG::2013-03-01 14:28:56,338::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:28:56,459::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0570469 s, 18.0 MB/s\n'; <rc> = 0 >Dummy-502::DEBUG::2013-03-01 14:28:58,472::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-322::DEBUG::2013-03-01 14:29:03,661::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-229::DEBUG::2013-03-01 14:29:03,666::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:29:04,357::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-525::DEBUG::2013-03-01 14:29:04,731::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-525::DEBUG::2013-03-01 14:29:12,565::task::568::TaskManager.Task::(_updateState) Task=`1dca9928-0e70-46fa-bbf4-36b23398e51c`::moving from state init -> state preparing >Thread-525::INFO::2013-03-01 14:29:12,570::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-525::INFO::2013-03-01 14:29:12,576::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-229::DEBUG::2013-03-01 14:29:12,578::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000272664 s, 15.0 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:29:12,579::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00029919 s, 13.7 MB/s\n'; <rc> = 0 >Thread-525::DEBUG::2013-03-01 14:29:12,579::task::1151::TaskManager.Task::(prepare) Task=`1dca9928-0e70-46fa-bbf4-36b23398e51c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-525::DEBUG::2013-03-01 14:29:12,584::task::568::TaskManager.Task::(_updateState) Task=`1dca9928-0e70-46fa-bbf4-36b23398e51c`::moving from state preparing -> state finished >Thread-322::DEBUG::2013-03-01 14:29:12,587::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000314042 s, 13.0 MB/s\n'; <rc> = 0 >Thread-525::DEBUG::2013-03-01 14:29:12,587::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-525::DEBUG::2013-03-01 14:29:12,591::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-525::DEBUG::2013-03-01 14:29:12,594::task::957::TaskManager.Task::(_decref) Task=`1dca9928-0e70-46fa-bbf4-36b23398e51c`::ref 0 aborting False >Thread-526::DEBUG::2013-03-01 14:29:12,634::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-526::DEBUG::2013-03-01 14:29:12,636::task::568::TaskManager.Task::(_updateState) Task=`297e14c1-e885-4acb-9593-78980ef19d59`::moving from state init -> state preparing >Thread-526::INFO::2013-03-01 14:29:12,638::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-526::DEBUG::2013-03-01 14:29:12,640::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`7147871e-b721-43f4-b8ff-d55bcf0bb4c5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-526::DEBUG::2013-03-01 14:29:12,641::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-526::DEBUG::2013-03-01 14:29:12,642::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-526::DEBUG::2013-03-01 14:29:12,644::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`7147871e-b721-43f4-b8ff-d55bcf0bb4c5`::Granted request >Thread-526::DEBUG::2013-03-01 14:29:12,646::task::794::TaskManager.Task::(resourceAcquired) Task=`297e14c1-e885-4acb-9593-78980ef19d59`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-526::DEBUG::2013-03-01 14:29:12,647::task::957::TaskManager.Task::(_decref) Task=`297e14c1-e885-4acb-9593-78980ef19d59`::ref 1 aborting False >Thread-526::INFO::2013-03-01 14:29:12,655::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-526::DEBUG::2013-03-01 14:29:12,656::task::1151::TaskManager.Task::(prepare) Task=`297e14c1-e885-4acb-9593-78980ef19d59`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-526::DEBUG::2013-03-01 14:29:12,657::task::568::TaskManager.Task::(_updateState) Task=`297e14c1-e885-4acb-9593-78980ef19d59`::moving from state preparing -> state finished >Thread-526::DEBUG::2013-03-01 14:29:12,658::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-526::DEBUG::2013-03-01 14:29:12,660::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-526::DEBUG::2013-03-01 14:29:12,661::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-526::DEBUG::2013-03-01 14:29:12,663::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-526::DEBUG::2013-03-01 14:29:12,664::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-526::DEBUG::2013-03-01 14:29:12,664::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-526::DEBUG::2013-03-01 14:29:12,666::task::957::TaskManager.Task::(_decref) Task=`297e14c1-e885-4acb-9593-78980ef19d59`::ref 0 aborting False >Dummy-502::DEBUG::2013-03-01 14:29:12,715::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142901 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-502::DEBUG::2013-03-01 14:29:14,728::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-527::DEBUG::2013-03-01 14:29:15,566::task::568::TaskManager.Task::(_updateState) Task=`d4718b9b-320d-4c74-9792-9bfbc2adb1e2`::moving from state init -> state preparing >Thread-229::DEBUG::2013-03-01 14:29:22,586::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/04bf19fa-db6c-4c8f-845f-b87411d8e898/metadata bs=4096 count=1' (cwd None) >Thread-322::DEBUG::2013-03-01 14:29:22,592::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/46a88efb-817e-49ba-b498-4fae08c6e657/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:29:22,610::domainMonitor::170::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 5dd04e7f-8474-4d0a-ae61-24f8fd2556de >Thread-528::DEBUG::2013-03-01 14:29:22,835::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-527::INFO::2013-03-01 14:29:51,841::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-151::DEBUG::2013-03-01 14:29:51,858::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-528::DEBUG::2013-03-01 14:29:51,860::task::568::TaskManager.Task::(_updateState) Task=`e526b31a-3246-412b-a77c-2e16dc34116c`::moving from state init -> state preparing >Thread-527::INFO::2013-03-01 14:29:51,863::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '8.92857098579', 'lastCheck': '39.3', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '8.91541910172', 'lastCheck': '39.3', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '8.22607898712', 'lastCheck': '39.2', 'code': 0, 'valid': True}} >Thread-151::DEBUG::2013-03-01 14:29:51,867::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata count=1' (cwd None) >Thread-528::INFO::2013-03-01 14:29:51,866::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-527::DEBUG::2013-03-01 14:29:51,867::task::1151::TaskManager.Task::(prepare) Task=`d4718b9b-320d-4c74-9792-9bfbc2adb1e2`::finished: {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'delay': '8.92857098579', 'lastCheck': '39.3', 'code': 0, 'valid': True}, '04bf19fa-db6c-4c8f-845f-b87411d8e898': {'delay': '8.91541910172', 'lastCheck': '39.3', 'code': 0, 'valid': True}, '5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'delay': '8.22607898712', 'lastCheck': '39.2', 'code': 0, 'valid': True}} >Thread-527::DEBUG::2013-03-01 14:29:51,879::task::568::TaskManager.Task::(_updateState) Task=`d4718b9b-320d-4c74-9792-9bfbc2adb1e2`::moving from state preparing -> state finished >Thread-527::DEBUG::2013-03-01 14:29:51,883::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-527::DEBUG::2013-03-01 14:29:51,887::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2013-03-01 14:29:51,888::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237856 s, 17.2 MB/s\n'; <rc> = 0 >Thread-527::DEBUG::2013-03-01 14:29:51,892::task::957::TaskManager.Task::(_decref) Task=`d4718b9b-320d-4c74-9792-9bfbc2adb1e2`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 14:29:51,896::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000287883 s, 7.1 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:29:51,899::misc::344::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000287883 s, 7.1 MB/s'], size: 2048 >Thread-151::DEBUG::2013-03-01 14:29:51,901::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-322::DEBUG::2013-03-01 14:29:51,903::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292314 s, 14.0 MB/s\n'; <rc> = 0 >Thread-151::WARNING::2013-03-01 14:29:51,903::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-151::DEBUG::2013-03-01 14:29:51,910::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-151::DEBUG::2013-03-01 14:29:51,913::lvm::488::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:29:51,915::lvm::490::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:29:51,917::lvm::498::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:29:51,920::lvm::510::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:29:51,923::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-151::DEBUG::2013-03-01 14:29:51,926::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:29:52,002::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125272 s, 8.2 MB/s\n'; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:29:52,187::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:29:52,188::lvm::402::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-151::DEBUG::2013-03-01 14:29:52,189::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['PHYBLKSIZE=4096', 'DESCRIPTION=iscsiStorageTest_data_domain0', 'VERSION=3', 'TYPE=ISCSI', 'VGUUID=NS0x3q-1C2v-Sh5p-4cka-UKEW-DuNG-iAoJeQ', u'PV0=pv:3514f0c542a0004c2,uuid:S608Xy-6kEb-NrAD-5vkT-uEsn-LfFC-BDjRMn,pestart:0,pecount:397,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'CLASS=Data', 'SDUUID=5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_DESCRIPTION=iscsiStorageTest', 'POOL_UUID=8fd46635-c46a-47a7-b122-316b2df29251', u'POOL_DOMAINS=46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=5029bd0c0b3b10ecde73750144b6d864017035c7', 'POOL_SPM_LVER=1'] >Thread-151::WARNING::2013-03-01 14:29:52,191::sd::361::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_imageNS already registered >Thread-151::WARNING::2013-03-01 14:29:52,191::sd::369::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_volumeNS already registered >Thread-151::WARNING::2013-03-01 14:29:52,191::blockSD::427::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 5dd04e7f-8474-4d0a-ae61-24f8fd2556de_lvmActivationNS already registered >Thread-528::INFO::2013-03-01 14:29:52,192::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-528::DEBUG::2013-03-01 14:29:52,194::task::1151::TaskManager.Task::(prepare) Task=`e526b31a-3246-412b-a77c-2e16dc34116c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-528::DEBUG::2013-03-01 14:29:52,195::task::568::TaskManager.Task::(_updateState) Task=`e526b31a-3246-412b-a77c-2e16dc34116c`::moving from state preparing -> state finished >Thread-528::DEBUG::2013-03-01 14:29:52,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2013-03-01 14:29:52,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a%3514f0c542a00047c|3514f0c542a00047d|3514f0c542a00048d|3514f0c542a00048e|3514f0c542a0004af|3514f0c542a0004b0|3514f0c542a0004b1|3514f0c542a0004c2|3514f0c542a0004c3|3514f0c542a0004c4%\', \'r%.*%\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 5dd04e7f-8474-4d0a-ae61-24f8fd2556de' (cwd None) >Thread-528::DEBUG::2013-03-01 14:29:52,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-528::DEBUG::2013-03-01 14:29:52,205::task::957::TaskManager.Task::(_decref) Task=`e526b31a-3246-412b-a77c-2e16dc34116c`::ref 0 aborting False >Thread-530::DEBUG::2013-03-01 14:29:52,234::BindingXMLRPC::161::vds::(wrapper) [10.35.161.121] >Thread-530::DEBUG::2013-03-01 14:29:52,235::task::568::TaskManager.Task::(_updateState) Task=`19654a01-190f-43ac-bfe5-5399dac66dcd`::moving from state init -> state preparing >Thread-530::INFO::2013-03-01 14:29:52,235::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='8fd46635-c46a-47a7-b122-316b2df29251', options=None) >Thread-530::DEBUG::2013-03-01 14:29:52,235::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b3755f37-225b-4804-bc24-1d183f9b240c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-530::DEBUG::2013-03-01 14:29:52,236::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' for lock type 'shared' >Thread-530::DEBUG::2013-03-01 14:29:52,236::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free. Now locking as 'shared' (1 active user) >Thread-530::DEBUG::2013-03-01 14:29:52,236::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8fd46635-c46a-47a7-b122-316b2df29251`ReqID=`b3755f37-225b-4804-bc24-1d183f9b240c`::Granted request >Thread-530::DEBUG::2013-03-01 14:29:52,237::task::794::TaskManager.Task::(resourceAcquired) Task=`19654a01-190f-43ac-bfe5-5399dac66dcd`::_resourcesAcquired: Storage.8fd46635-c46a-47a7-b122-316b2df29251 (shared) >Thread-530::DEBUG::2013-03-01 14:29:52,237::task::957::TaskManager.Task::(_decref) Task=`19654a01-190f-43ac-bfe5-5399dac66dcd`::ref 1 aborting False >Thread-530::INFO::2013-03-01 14:29:52,238::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-530::DEBUG::2013-03-01 14:29:52,239::task::1151::TaskManager.Task::(prepare) Task=`19654a01-190f-43ac-bfe5-5399dac66dcd`::finished: {'info': {'spm_id': 1, 'master_uuid': '5dd04e7f-8474-4d0a-ae61-24f8fd2556de', 'name': 'iscsiStorageTest', 'version': '3', 'domains': u'46a88efb-817e-49ba-b498-4fae08c6e657:Active,eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70:Attached,04bf19fa-db6c-4c8f-845f-b87411d8e898:Active,5dd04e7f-8474-4d0a-ae61-24f8fd2556de:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 1}, 'dominfo': {u'46a88efb-817e-49ba-b498-4fae08c6e657': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'eab602ce-ea7c-4e8b-8f16-6b7b1e6a2e70': {'status': u'Attached'}, u'04bf19fa-db6c-4c8f-845f-b87411d8e898': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}, u'5dd04e7f-8474-4d0a-ae61-24f8fd2556de': {'status': u'Active', 'diskfree': '49123688448', 'alerts': [], 'disktotal': '53284438016'}}} >Thread-530::DEBUG::2013-03-01 14:29:52,239::task::568::TaskManager.Task::(_updateState) Task=`19654a01-190f-43ac-bfe5-5399dac66dcd`::moving from state preparing -> state finished >Thread-530::DEBUG::2013-03-01 14:29:52,239::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8fd46635-c46a-47a7-b122-316b2df29251': < ResourceRef 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', isValid: 'True' obj: 'None'>} >Thread-530::DEBUG::2013-03-01 14:29:52,239::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-530::DEBUG::2013-03-01 14:29:52,240::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' >Thread-530::DEBUG::2013-03-01 14:29:52,240::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' (0 active users) >Thread-530::DEBUG::2013-03-01 14:29:52,240::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251' is free, finding out if anyone is waiting for it. >Thread-530::DEBUG::2013-03-01 14:29:52,240::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8fd46635-c46a-47a7-b122-316b2df29251', Clearing records. >Thread-530::DEBUG::2013-03-01 14:29:52,240::task::957::TaskManager.Task::(_decref) Task=`19654a01-190f-43ac-bfe5-5399dac66dcd`::ref 0 aborting False >Thread-151::DEBUG::2013-03-01 14:29:52,407::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-151::DEBUG::2013-03-01 14:29:52,408::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd iflag=direct if=/dev/5dd04e7f-8474-4d0a-ae61-24f8fd2556de/metadata bs=4096 count=1' (cwd None) >Thread-151::DEBUG::2013-03-01 14:29:52,415::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000283655 s, 14.4 MB/s\n'; <rc> = 0 >Dummy-502::DEBUG::2013-03-01 14:29:54,016::misc::83::Storage.Misc.excCmd::(<lambda>) 'dd if=/rhev/data-center/8fd46635-c46a-47a7-b122-316b2df29251/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-502::DEBUG::2013-03-01 14:29:54,124::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455553 s, 22.5 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 917042
:
704179
| 704180